Lead Data Engineer

7 months ago

Irving, United States IVID TEK INC Remote Work Freelance Full time $65 - $70
Position: Lead Data Engineer (GCP,Azure)
Location: Dallas, TX
Job Type: Contract C2C
Rate: 65-70/ Hr
Roles and Responsibilities:Key Skills: Vertex AI , GCP , Kubeflow , CI/CD , Python , BigData
Job Description:
  • Identify new opportunities to improve business processes and improve consumer experiences, and prototype solutions to demonstrate value with a crawl, walk, run mindset.
  • Work with data scientists and analysts to create and deploy new product features on the ecommerce website, in-store portals and the Client's mobile app
  • Implement end-to-end solutions across the full breadth of ML model development lifecycle. The specific role includes working hand in hand with the scientists from the point of data exploration for model development to the point of building features, mls and deploying them in production. You will have an opportunity to work on both batch and real time models. The role also involves operational support.
  • Establish scalable, efficient, automated processes for data analyses, model development, validation and implementation
  • Write efficient and scalable software to ship products in an iterative, continual-release environment
  • Contribute to and promote good software engineering practices across the team and build cloud native software for ML pipelines
  • Contribute to and re-use community best practices
  • Embody the values and passions that characterize client., with empathy to engage with colleagues from multiple backgrounds

About You
  • University or advanced degree in engineering, computer science, mathematics, or a related field
  • 10+ years' experience developing and deploying machine learning systems into production, and independent contributor.
  • Comfortable with Python ecosystem, vscode, jupyternotebooks.
  • Experience working with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with at least one cloud provider solution (AWS, GCP) and understanding of serverless code development (GCP preferred)
  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. (Python preferred)
  • CI/CD expert. And can work on GitHub actions, harness, Jenkins
  • Can work with Google Big Query, or similar warehouse.
  • Work on Kubeflow pipelines independently and propose standards.
  • Knowledge of Feature Engineering, Feature Store, and audit capabilities.
  • Expertise in standard software engineering methodology, e.g. unit testing, test automation, continuous integration, code reviews, design documentation
  • Working experience with native ML orchestration systems such as Kubeflow, Step Functions, MLflow, Airflow, TFX...
  • Relevant working experience with Docker and Kubernetes is a big plus
  • Review and integrate all application requirements, including functional, security, integration, performance, quality and operations requirements.
  • Experience on Data Analytics Solutions Cloud Architect experience of at least 3-4 years in development using Cloud Technologies and awareness of different processes around Big Data platforms GCP Experience of 1-2 years on BigQuery, GCS, Dataproc, Composer, Scheduler, Pub/Sub, Dataflow, Cloud Function Proficient in Python scripting language 1-2 years of development experience and 1 year of experience Professional Certification Google Cloud Platform
  • Hands on experience in Azure Cloud components such as Azure Data Factory, Azure Logic apps service, Data Bricks, AKS, Azure devops or any Cloud technologies
  • Provide technical leadership to the project team to perform design to deployment related activities, provide guidance, perform reviews, prevent and resolve technical issues.
  • Hands on experience with GCP services using GCP Console or Deployment Manager
  • Excellent communication written and oral and interpersonal skills

  • Data Engineering Lead

    2 weeks ago

    Irving, Texas, United States Vizient Full time

    This Data Engineering Lead role at Vizient involves overseeing the deployment, monitoring, and continuous improvement of AI models in production environments. The successful candidate will have 5+ years of experience in data engineering and a strong background in AI-enabled systems, machine learning model development, and data management.Key responsibilities...

  • Lead Data Engineer

    3 weeks ago

    Irving, United States CV Library Full time

    We are Lennar Lennar is one of the nation's leading homebuilders, dedicated to making an impact and creating an extraordinary experience for their Homeowners, Communities, and Associates by building quality homes and providing exceptional customer service, giving back to the communities in which we work and live in, and fostering a culture of opportunity...

  • Senior Data Engineering Lead

    2 weeks ago

    Irving, Texas, United States Resource Informatics Group Inc Full time

    About Resource Informatics Group Inc">Resource Informatics Group Inc is a leading provider of data engineering solutions. We are seeking an experienced Senior Data Engineering Lead to join our team and lead the development of our ETL processes. ">We require someone with 12+ years of experience in designing and implementing data pipelines, as well as strong...

  • Senior Data Engineering Lead

    3 weeks ago

    Irving, Texas, United States Gartner Full time

    About the Role: We are seeking a highly skilled Senior Data Engineering Lead to join our People Analytics Data Engineering team at Gartner. In this role, you will be responsible for developing and maintaining data warehouse modeling, data pipelines, and related analytics specific to People or workforce analytics in cloud data platforms.

  • Cloud Data Engineering Lead

    4 weeks ago

    Irving, Texas, United States Synechron Full time

    Overview">We are seeking a highly skilled Cloud Data Engineer to join our dynamic team with extensive experience in cloud technologies, including Snowflake, GCP, and Cloudera. The ideal candidate will lead the design, development, and implementation of complex cloud-based data architectures and provide technical expertise on Snowflake data warehouse and data...

  • Data Engineering Lead

    2 weeks ago

    Irving, Texas, United States ShiftCode Analytics Full time

    Job Description:At ShiftCode Analytics, we're looking for a seasoned Senior Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, developing, and delivering large-scale data solutions.Key Responsibilities:Design and implement complex data pipelines using various technologies.Develop and maintain...

  • Lead Big Data Engineer

    4 weeks ago

    Irving, United States Infovision Full time

    Job title: Lead Big Data Engineer (GCP Cloud) Location: Irving, TX Duration: Long-term Skills Needed: 10+ years of experience in designing and building data pipelines in large-scale distributed systems. Lead the design, development, and maintenance of scalable batch and real-time data processing pipelines. Proficiency with Google Cloud Platform (GCP) and...

  • Lead Big Data Engineer

    2 months ago

    Irving, United States Infovision Full time

    Job title: Lead Big Data Engineer (GCP Cloud)Location: Irving, TXDuration: Long-termSkills Needed:10+ years of experience in designing and building data pipelines in large-scale distributed systems.Lead the design, development, and maintenance of scalable batch and real-time data processing pipelines.Proficiency with Google Cloud Platform (GCP) and tools...

  • Lead Big Data Engineer

    2 months ago

    Irving, United States InfoVision Inc. Full time

    Job title: Lead Big Data Engineer (GCP Cloud)Location: Irving, TXDuration: Long-term Skills Needed:10+ years of experience in designing and building data pipelines in large-scale distributed systems.Lead the design, development, and maintenance of scalable batch and real-time data processing pipelines.Proficiency with Google Cloud Platform (GCP) and tools...

  • Lead Data Architect

    4 weeks ago

    Irving, Texas, United States Resource Informatics Group Inc Full time

    Job DescriptionLead Role - Data EngineeringWe seek a seasoned Lead Data Engineer with 12+ years of experience in ETL to lead and manage a team. Key responsibilities include leading the team, taking care of deliverables, and collaborating with colleagues to achieve project goals.Due to the critical nature of this role, we require a strong Lead who can also...

  • Data Engineer

    1 week ago

    Irving, United States Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Commercial - Lead Data Engineer

    4 weeks ago

    Irving, United States Luminant Energy Company LLC Full time

    If you have what it takes to become part of the Vistra family and would like to start a promising career with a global leader, take a look at the exciting employment opportunities that are currently available and apply online. Job Summary Technical role focused on designing, building, and maintaining the infrastructure required for optimal extraction,...

  • Data Engineer

    4 weeks ago

    Irving, United States Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Data Engineer Position

    6 days ago

    Irving, Texas, United States Resource Informatics Group Full time

    Job Title: Data Engineer PositionAbout Us: Resource Informatics Group is a leading provider of data engineering services. We work with clients to design and implement data pipelines that meet their business needs.Estimated Salary: $140,000 - $180,000 per year depending on experience.Description: We are seeking an experienced Data Engineer to join our team....

  • Senior Technical Lead

    4 weeks ago

    Irving, Texas, United States Synechron Full time

    Job Description">This role involves leading the design, development, and implementation of complex cloud-based data architectures, utilizing Snowflake, GCP, and Cloudera technologies. The ideal candidate will possess strong technical skills, including proficiency in SQL, data modeling, and data integration. Experience with data visualization tools and data...

  • Data Architect and Engineer

    3 weeks ago

    Irving, Texas, United States Synechron Full time

    About the Role">This Senior Technical Lead position is responsible for leading the engineering team for data cloud technologies and designing solutions for AWS, Snowflake, and other cloud platforms. The ideal candidate will have a strong background in cloud computing, data engineering, and data architecture, with experience in Snowflake, GCP, and Cloudera...

  • Data Engineer Lead

    4 weeks ago

    Irving, Texas, United States Tata Consultancy Services Full time

    Company Overview:Tata Consultancy Services is a leading global IT services company.Salary: The estimated salary for this position is $130,000 - $140,000 per year, plus benefits.Job Description:This is a full-time opportunity as a Big Data (PySpark) Tech Lead in Irving, TX.Required Skills and Qualifications:10+ years of overall experience in data management,...

  • Senior Linux Engineer

    3 months ago

    Irving, United States NTT DATA Full time

    Req ID: 299982 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Linux Engineer - Irving, Texas to join our team in Irving, Texas (US-TX), United States (US).NTT Data Americas is...

  • Lead Data Engineer

    4 weeks ago

    Irving, United States Vizient, Inc. Full time

    When you‘re the best, we‘re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to...

  • Cloud Data Engineer

    4 weeks ago

    Irving, United States Diverse Lynx Full time

    Role: Azure Data Engineer Location: Downtown Minneapolis (Day 1 Onsite) Full-Time Key Responsibilities: Position Overview We are seeking a Lead Developer with advanced skills in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to develop and manage ETL pipelines and data processing solutions that support AI/ML initiatives. The ideal...