AWS Data Engineer

2 days ago


San Francisco Bay Area, United States Incedo Inc. Full time

Job Description:

The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.


Responsibilities:

  • Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.
  • Use Spark on AWS for data transformation and processing across large datasets.
  • Develop and maintain efficient data workflows with SQS for task queueing and orchestration.
  • Integrate, transform, and manage data using Mulesoft and Talend for seamless data integration.
  • Ensure high-performance data storage, retrieval, and analytics across Redshift, DynamoDB, and Athena.
  • Oversee data consistency, integrity, and compliance through IQVIA MDM solutions.
  • Apply best practices in data governance, security, and scalability within a collaborative and cross-functional team environment.


Qualifications:

  • Proven expertise in AWS data engineering, specifically with Glue, EMR, Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.
  • Strong experience with data integration (Mulesoft, Talend)
  • Working knowledge of master data management (proficiency in IQVIA MDM is a plus).
  • Demonstrated ability to lead technical projects and mentor data engineering teams.
  • Exceptional analytical and communication skills.


  • san francisco bay area, United States Incedo Inc. Full time

    Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.Use Spark...

  • AWS Data Engineer

    4 weeks ago


    South San Francisco, United States RICEFW Technologies Inc Full time

    (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...

  • Sr. Data Engineer

    1 day ago


    San Francisco Bay Area, United States Acunor Full time

    Job Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...


  • san francisco bay area, United States Acunor Full time

    Job Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...

  • Data Engineer

    2 days ago


    San Francisco Bay Area, United States Intelliswift Software Full time

    Title: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...


  • South San Francisco, United States Agile Datapro Full time

    Job Title: (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite)Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:· Lead the design, implementation, and optimization of scalable data pipelines and architectures...

  • AWS Data Engineer

    1 month ago


    san francisco, United States Compunnel Inc. Full time

    Position: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...

  • AWS Data Engineer

    1 month ago


    san francisco, United States Compunnel Inc. Full time

    Position: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...

  • AWS Data Engineer

    1 month ago


    San Francisco, United States Compunnel Inc. Full time

    Position: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...

  • Data Engineer

    2 days ago


    San Francisco Bay Area, United States Diligente Technologies Full time

    Title: Data Engineer(Databricks Azure)Location: San Francisco, CA(Remote)Contract ResponsibilitiesLead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologiesWork with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisionsBuild...


  • san francisco bay area, United States Intelliswift Software Full time

    Title: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...


  • san francisco bay area, United States Intelliswift Software Full time

    Title: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...


  • Bodega Bay, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, United States Amazon Data Services, Inc. Full time

    This unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...

  • AWS Data Architect

    1 month ago


    san diego, United States Indotronix International Corporation Full time

    Job Title: AWS Data EngineerLocation: Remote (San Diego, CA 92130)Duration: 6 months (possibility of extension or conversion)Job Description:As the Senior Software Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data...

  • AWS Data Architect

    1 month ago


    San Diego, United States Indotronix International Corporation Full time

    Job Title: AWS Data EngineerLocation: Remote (San Diego, CA 92130)Duration: 6 months (possibility of extension or conversion)Job Description:As the Senior Software Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data...


  • san francisco, United States RICEFW Technologies Inc Full time

    (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...


  • san francisco, United States RICEFW Technologies Inc Full time

    (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...

  • Staff Engineer

    3 weeks ago


    San Francisco, United States Early Warning® Full time

    At Early Warning, we’ve powered and protected the U.S. financial system for over thirty years with cutting-edge solutions like Zelle, Paze℠, and so much more. As a trusted name in payments, we partner with thousands of institutions to increase access to financial services and protect transactions for hundreds of millions of consumers and small...


  • san francisco, United States Agile Datapro Full time

    Job Title: (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite)Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:· Lead the design, implementation, and optimization of scalable data pipelines and architectures...