AWS Data Engineer
2 days ago
Job Description:
The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.
Responsibilities:
- Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.
- Use Spark on AWS for data transformation and processing across large datasets.
- Develop and maintain efficient data workflows with SQS for task queueing and orchestration.
- Integrate, transform, and manage data using Mulesoft and Talend for seamless data integration.
- Ensure high-performance data storage, retrieval, and analytics across Redshift, DynamoDB, and Athena.
- Oversee data consistency, integrity, and compliance through IQVIA MDM solutions.
- Apply best practices in data governance, security, and scalability within a collaborative and cross-functional team environment.
Qualifications:
- Proven expertise in AWS data engineering, specifically with Glue, EMR, Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.
- Strong experience with data integration (Mulesoft, Talend)
- Working knowledge of master data management (proficiency in IQVIA MDM is a plus).
- Demonstrated ability to lead technical projects and mentor data engineering teams.
- Exceptional analytical and communication skills.
-
Incedo Inc. | AWS Data Engineer
1 day ago
san francisco bay area, United States Incedo Inc. Full timeJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.Use Spark...
-
AWS Data Engineer
4 weeks ago
South San Francisco, United States RICEFW Technologies Inc Full time(Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...
-
Sr. Data Engineer
1 day ago
San Francisco Bay Area, United States Acunor Full timeJob Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...
-
Acunor | Sr. Data Engineer
19 hours ago
san francisco bay area, United States Acunor Full timeJob Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...
-
Data Engineer
2 days ago
San Francisco Bay Area, United States Intelliswift Software Full timeTitle: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...
-
Technical Lead AWS Data Engineer
4 weeks ago
South San Francisco, United States Agile Datapro Full timeJob Title: (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite)Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:· Lead the design, implementation, and optimization of scalable data pipelines and architectures...
-
AWS Data Engineer
1 month ago
san francisco, United States Compunnel Inc. Full timePosition: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...
-
AWS Data Engineer
1 month ago
san francisco, United States Compunnel Inc. Full timePosition: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...
-
AWS Data Engineer
1 month ago
San Francisco, United States Compunnel Inc. Full timePosition: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...
-
Data Engineer
2 days ago
San Francisco Bay Area, United States Diligente Technologies Full timeTitle: Data Engineer(Databricks Azure)Location: San Francisco, CA(Remote)Contract ResponsibilitiesLead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologiesWork with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisionsBuild...
-
Intelliswift Software | Data Engineer
1 day ago
san francisco bay area, United States Intelliswift Software Full timeTitle: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...
-
Intelliswift Software | Data Engineer
1 day ago
san francisco bay area, United States Intelliswift Software Full timeTitle: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...
-
Senior Data Engineer
7 days ago
Bodega Bay, United States People Data Labs Full timeJob DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...
-
San Francisco, United States Amazon Data Services, Inc. Full timeThis unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...
-
AWS Data Architect
1 month ago
san diego, United States Indotronix International Corporation Full timeJob Title: AWS Data EngineerLocation: Remote (San Diego, CA 92130)Duration: 6 months (possibility of extension or conversion)Job Description:As the Senior Software Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data...
-
AWS Data Architect
1 month ago
San Diego, United States Indotronix International Corporation Full timeJob Title: AWS Data EngineerLocation: Remote (San Diego, CA 92130)Duration: 6 months (possibility of extension or conversion)Job Description:As the Senior Software Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data...
-
san francisco, United States RICEFW Technologies Inc Full time(Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...
-
san francisco, United States RICEFW Technologies Inc Full time(Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...
-
Staff Engineer
3 weeks ago
San Francisco, United States Early Warning® Full timeAt Early Warning, we’ve powered and protected the U.S. financial system for over thirty years with cutting-edge solutions like Zelle, Paze℠, and so much more. As a trusted name in payments, we partner with thousands of institutions to increase access to financial services and protect transactions for hundreds of millions of consumers and small...
-
san francisco, United States Agile Datapro Full timeJob Title: (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite)Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:· Lead the design, implementation, and optimization of scalable data pipelines and architectures...