Agile Datapro | Technical Lead AWS Data Engineer | san francisco, ca
5 days ago
Job Title: (Technical Lead) AWS Data Engineer
Location: South SFO, CA (Hybrid role – 3 days/week onsite)
Job Description:
The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.
Responsibilities:
· Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.
· Use Spark on AWS for data transformation and processing across large datasets.
· Develop and maintain efficient data workflows with SQS for task queueing and orchestration.
· Integrate, transform, and manage data using Mulesoft and Talend for seamless data integration.
· Ensure high-performance data storage, retrieval, and analytics across Redshift, DynamoDB, and Athena.
· Oversee data consistency, integrity, and compliance through IQVIA MDM solutions.
· Apply best practices in data governance, security, and scalability within a collaborative and cross-functional team environment.
Qualifications:
· Proven expertise in AWS data engineering, specifically with Glue, EMR, Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.
· Strong experience with data integration (Mulesoft, Talend)
· Working knowledge of master data management (proficiency in IQVIA MDM is a plus).
· Demonstrated ability to lead technical projects and mentor data engineering teams.
· Exceptional analytical and communication skills.
If you are interested to pursue the opportunity, please send your updated resume to saikat.g@agiledatapro.com along with your rate / salary information
-
Technical Lead AWS Data Engineer
5 days ago
South San Francisco, United States Agile Datapro Full timeJob Title: (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite)Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:· Lead the design, implementation, and optimization of scalable data pipelines and architectures...
-
san francisco, United States RICEFW Technologies Inc Full time(Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...
-
san francisco, United States RICEFW Technologies Inc Full time(Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...
-
AWS Data Engineer
2 weeks ago
san francisco, United States Compunnel Inc. Full timePosition: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...
-
AWS Data Engineer
3 weeks ago
San Francisco, United States Compunnel Inc. Full timePosition: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...
-
AWS Data Engineer
3 weeks ago
san francisco, United States Compunnel Inc. Full timePosition: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...
-
AWS Data Engineer
1 month ago
san francisco, United States Norconsulting Global Recruitment Full timeIn Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San FranciscoAWS Data EngineerLocation: San Francisco ( 3 days onsite 2 days remote)look for nearby Candidates only ( Only w2 Required)Rate: 70 USD per hourMust Have Skills : Spark, AWS, data lake, data pipelining, pythonJob Description:As an AWS Data Engineer, you...
-
AWS Data Engineer
1 month ago
San Francisco, United States Norconsulting Global Recruitment Full timeIn Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San FranciscoAWS Data EngineerLocation: San Francisco ( 3 days onsite 2 days remote)look for nearby Candidates only ( Only w2 Required)Rate: 70 USD per hourMust Have Skills : Spark, AWS, data lake, data pipelining, pythonJob Description:As an AWS Data Engineer, you...
-
San Francisco, California, United States City and County of San Francisco Full timeProgram OverviewJoin the San Francisco Public Utilities Commission (SFPUC) as a student intern and gain hands-on experience in engineering and architecture disciplines. The SFPUC is a leading utility organization providing high-quality water, power, and wastewater services to the San Francisco Bay Area.Job SummaryAs a student intern, you will assist...
-
san francisco, United States developrec Full timeContract Senior Cloud & Network Engineer – Menlo Park or San Francisco (4 days a week in the office, 1 day from home) – 12-month contractWe are working with a leading global investment company who are leveraging cutting-edge technologies to transform the way businesses approach cloud infrastructure and networking. They are looking for a Senior Cloud and...
-
Computer Systems Architects
2 weeks ago
San Francisco, United States CyberCube Full timeDetermine architectural strategy and vision for the company’s computer systems. Develop scalable and high performing solutions to improve the stability, interoperability, and security of computer systems. Identify data, software, technical tools, and software development standards that meet user needs. Provide architectural guidance to software developers...
-
Site Reliability Cloud Engineer
2 weeks ago
San Francisco, United States Myriad Genetics Inc. Full timeSite Reliability Cloud Engineer(South San Francisco, CA) Design, analyze and troubleshoot distributed systems. Use AWS Cloud to build, configure, automate and maintain highly reliable, scalable and secure services & infrastructure (EC2, IAM, Security Groups, Route53 and S3). Advise on systems architecture, performance, capacity planning, and monitoring....
-
san francisco, United States Bank of San Francisco Full timeAre you looking to support a fast-growing, fast-paced, client-oriented boutique bank with opportunity to learn and grow? Bank of San Francisco is seeking a temporary Sr. Commercial Loan Servicing Specialist for 3+ months to take ownership of implementing complex transactions onto the servicing platform. The ideal candidate must be able to analyze complex...
-
san francisco, United States Insight Global Full timeRequired Skills & Experience- 5+ years with Identity and Access Management (IAM), including 3+ years of hands-on experience with Okta - Experience as a System Administrator, Network Administrator, or IT Systems Engineer - Experience building workflows and automation (Okta Workflows) - Strong understanding of API integrations and leveraging APIs to...
-
san francisco, United States Insight Global Full timeRequired Skills & Experience- 5+ years with Identity and Access Management (IAM), including 3+ years of hands-on experience with Okta - Experience as a System Administrator, Network Administrator, or IT Systems Engineer - Experience building workflows and automation (Okta Workflows) - Strong understanding of API integrations and leveraging APIs to...
-
AWS Data Engineer
5 days ago
South San Francisco, United States RICEFW Technologies Inc Full time(Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...
-
Network Security Engineer
2 weeks ago
San Francisco, United States University of California - San Francisco Full timeNetwork Security Engineer IT Data Network Full Time 80408BR Job Summary The Network Security Engineer within the University of California, San Francisco's (UCSF) Information Technology (IT) department will ensure the security and integrity of UCSF's network infrastructure. The Network Security Engineer supports the planning, design, optimization,...
-
Principal Electrical Engineer
1 month ago
San Francisco, California, United States FELLOW Full timeJob Title:Principal Electrical Engineer - San Francisco, CAAbout the Role:We are seeking a highly skilled Principal Electrical Engineer to join our team in San Francisco, CA. As a key member of our engineering team, you will be responsible for designing and developing electrical systems for our premium coffee gear products.Key Responsibilities:Design and...
-
Senior Software Engineer
2 weeks ago
San Francisco, United States Rippling Full timeSenior Software Engineer - Supergroups PlatformAbout Rippling: Rippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and computers. For the first time ever, you can manage and automate every part of the employee lifecycle...
-
Sr/Data Engineer
2 weeks ago
San Francisco, United States Federal Reserve Bank of New York Full timeCompanyFederal Reserve Bank of San Francisco We are the Federal Reserve Bank of San Francisco—public servants with a mission to advance the nation’s monetary, financial, and payment systems to build a stronger economy for all Americans. We are a community-engaged bank, and are committed to understanding and serving the vibrant, expansive communities of...