Senior ETL Databricks Developer
1 week ago
We are seeking a Senior ETL Databricks Developer to design and optimize high-performance data pipelines using Databricks on AWS. The role demands expertise in building scalable data solutions, leveraging modern data lake architectures, and integrating with advanced tools to support enterprise data workflows.
Key Responsibilities
- Design, develop, and optimize ETL data pipelines using Databricks and AWS.
- Implement and manage data lake solutions with Delta Lake for efficient storage and processing.
- Utilize Spark (Python/Scala) for large-scale data processing and performance tuning.
- Develop robust data models to support business requirements and analytics.
- Integrate CI/CD pipelines for automated data workflow deployments.
- Collaborate with cross-functional teams to integrate MLflow and other tools for enhanced data operations.
- Extensive experience with Databricks, Spark, and Delta Lake on AWS.
- Proficiency in Python and/or Scala for data pipeline development.
- Strong knowledge of modern data lake architectures and ETL frameworks.
- Expertise in data modeling and performance optimization for large-scale datasets.
- Hands-on experience with CI/CD for data workflows.
- Familiarity with MLflow for managing machine learning lifecycles.
- Experience with AWS cloud services (e.g., S3, Redshift, Glue).
- Knowledge of data governance and security best practices.
- Ability to work in a fast-paced, collaborative onsite environment.
Job Type: Contract
Duration: 12 M+ Extendable
Location: Foster City, CA
Work Type: Onsite
-
Sr. ETL Databricks Developer
4 days ago
Foster City, CA, United States E-Solutions Full timeJob Title:: Sr. ETL Databricks Developer Onsite: Foster city,CA(Onsite) High level requirement: Senior ETL Databricks Developer with strong experience in designing and optimizing data pipelines using Databricks on AWS. The ideal candidate will have deep knowledge of Spark, Delta Lake, Python/Scala, and modern data lake architectures. Hands-on expertise with...
-
ETL Developer
1 week ago
Foster City, CA, United States BayInfotech Full timeThe defined scope of work (SOW) includes Data Warehousing ETL (Extract, Transform and Load) and Report Development. Responsibilities and deliverables include: • Develop and maintains the interfaces and data extracts from business source systems into the enterprise reporting systems using Informatica tool. • Design and write programs and scripts required...
-
ETL Developer
2 weeks ago
Foster City, CA, United States BayInfotech Full timeThe defined scope of work (SOW) includes Data Warehousing ETL (Extract, Transform and Load) and Report Development. Responsibilities and deliverables include: • Develop and maintains the interfaces and data extracts from business source systems into the enterprise reporting systems using Informatica tool. • Design and write programs and scripts required...
-
ETL Developer
2 days ago
Foster City, CA, United States BayInfotech Full timeThe defined scope of work (SOW) includes Data Warehousing ETL (Extract, Transform and Load) and Report Development. Responsibilities and deliverables include: • Develop and maintains the interfaces and data extracts from business source systems into the enterprise reporting systems using Informatica tool. • Design and write programs and scripts required...
-
Informatica MDM Developer
7 days ago
Foster City, CA, United States Right Skale, Inc. Full timeA skilled Informatica MDM Developer with hands-on experience in designing, developing, and maintaining Master Data Management (MDM) solutions using Informatica, with strong expertise in the Life Sciences Commercial domain. This role primarily focuses on Informatica MDM and Informatica Data Quality (IDQ) and requires senior-level experience for complex...
-
Informatica MDM Developer
1 week ago
Foster City, CA, United States Right Skale, Inc. Full timeA skilled Informatica MDM Developer with hands-on experience in designing, developing, and maintaining Master Data Management (MDM) solutions using Informatica, with strong expertise in the Life Sciences Commercial domain. This role primarily focuses on Informatica MDM and Informatica Data Quality (IDQ) and requires senior-level experience for complex...
-
Informatica MDM Developer
4 days ago
Foster City, CA, United States Right Skale, Inc. Full timeA skilled Informatica MDM Developer with hands-on experience in designing, developing, and maintaining Master Data Management (MDM) solutions using Informatica, with strong expertise in the Life Sciences Commercial domain. This role primarily focuses on Informatica MDM and Informatica Data Quality (IDQ) and requires senior-level experience for complex...
-
Sony Pictures/ ETL Developer
1 week ago
Culver City, CA, United States CData Software Full timePlease share resumes for this position Job ID Account Name Skill Location Max Salary Range 292614 Sony Pictures ETL Developer Culver City, CA -onsite $90K - $120K Note for Vendors: Requirements to be worked upon shall only be received from TCS recruiters along with the JOB ID. Vendors must not work on any requirements without JOB ID or received from any...
-
Sony Pictures/ ETL Developer
4 days ago
Culver City, CA, United States CData Software Full timePlease share resumes for this position Job ID Account Name Skill Location Max Salary Range 292614 Sony Pictures ETL Developer Culver City, CA -onsite $90K - $120K Note for Vendors: Requirements to be worked upon shall only be received from TCS recruiters along with the JOB ID. Vendors must not work on any requirements without JOB ID or received from any...
-
Sony Pictures/ ETL Developer
2 weeks ago
Culver City, CA, United States CData Software Full timePlease share resumes for this position Job ID Account Name Skill Location Max Salary Range 292614 Sony Pictures ETL Developer Culver City, CA -onsite $90K - $120K Note for Vendors: Requirements to be worked upon shall only be received from TCS recruiters along with the JOB ID. Vendors must not work on any requirements without JOB ID or received from any...
