Current jobs related to Data Engineer, ETL, Senior - San Diego - Zapata Technology

  • Senior Data Engineer

    2 weeks ago

    San Diego, California, United States Zapata Technology Full time

    Job DescriptionZapata Technology is seeking an experienced Data Engineer to lead the migration of our data infrastructure from Confluent with manual ETL processes to Apache NiFi.Key ResponsibilitiesPlan, coordinate, and execute the migration from Confluent with manual ETL processes to Apache NiFi, ensuring minimal downtime and data integrity during the...

  • Senior Data Engineer

    4 weeks ago

    San Diego, California, United States BioPhase Solutions Full time

    Job Title: Senior Data EngineerAt BioPhase Solutions, we are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a pivotal role in designing, implementing, and maintaining data pipelines that process and analyze large volumes of instrument data, clinical biomarker inputs, and patient information.Key...

  • Senior Data Engineer

    4 weeks ago

    San Diego, California, United States CoStar Group Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at CoStar Group. As a Senior Data Engineer, you will be responsible for designing, building, testing, and deploying scalable, reusable, and maintainable applications that handle substantial amounts of data.Key Responsibilities:Design and develop cloud-based...

  • Senior Azure Data Engineer

    2 weeks ago

    San Diego, California, United States Kyocera Full time

    Job DescriptionAt Kyocera, we are seeking a highly skilled Senior Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data solutions on the Azure platform.The ideal candidate will have a strong background in data engineering, with experience in...

  • Senior Azure Data Engineer

    2 weeks ago

    San Diego, California, United States Kyocera Full time

    Job Title: Senior Azure Data EngineerAt Kyocera, we are seeking a highly skilled Senior Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data solutions on the Azure platform.Key Responsibilities:Design and implement data architectures for...

  • Senior ETL Developer

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Senior ETL DeveloperAt Unreal Gigs, we're seeking a highly skilled Senior ETL Developer to join our team of data-driven innovators. As a key member of our ETL development team, you'll play a crucial role in designing, building, and maintaining our ETL solutions.Key Responsibilities:ETL Solution Design: Design and implement ETL solutions to...

  • Senior ETL Developer

    2 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Senior ETL DeveloperAt Unreal Gigs, we're seeking a highly skilled Senior ETL Developer to join our team of data-driven innovators. As a key member of our ETL development team, you'll play a crucial role in designing, building, and maintaining our ETL solutions.Key Responsibilities:ETL Solution Design: Design and implement ETL solutions to...

  • Senior Data Engineer

    1 week ago

    San Diego, California, United States Vets Hired Full time

    About the JobAs a Senior Data Engineer at Vets Hired, you will play a critical role in building quality data pipelines that drive analytic solutions. Your expertise in data architecture, data engineering, and data analysis will enable the organization to advance its data-driven decision-making capabilities.Key ResponsibilitiesDesign, develop, and maintain...

  • Senior Data Engineer

    2 weeks ago

    San Antonio, Texas, United States Diverse Lynx Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying high-quality, fault-tolerant data pipelines using Snowflake, DBT, and ETL Informatica.Key Responsibilities:Analyze and develop...

  • Senior Azure Data Engineer

    4 weeks ago

    San Diego, California, United States Kyocera Full time

    Job Title: Senior Azure Data EngineerAt Kyocera, we are seeking a highly skilled Senior Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems on the Azure platform.Key Responsibilities:Design and implement data architectures for enterprise...

  • Senior Data Engineer

    4 weeks ago

    San Francisco, California, United States Apex Systems, Inc. Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Apex Systems, Inc. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key Responsibilities:Lead the development of data pipelines for machine learning use casesDesign and...

  • Senior ETL Developer

    1 week ago

    San Francisco, California, United States Unreal Gigs Full time

    Job OverviewUnreal Gigs is seeking a highly skilled Senior ETL Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our ETL solutions.Key Responsibilities:Design and implement ETL solutions to extract, transform, and load data from various sources into target...

  • Senior Data Engineer

    1 week ago

    San Antonio, Texas, United States Vericast Full time

    Job Title: Senior Data EngineerVericast is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing complex data systems and processes that enable optimal business capabilities.Key Responsibilities:Design and develop data pipelines using ETL tools like Talend, SSIS, and...

  • Senior Azure Data Engineer

    4 weeks ago

    San Diego, California, United States Kyocera Full time

    Job Title: Senior Azure Data EngineerWe are seeking a highly skilled Senior Azure Data Engineer to join our team at Kyocera International, Inc. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems on the Azure platform.Key Responsibilities:Design and implement data...

  • Senior Data Engineer

    2 weeks ago

    San Diego, California, United States BioPhase Full time

    Position OverviewThe Senior Data Engineer will play a pivotal role in designing, implementing, and maintaining data pipelines that process and analyze large volumes of instrument data, clinical biomarker inputs, and patient information. This role requires a strong technical foundation, experience in startup environments, and the ability to navigate the...

  • Senior Data Engineer

    2 weeks ago

    San Diego, California, United States BRAIN CORP Full time

    Job Title: Senior Data EngineerBRAIN CORP is seeking a highly skilled Senior Data Engineer to lead the development of data-centric products that enhance our innovative BrainOS platform.This individual will be responsible for designing, constructing, and maintaining the systems and infrastructure to facilitate efficient collection, storage, and analysis of...

  • Senior Data Engineer

    2 weeks ago

    San Antonio, Texas, United States Vericast Full time

    Job Title: Senior Data EngineerVericast is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing complex data systems and processes that enable optimal business capabilities.Key Responsibilities:Design and develop data pipelines using ETL tools like...

  • Software Test

    3 months ago

    San Diego, United States MILLENNIUMSOFT Full time

    Position: Software Test - (Data / ETL testing) Location: San Diego, CA Duration: 12+ Months Contract 1st shift Description: Job Posting Title: Software Test - (Data / ETL testing) Template: Software Quality Engineer   Job Description Summary HDS (Hosted and Data Solutions) is responsible for developing core services and analytics applications to...

  • Senior ETL Developer

    1 week ago

    San Francisco, California, United States Motion Recruitment Full time

    Job Title: Senior ETL DeveloperJob Summary:We are seeking a highly skilled Senior ETL Developer to join our team. As a Senior ETL Developer, you will be responsible for designing, developing, and implementing complex ETL processes using Ab Initio. You will work closely with our data warehousing team to ensure the smooth operation of our data warehouse...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, United States Neon Redwood Full time

    About Neon Redwood Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Senior Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities. ...

Data Engineer, ETL, Senior

2 months ago

San Diego, United States Zapata Technology Full time

Zapata Technology is seeking an experienced Data Engineer, for a hybrid role in San Diego, California. The Data Engineer will lead the migration of our data infrastructure from Confluent with manual ETL processes to Apache NiFi. This role will involve working with PostgreSQL, MongoDB or Cassandra, and optionally Neo4j, within a Kubernetes environment. The ideal candidate will have extensive experience in data engineering, ETL processes, and managing data pipelines in cloud-native environments.

Check out the details below and our awesome benefits here.

This role is contingent upon contract award.

Compensation: 125-150K

Responsibilities:

  • Plan, coordinate, and execute the migration from Confluent with manual ETL processes to Apache NiFi, ensuring minimal downtime and data integrity during the migration.
  • Design and implement automated ETL workflows using Apache NiFi to improve the efficiency and reliability of data processing.
  • Work with PostgreSQL, MongoDB, or Cassandra to ensure seamless data integration and management, optimizing database performance and reliability.
  • Deploy and manage all components within a Kubernetes environment to ensure scalability, high availability, and efficient resource utilization.
  • Collaborate closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions while documenting processes, workflows, and configurations.
  • Implement monitoring solutions to track the performance of data pipelines and databases, continuously optimizing workflows for performance and cost-efficiency.
Qualifications:
  • Proven experience in data engineering, with a focus on ETL processes and data migration projects.
  • Proficiency in Apache NiFi for ETL automation.
  • Strong knowledge of PostgreSQL, MongoDB, or Cassandra.
  • Familiarity with Neo4j and its integration (preferred but not mandatory).
  • Experience with Kubernetes for container orchestration.
  • Understanding of data architecture, data modeling, and data integration best practices.
Soft Skills:
  • Excellent problem-solving abilities and attention to detail.
  • Strong communication skills, with the ability to work collaboratively in a team environment.
  • Ability to manage multiple tasks and projects simultaneously, meeting deadlines effectively.
Preferred Qualifications:
  • Experience in cloud platforms such as AWS, Google Cloud, or Azure.
  • Familiarity with additional data processing tools and frameworks.
  • Certification in Kubernetes or related technologies.
  • Ability to incorporate Neo4j into the data architecture if required.

Education Level & Degree:

Bachelors degree in Information Technology or a related field, and two to three years of experience is preferred.

Position Type:

Full time position

Clearance: Secret security clearance. Employment is contingent on having or obtaining the required active security clearance or successfully passing the required background check, as well as other factors, including, but not limited to, drug screens.

AAP/EEO Statement:

Equal Opportunity Employer M/F/Disabled/Veteran

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.

Zapata Technology, Inc. provides reasonable accommodation to applicants who are veterans or who have disabilities and are unable to fully use our company application system.