Senior Data Ingestion Engineer

2 days ago


Dallas, Texas, United States Tiva's Client Full time

Data Ingestion Expert

About the Role:

This position is responsible for designing and implementing data ingestion pipelines on the Databricks platform. The ideal candidate will have a deep understanding of data streaming, ETL/ELT implementation, and system integration tools.

Key Responsibilities:

  • Ingest data from various source systems and tailor ingestion approaches on a per-system basis
  • Manage, maintain, and oversee ETL/ELT pipelines on the Databricks platform
  • Optimize data pipelines for scalability and speed
  • Document ingestion and integration flows and pipelines
  • Use Airflow to schedule and automate ingestion jobs
  • Manage metadata and master data in technical data catalog
  • Ensure ELT/ETL design meets required security and compliance guidelines

Requirements:

  • 5+ years of experience in data engineering, ingestion pipelining, and data streaming using Kafka
  • Hands-on experience with Kafka, AWS, Python/PySpark, Spark/Scala, Databricks, Unity Catalog, and SQL
  • ETL/ELT development, monitoring, and pipelining using tools such as Apache Airflow
  • Ingestion tools such as Dell Boomi
  • Data quality guidelines
  • CI/CD pipelines
  • Agile
  • Git and version control

About You:

  • Bring a strong understanding of data engineering principles and practices
  • Have experience with data streaming, ETL/ELT implementation, and system integration tools
  • Be able to design and implement data ingestion pipelines on the Databricks platform

PySpark AND kafka AND aws AND databricks AND data ingestion AND python AND unity catalog AND data streaming



  • Dallas, Texas, United States Tiva's Client Full time

    Senior Data Integration EngineerAbout the Role:This is a key position within our organization, responsible for designing and implementing data integration solutions on the Databricks platform. The ideal candidate will have a deep understanding of data lake ingestion, integration processes, and best practices, as well as experience with Python/PySpark,...


  • Dallas, Texas, United States Optimize Search Group Full time

    Job Title: Senior Data ArchitectDuration: Direct HireLocation: Dallas, TX (100% On-Site)We are seeking a highly skilled and experienced Senior Data Architect to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of...


  • Dallas, Texas, United States Axis Data Full time

    Job OverviewAxis Data is a leading data engineering and analytics consulting firm, partnering with Palantir to deliver cutting-edge data operations solutions.As a Senior Engineer at Axis Data, you will lead the development and deployment of data solutions, leveraging your expertise in Palantir Foundry and data engineering.Key Responsibilities:Design,...


  • Dallas, Texas, United States Alto Pharmacy Full time

    Job Title: Senior Data EngineerAlto Pharmacy is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and building scalable data pipelines, managing ETL processes, and ensuring data quality and security.Key Responsibilities:Design, develop, and maintain robust data...


  • Dallas, Texas, United States Alto Pharmacy Full time

    Job Title: Senior Data EngineerJob Summary:Alto Pharmacy is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and building scalable data pipelines, managing ETL processes, and ensuring data quality and integrity across all stages of the data lifecycle.Key...


  • Dallas, Texas, United States TopShelf Talent Group Full time

    Senior Data EngineerTopShelf Talent Group is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable and reliable data infrastructure.Key Responsibilities:Design and develop systems for data ingestion, persistence, and consumption.Drive the...

  • Data Engineer

    3 weeks ago


    Dallas, Texas, United States Axis Data Full time

    Job OverviewAxis Data is a leading provider of advanced data engineering and analytics consulting services. As a Data Engineer at Axis Data, you will play a key role in developing and implementing end-to-end data solutions that meet the unique needs of our clients.Key ResponsibilitiesCollaborate with senior engineers and clients to understand data...


  • Dallas, Texas, United States Goldman Sachs Group, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Data Software Engineer to join our PWM Data Distribution team. As a key member of our team, you will be responsible for designing, developing, and deploying a next-gen data platform and services to support the ever-increasing needs of our business.Key ResponsibilitiesDesign and develop a data pipeline to...


  • Dallas, Texas, United States TopShelf Talent Group Full time

    Senior Data EngineerTopShelf Talent Group is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable and reliable data infrastructure.Key Responsibilities:Design and develop systems for data ingestion, persistence, and consumption.Drive the...


  • Dallas, Texas, United States Goldman Sachs Group, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Data Software Engineer to join our Asset and Wealth Management team at Goldman Sachs. As a key member of our team, you will be responsible for designing and developing a next-gen data platform and services to support the ever-increasing needs of our business.Key ResponsibilitiesDesign and develop a highly...

  • Senior Data Architect

    4 weeks ago


    Dallas, Texas, United States Glocomms Full time

    Job Title: Lead Data EngineerGlocomms is seeking a highly skilled and experienced Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives.Key...

  • Senior Data Architect

    2 weeks ago


    Dallas, Texas, United States Glocomms Full time

    Job Title: Lead Data EngineerGlocomms is seeking a highly skilled and experienced Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives.Key...

  • Data Engineering Lead

    3 weeks ago


    Dallas, Texas, United States Glocomms Full time

    Lead Data EngineerGlocomms is seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. As a key member of our data engineering team, you will be responsible for leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives.Key...


  • Dallas, Texas, United States Tiva's Client Full time

    Senior Technical Data Steward Job DescriptionAbout the Role:We are seeking a highly skilled Senior Technical Data Steward to join our team at Tiva's Client. As a key member of our data governance team, you will be responsible for translating business needs into technical requirements, managing logical data models, and working closely with ingestion and...


  • Dallas, Texas, United States Inizio Partners Full time

    About the Role:We are seeking an experienced AWS Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and implementing our new data pipelines using AWS. You will work closely with our data science and data visualization teams to transform ingested data into actionable insights. Key...

  • Lead Data Engineer

    1 day ago


    Dallas, Texas, United States Alcority Full time

    Job Title: Lead Data EngineerWe are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms.This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable...


  • Dallas, Texas, United States Tiva's Client Full time

    Senior Technical Data StewardTiva's Client is seeking a highly skilled Senior Technical Data Steward to join their team. As a key member of the organization, you will be responsible for translating business needs into technical requirements, managing logical data models, and working closely with ingestion and curation teams.About the RoleThis role requires a...

  • Senior Data Architect

    2 weeks ago


    Dallas, Texas, United States Anblicks Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Anblicks. As a Senior Data Engineer, you will be responsible for designing and developing data engineering solutions using next-generation data techniques.Key Responsibilities:Design and develop big data solutions using Hadoop and other big data...

  • Senior Data Engineer

    3 weeks ago


    Dallas, Texas, United States Alto Pharmacy Full time

    Job DescriptionAlto Pharmacy is a pioneering digital pharmacy that revolutionizes the way people manage their health. We're committed to providing an exceptional pharmacy experience by leveraging cutting-edge technology to simplify prescription management, improve health outcomes, and enhance customer satisfaction.The Data Engineering team plays a vital role...

  • Data Engineer

    1 month ago


    Dallas, Texas, United States NTT DATA Full time

    Job DescriptionNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement efficient data pipelines to extract, transform, and...