Senior Data Ingestion Engineer
2 days ago
Data Ingestion Expert
About the Role:
This position is responsible for designing and implementing data ingestion pipelines on the Databricks platform. The ideal candidate will have a deep understanding of data streaming, ETL/ELT implementation, and system integration tools.
Key Responsibilities:
- Ingest data from various source systems and tailor ingestion approaches on a per-system basis
- Manage, maintain, and oversee ETL/ELT pipelines on the Databricks platform
- Optimize data pipelines for scalability and speed
- Document ingestion and integration flows and pipelines
- Use Airflow to schedule and automate ingestion jobs
- Manage metadata and master data in technical data catalog
- Ensure ELT/ETL design meets required security and compliance guidelines
Requirements:
- 5+ years of experience in data engineering, ingestion pipelining, and data streaming using Kafka
- Hands-on experience with Kafka, AWS, Python/PySpark, Spark/Scala, Databricks, Unity Catalog, and SQL
- ETL/ELT development, monitoring, and pipelining using tools such as Apache Airflow
- Ingestion tools such as Dell Boomi
- Data quality guidelines
- CI/CD pipelines
- Agile
- Git and version control
About You:
- Bring a strong understanding of data engineering principles and practices
- Have experience with data streaming, ETL/ELT implementation, and system integration tools
- Be able to design and implement data ingestion pipelines on the Databricks platform
PySpark AND kafka AND aws AND databricks AND data ingestion AND python AND unity catalog AND data streaming
-
Senior Data Integration Specialist
2 weeks ago
Dallas, Texas, United States Tiva's Client Full timeSenior Data Integration EngineerAbout the Role:This is a key position within our organization, responsible for designing and implementing data integration solutions on the Databricks platform. The ideal candidate will have a deep understanding of data lake ingestion, integration processes, and best practices, as well as experience with Python/PySpark,...
-
Senior Data Architect
1 day ago
Dallas, Texas, United States Optimize Search Group Full timeJob Title: Senior Data ArchitectDuration: Direct HireLocation: Dallas, TX (100% On-Site)We are seeking a highly skilled and experienced Senior Data Architect to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of...
-
Senior Data Solutions Engineer
2 days ago
Dallas, Texas, United States Axis Data Full timeJob OverviewAxis Data is a leading data engineering and analytics consulting firm, partnering with Palantir to deliver cutting-edge data operations solutions.As a Senior Engineer at Axis Data, you will lead the development and deployment of data solutions, leveraging your expertise in Palantir Foundry and data engineering.Key Responsibilities:Design,...
-
Senior Data Engineer
3 days ago
Dallas, Texas, United States Alto Pharmacy Full timeJob Title: Senior Data EngineerAlto Pharmacy is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and building scalable data pipelines, managing ETL processes, and ensuring data quality and security.Key Responsibilities:Design, develop, and maintain robust data...
-
Senior Data Engineer
2 days ago
Dallas, Texas, United States Alto Pharmacy Full timeJob Title: Senior Data EngineerJob Summary:Alto Pharmacy is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and building scalable data pipelines, managing ETL processes, and ensuring data quality and integrity across all stages of the data lifecycle.Key...
-
Senior Data Architect
2 days ago
Dallas, Texas, United States TopShelf Talent Group Full timeSenior Data EngineerTopShelf Talent Group is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable and reliable data infrastructure.Key Responsibilities:Design and develop systems for data ingestion, persistence, and consumption.Drive the...
-
Data Engineer
3 weeks ago
Dallas, Texas, United States Axis Data Full timeJob OverviewAxis Data is a leading provider of advanced data engineering and analytics consulting services. As a Data Engineer at Axis Data, you will play a key role in developing and implementing end-to-end data solutions that meet the unique needs of our clients.Key ResponsibilitiesCollaborate with senior engineers and clients to understand data...
-
Senior Data Software Engineer
2 weeks ago
Dallas, Texas, United States Goldman Sachs Group, Inc. Full timeAbout the RoleWe are seeking a highly skilled Senior Data Software Engineer to join our PWM Data Distribution team. As a key member of our team, you will be responsible for designing, developing, and deploying a next-gen data platform and services to support the ever-increasing needs of our business.Key ResponsibilitiesDesign and develop a data pipeline to...
-
Senior Data Architect
7 days ago
Dallas, Texas, United States TopShelf Talent Group Full timeSenior Data EngineerTopShelf Talent Group is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable and reliable data infrastructure.Key Responsibilities:Design and develop systems for data ingestion, persistence, and consumption.Drive the...
-
Senior Data Software Engineer
2 weeks ago
Dallas, Texas, United States Goldman Sachs Group, Inc. Full timeAbout the RoleWe are seeking a highly skilled Senior Data Software Engineer to join our Asset and Wealth Management team at Goldman Sachs. As a key member of our team, you will be responsible for designing and developing a next-gen data platform and services to support the ever-increasing needs of our business.Key ResponsibilitiesDesign and develop a highly...
-
Senior Data Architect
4 weeks ago
Dallas, Texas, United States Glocomms Full timeJob Title: Lead Data EngineerGlocomms is seeking a highly skilled and experienced Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives.Key...
-
Senior Data Architect
2 weeks ago
Dallas, Texas, United States Glocomms Full timeJob Title: Lead Data EngineerGlocomms is seeking a highly skilled and experienced Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives.Key...
-
Data Engineering Lead
3 weeks ago
Dallas, Texas, United States Glocomms Full timeLead Data EngineerGlocomms is seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. As a key member of our data engineering team, you will be responsible for leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives.Key...
-
Senior Technical Data Governance Specialist
2 days ago
Dallas, Texas, United States Tiva's Client Full timeSenior Technical Data Steward Job DescriptionAbout the Role:We are seeking a highly skilled Senior Technical Data Steward to join our team at Tiva's Client. As a key member of our data governance team, you will be responsible for translating business needs into technical requirements, managing logical data models, and working closely with ingestion and...
-
Senior Data Engineer
1 day ago
Dallas, Texas, United States Inizio Partners Full timeAbout the Role:We are seeking an experienced AWS Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and implementing our new data pipelines using AWS. You will work closely with our data science and data visualization teams to transform ingested data into actionable insights. Key...
-
Lead Data Engineer
1 day ago
Dallas, Texas, United States Alcority Full timeJob Title: Lead Data EngineerWe are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms.This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable...
-
Senior Technical Data Architect
3 weeks ago
Dallas, Texas, United States Tiva's Client Full timeSenior Technical Data StewardTiva's Client is seeking a highly skilled Senior Technical Data Steward to join their team. As a key member of the organization, you will be responsible for translating business needs into technical requirements, managing logical data models, and working closely with ingestion and curation teams.About the RoleThis role requires a...
-
Senior Data Architect
2 weeks ago
Dallas, Texas, United States Anblicks Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Anblicks. As a Senior Data Engineer, you will be responsible for designing and developing data engineering solutions using next-generation data techniques.Key Responsibilities:Design and develop big data solutions using Hadoop and other big data...
-
Senior Data Engineer
3 weeks ago
Dallas, Texas, United States Alto Pharmacy Full timeJob DescriptionAlto Pharmacy is a pioneering digital pharmacy that revolutionizes the way people manage their health. We're committed to providing an exceptional pharmacy experience by leveraging cutting-edge technology to simplify prescription management, improve health outcomes, and enhance customer satisfaction.The Data Engineering team plays a vital role...
-
Data Engineer
1 month ago
Dallas, Texas, United States NTT DATA Full timeJob DescriptionNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement efficient data pipelines to extract, transform, and...