Senior Data Integration Engineer
4 weeks ago
Senior Data Integration Engineer
Role Overview:
This role will be responsible for conducting ingestion and systems integration activities on the Databricks platform. This role requires a deep understanding of:
- Data Lake ingestion and integration processes and best practices
- Databricks platform
- Python/PySpark
- ETL/ELT design, Apache Airflow
- CI/CD
- System integration tools
- Data pipeline management
About the role:
- Integrate data from a variety of source systems and knowledge to tailor integration approaches on a per-system basis
- Liaise with Technical Data Steward and understanding business requirements for ingestion and integration
- Document ingestion and integration flows and pipelines
- Use Airflow to schedule and automate ingestion jobs
- Manage metadata and master data in technical data catalog
- Manage, maintain, and oversee ETL/ELT pipelines on the Databricks platform
- Ensure ELT/ETL design meets required security and compliance guidelines, and ensure PII management, flagging, and risk assessment during ingestion and integration
- Conduct pipeline monitoring
- Ensure adherence to SDLC best practices
About you:
- Bring 5+ years of experience in data engineering, ingestion pipelining, and ETL/ELT
- Hold a bachelor’s degree in computer science, engineering, statistics, or related field
- Have hands-on experience with and understanding of the following:
- Spark/Scala
- SQL
- Python/PySpark or similar programming language
- Databricks
- ETL/ELT development, monitoring and pipelining using tools such as Apache Airflow
- omibo
- Data quality guidelines
- CI/CD pipelines
- Agile
- Git and version control
-
Senior Data Integration Engineer
1 month ago
Dallas, United States Tiva's Client Full timeSenior Data Integration Engineer Role Overview:This role will be responsible for conducting ingestion and systems integration activities on the Databricks platform. This role requires a deep understanding of:Data Lake ingestion and integration processes and best practicesDatabricks platformPython/PySparkETL/ELT design, Apache AirflowCI/CDSystem integration...
-
Senior Data Solutions Engineer
2 weeks ago
Dallas, Texas, United States Axis Data Full timeJob OverviewAxis Data is a leading data engineering and analytics consulting firm, partnering with Palantir to deliver cutting-edge data operations solutions.As a Senior Engineer at Axis Data, you will lead the development and deployment of data solutions, leveraging your expertise in Palantir Foundry and data engineering.Key Responsibilities:Design,...
-
Senior Data Integration Specialist
4 weeks ago
Dallas, Texas, United States Tiva's Client Full timeSenior Data Integration EngineerAbout the Role:This is a key position within our organization, responsible for designing and implementing data integration solutions on the Databricks platform. The ideal candidate will have a deep understanding of data lake ingestion, integration processes, and best practices, as well as experience with Python/PySpark,...
-
Senior Data Integration Engineer
3 weeks ago
Dallas, Texas, United States ShiftCode Analytics Full timeJob Title: Sr. ETL Engineer w/ RedpointShiftCode Analytics is seeking a highly skilled Sr. ETL Engineer with experience in Redpoint Data Integration to join our team.Job Summary:We are looking for a seasoned ETL engineer with hands-on experience in Redpoint Data Integration to work on a 12+ month contract, 2-3 days a week onsite in Dallas, TX, Morristown,...
-
Data Engineer
1 month ago
Dallas, Texas, United States Axis Data Full timeJob OverviewAxis Data is a leading provider of advanced data engineering and analytics consulting services. As a Data Engineer at Axis Data, you will play a key role in developing and implementing end-to-end data solutions that meet the unique needs of our clients.Key ResponsibilitiesCollaborate with senior engineers and clients to understand data...
-
Data Engineer
7 days ago
Dallas, Texas, United States Axis Data Full timeJob OverviewAxis Data is a leading provider of advanced data engineering and analytics consulting services. As a Data Engineer, you will play a key role in developing and implementing end-to-end data solutions that meet the unique needs of our clients.Key Responsibilities:Collaborate with senior engineers and clients to understand data requirements and...
-
Data Engineer
2 weeks ago
Dallas, Texas, United States NTT DATA Full timeJob SummaryNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and load data from diverse...
-
Data Engineer
1 month ago
Dallas, Texas, United States NTT DATA Full timeJob DescriptionNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement efficient and scalable data pipelines to extract,...
-
Data Engineer
4 months ago
Dallas, United States NTT DATA Full timeJob Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Onsite) to join our team in Dallas, Texas (US-TX), United States (US).Job Responsibilities...
-
Senior Data Engineer
4 weeks ago
Dallas, Texas, United States Agile Tech Labs Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Agile Tech Labs.Job Summary:The Senior Data Engineer will be responsible for designing, developing, and implementing data analytics solutions to drive business growth and improve decision-making.Key Responsibilities:Develop and maintain large-scale data...
-
Senior Data Engineer
1 week ago
Dallas, Texas, United States UT Southwestern Medical Center Full timeJob SummaryThe Department of Information Resources, Enterprise Data Services is seeking a highly skilled Senior Data Engineer to join their team.This critical role requires expertise in designing, implementing, and maintaining large-scale data systems, as well as experience with cloud-based platforms such as Microsoft Azure, Amazon Web Services, and Google...
-
Senior Data Engineer
1 month ago
Dallas, Texas, United States Wounded Warrior Project Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Web, Data, and Analytics team at Wounded Warrior Project (WWP). As a Senior Data Engineer, you will play a critical role in designing, implementing, and maintaining our data infrastructure to support business intelligence and analytics initiatives.Key...
-
Senior Data Engineer
2 weeks ago
Dallas, Texas, United States Alto Pharmacy Full timeJob Title: Senior Data EngineerJob Summary:Alto Pharmacy is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and building scalable data pipelines, managing ETL processes, and ensuring data quality and integrity across all stages of the data lifecycle.Key...
-
Senior Data Systems Engineer
2 weeks ago
Dallas, Texas, United States Shtudy Full timeJob Title: Senior Data Systems EngineerWe are seeking a highly skilled Senior Data Systems Engineer to join our dynamic team at Shtudy. This role requires a strong background in data engineering, cloud technologies, and quality assurance.Key Responsibilities:Automate ETL pipelines using Python to streamline data integration, transformation, and migration...
-
Senior Data Engineer
2 weeks ago
Dallas, Texas, United States Alto Pharmacy Full timeJob Title: Senior Data EngineerAlto Pharmacy is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and building scalable data pipelines, managing ETL processes, and ensuring data quality and security.Key Responsibilities:Design, develop, and maintain robust data...
-
Senior Data Engineer
1 week ago
dallas, United States TopShelf Talent Group Full timeOur client is a well-known investment management firm in the Dallas area and they're seeking a Senior Data Engineer to join their team.They need a Senior Data Engineer with 8+ years of hands-on expertise in data engineering, with a focus on creating reliable, efficient, and scalable systems. This role is pivotal in shaping the data architecture and pipelines...
-
Senior Data Engineer
3 weeks ago
Dallas, United States TopShelf Talent Group Full timeOur client is a well-known investment management firm in the Dallas area and they're seeking a Senior Data Engineer to join their team.They need a Senior Data Engineer with 8+ years of hands-on expertise in data engineering, with a focus on creating reliable, efficient, and scalable systems. This role is pivotal in shaping the data architecture and pipelines...
-
Senior Data Engineer
3 weeks ago
dallas, United States TopShelf Talent Group Full timeOur client is a well-known investment management firm in the Dallas area and they're seeking a Senior Data Engineer to join their team.They need a Senior Data Engineer with 8+ years of hands-on expertise in data engineering, with a focus on creating reliable, efficient, and scalable systems. This role is pivotal in shaping the data architecture and pipelines...
-
Senior Data Engineer
1 month ago
Dallas, Texas, United States Wounded Warrior Project Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Web, Data, and Analytics team at Wounded Warrior Project. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems to support business intelligence and analytics initiatives.Key...
-
Senior Data Integration Specialist
1 month ago
Dallas, Texas, United States ShiftCode Analytics Full timeSR. ETL ENGINEER W/ REDPOINT EXPWe are seeking a highly skilled Redpoint ETL Engineer to join our team at ShiftCode Analytics.This is a 12+ month contract opportunity, working 2-3 days a week onsite in either Dallas, TX, Morristown, NJ, or north west Connecticut.The ideal candidate will have strong Redpoint ETL skills and at least 4 years of experience in...