Sr. Data Integration Engineer

3 weeks ago

Chicago, United States The Judge Group Full time

WORK TO BE PERFORMED:

  • Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.
  • Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data sources, transforming as per provided business rules or data mappings, and loading into target databases/services including DB2, AWS S3, and Apache Iceberg.
  • Serve as a subject matter expert on multiple data integration projects, ensuring consistent design and efficient data processing.
  • Play a leading role in Build, Test, and Implementation phases of assigned projects, with a diverse development team spread across multiple locations.
  • Provide Level 2 and Level 3 technical support to mission-critical applications.
  • Perform process improvement and re-engineering with an understanding of technical data problems and solutions as they relate to the current and future business environment.
  • Analyze complex distributed production deployments and make recommendations to optimize performance.
  • Design and develop innovative data solutions for demanding business situations.
  • Develop and document Data Integration standards and procedures.
  • Design reusable and portable Data Integration components.
  • Transform flat delimited files into multiple formats, including Parquet, JSON, and Protobuf.
  • Play a supporting role in Build, Test, and Implementation phases of assigned projects, with a diverse development team spread across multiple locations.
  • Investigate production Data Integration issues and work to determine the root cause of problems.



SKILL AND EXPERIENCE REQUIRED:

  • 5+ years in IT application development, with at least 5 years in Data Integration (ETL) Development, using tools such as Python, SQL and Unix Shell Scripting.
  • Experienced practitioner with a proven track record of implementing mid-scale to large-scale Data Integration (ETL) solutions, performing data analysis and profiling, interacting with client management, and designing and architecting dynamic ETL solutions.
  • Working knowledge for Data Types and Databases including Relational, Dimensional, Vertical and No SQL databases.
  • Hands-on experience with data cleansing and data visualization and familiarity with Hadoop Ecosystem.
  • Experience with platforms such Hive and Trino/Starburst.
  • Strong conceptual knowledge of file formats such as JSON, Parquet and Protobuf.
  • Capable of writing and optimizing SQL queries and stored procedures.
  • Exposure to AWS Services including but not limited S3, PostgreSQL, Apache Iceberg and Kafka.
  • Ideal candidate would have worked on a Scrum Team and familiar with using tools such as Jira and Git.
  • Experience developing containerized Data Integration solutions using Kubernetes, Rancher, and CI/CD pipelines using Harness, Jenkins and Artifactory is a plus.
  • Experience working with scheduling tools such as UC4, Control-M, or Autosys is a plus.

  • Data Integration Engineer

    2 weeks ago

    Chicago, Illinois, United States The Judge Group Full time

    Job Title: Sr. Data Integration EngineerJob Summary:The Sr. Data Integration Engineer will be responsible for designing, developing, and implementing data integration processes within the Strategic Data Platform and other data solutions implementations.Key Responsibilities:Design and develop data integration processes sourcing data from various structured...

  • Data Integration Specialist

    3 weeks ago

    Chicago, Illinois, United States The Judge Group Full time

    Job Title: Sr. Data Integration EngineerAt The Judge Group, we are seeking a highly skilled Sr. Data Integration Engineer to join our team. As a key member of our data integration team, you will be responsible for designing, developing, and implementing data integration processes that drive business value.Key Responsibilities:Design and develop data...

  • Sr. Data Integration Engineer

    3 weeks ago

    Chicago, United States The Judge Group Full time

    WORK TO BE PERFORMED:Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data...

  • Sr. Data Integration Engineer

    1 week ago

    chicago, United States The Judge Group Full time

    WORK TO BE PERFORMED:Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data...

  • Sr. Data Engineer

    5 months ago

    Chicago, United States Ampcus Full time

    Position: Sr. Data Engineer Location: Chicago, IL. (Hybrid) Duration: + Months Contract Summary: We are seeking an experienced data engineer to contribute to a high data volume Electronic Medical Records (EMR) application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with...

  • Sr. Data Engineer

    1 month ago

    Chicago, United States fairlife, LLC Full time

    fairlife, LLC is a Chicago-based nutrition company that creates great-tasting, nutrition-rich and dairy products to nourish consumers.With nearly $3B in annual retail sales, fairlife s portfolio of delicious, lactose-free, real dairy products includes: fairlife ultra-filtered milk; Core Power High Protein Shakes, a sports nutrition drink to support...

  • Data Integration Engineer

    4 days ago

    Chicago, Illinois, United States The Judge Group Full time

    Job Summary:The Judge Group is seeking a highly skilled Data Integration Engineer to join our team. As a Data Integration Engineer, you will be responsible for designing, developing, and implementing data integration processes within our Strategic Data Platform and other data solutions implementations.Key Responsibilities:Design and develop data integration...

  • Sr. Data Engineer

    2 months ago

    Chicago, United States Ampcus Incorporated Full time

    Role: Sr. Data Engineer Work Location: 100% Remote Qlik Replicate + Java and Talend + Java Job Description 8+ years of overall technology experience. 6+ years of Data Engineering, Data Modeling, and Data Warehousing experience required. Expert knowledge of full data ...

  • Senior Data Engineer

    4 weeks ago

    Chicago, Illinois, United States fairlife, LLC Full time

    Job Title: Sr. Data EngineerJoin fairlife, LLC, a leading nutrition company, in shaping the future of data-driven decision making. As a Sr. Data Engineer, you will play a pivotal role in building a best-in-class Data and Decision Intelligence (DDI) ecosystem.Job Summary:The Sr. Data Engineer will be responsible for delivering innovative data solutions that...

  • Senior Data Engineer

    1 month ago

    Chicago, Illinois, United States fairlife Full time

    Job Title: Sr. Data EngineerAt fairlife, LLC, we are seeking a highly skilled Sr. Data Engineer to join our team. As a key member of our Data and Decision Intelligence (DDI) ecosystem, you will play a critical role in delivering our ambition of building a best-in-class data framework.Job Summary:The Sr. Data Engineer will be responsible for translating...

  • Senior Data Modeler

    3 weeks ago

    Chicago, United States Prairie Consulting Services Full time

    Senior Data Modeler / Sr Data Engineer - (Contract - Hybrid, Chicago, IL or Tempe, AZ)We are seeking a Senior Data Modeler with exceptional data modeling and SQL skills for a contract position, requiring 3 days per week on-site in either Chicago, IL, or Tempe, AZ.MUST have:PowerBISQLEnd to End experience - design, analysis, knowing how the data models will...

  • Senior Data Modeler

    1 week ago

    chicago, United States Prairie Consulting Services Full time

    Senior Data Modeler / Sr Data Engineer - (Contract - Hybrid, Chicago, IL or Tempe, AZ)We are seeking a Senior Data Modeler with exceptional data modeling and SQL skills for a contract position, requiring 3 days per week on-site in either Chicago, IL, or Tempe, AZ.MUST have:PowerBISQLEnd to End experience - design, analysis, knowing how the data models will...

  • Senior Data Modeler

    3 weeks ago

    Chicago, United States Prairie Consulting Services Full time

    Senior Data Modeler / Sr Data Engineer - (Contract - Hybrid, Chicago, IL or Tempe, AZ)We are seeking a Senior Data Modeler with exceptional data modeling and SQL skills for a contract position, requiring 3 days per week on-site in either Chicago, IL, or Tempe, AZ.MUST have:PowerBISQLEnd to End experience - design, analysis, knowing how the data models will...

  • Senior Data Engineer

    1 month ago

    Chicago, Illinois, United States Ampcus Full time

    Job Title: Sr. Data Engineer Job Summary: We are seeking an experienced data engineer to contribute to a high data volume Electronic Medical Records (EMR) application. This critical system requires ongoing production maintenance and demands enhancements through integration with Machine Learning and Master Data applications. In the future, there's a plan to...

  • Senior Data Engineer

    4 days ago

    Chicago, Illinois, United States Saxon Global Full time

    Transformative Data Engineer OpportunityAt Saxon Global, we're seeking a highly skilled Sr. ETL/Data Engineer to join our Capital Markets Enterprise Solutions Group. As a key member of our team, you'll contribute to the technical design, development, and integration of cross-functional, multi-platform application systems. Your expertise in ETL/ELT, data...

  • Data Engineer

    4 days ago

    Chicago, Illinois, United States Diverse Lynx Full time

    Data Integration ExpertiseData integration is at the heart of our data engineering team, and we're looking for a skilled Data Engineer to join us in designing, building, and maintaining data pipelines for our Snowflake data model. As a Data Engineer, you will be responsible for implementing and maintaining data synchronization between on-premises Oracle...

  • Senior Data Engineer

    1 week ago

    Chicago, Illinois, United States Ampcus Full time

    Job Title: Sr. Data Engineer Job Summary: We are seeking an experienced data engineer to contribute to a high data volume Electronic Medical Records (EMR) application. This critical system requires ongoing production maintenance and demands enhancements through integration with Machine Learning and Master Data applications. In the future, there's a plan to...

  • Senior Data Engineer

    3 days ago

    Chicago, Illinois, United States fairlife Full time

    Job DescriptionAt fairlife, LLC, we're building a best-in-class Data and Decision Intelligence (DDI) ecosystem to drive our digital transformation. As a Sr. Data Engineer, you'll play a key role in delivering this vision by translating technical requirements into targeted solutions that fit into our broader data framework, architecture, and roadmap.Key...

  • Data Integration Developers

    3 weeks ago

    Chicago, United States Cogent Data Solutions Llc Full time

    Role: Data Integration Developers Client Name: THE OCCLocation: Chicago, Illinois (Onsite Role) Hybrid: Must be able to sit onsite 3x per weekJob Description:5+ years experienceStrong ETL Skills w/ DataStage highly preferredStrong experience with PythonStrong Experience with SQLStrong Experience with Shell Scripting2+ years working with Hadoop or similar...

  • Data Integration Developers

    3 weeks ago

    Chicago, United States Cogent Data Solutions Llc Full time

    Role: Data Integration Developers Client Name: THE OCCLocation: Chicago, Illinois (Onsite Role) Hybrid: Must be able to sit onsite 3x per week Job Description:5+ years experienceStrong ETL Skills w/ DataStage highly preferredStrong experience with PythonStrong Experience with SQLStrong Experience with Shell Scripting2+ years working with Hadoop or similar...