Data Integration Engineer

2 weeks ago


Chicago, Illinois, United States The Judge Group Full time
Job Title: Sr. Data Integration Engineer

Job Summary:

The Sr. Data Integration Engineer will be responsible for designing, developing, and implementing data integration processes within the Strategic Data Platform and other data solutions implementations.

Key Responsibilities:

  • Design and develop data integration processes sourcing data from various structured and semi-structured data sources, transforming data as per provided business rules or data mappings, and loading into target databases/services.
  • Serve as a subject matter expert on multiple data integration projects, ensuring consistent design and efficient data processing.
  • Play a leading role in Build, Test, and Implementation phases of assigned projects, with a diverse development team spread across multiple locations.
  • Provide Level 2 and Level 3 technical support to mission-critical applications.
  • Perform process improvement and re-engineering with an understanding of technical data problems and solutions as they relate to the current and future business environment.
  • Analyze complex distributed production deployments and make recommendations to optimize performance.
  • Design and develop innovative data solutions for demanding business situations.
  • Develop and document Data Integration standards and procedures.
  • Design reusable and portable Data Integration components.
  • Transform flat delimited files into multiple formats, including Parquet, JSON, and Protobuf.

Requirements:

  • 5+ years in IT application development, with at least 5 years in Data Integration (ETL) Development, using tools such as Python, SQL, and Unix Shell Scripting.
  • Experienced practitioner with a proven track record of implementing mid-scale to large-scale Data Integration (ETL) solutions, performing data analysis and profiling, interacting with client management, and designing and architecting dynamic ETL solutions.
  • Working knowledge for Data Types and Databases including Relational, Dimensional, Vertical, and No SQL databases.
  • Hands-on experience with data cleansing and data visualization and familiarity with Hadoop Ecosystem.
  • Experience with platforms such Hive and Trino/Starburst.
  • Strong conceptual knowledge of file formats such as JSON, Parquet, and Protobuf.
  • Capable of writing and optimizing SQL queries and stored procedures.
  • Exposure to AWS Services including but not limited S3, PostgreSQL, Apache Iceberg, and Kafka.
  • Ideal candidate would have worked on a Scrum Team and familiar with using tools such as Jira and Git.
  • Experience developing containerized Data Integration solutions using Kubernetes, Rancher, and CI/CD pipelines using Harness, Jenkins, and Artifactory is a plus.
  • Experience working with scheduling tools such as UC4, Control-M, or Autosys is a plus.


  • Chicago, Illinois, United States The Judge Group Full time

    Job Summary:The Judge Group is seeking a highly skilled Data Integration Engineer to join our team. As a Data Integration Engineer, you will be responsible for designing, developing, and implementing data integration processes within our Strategic Data Platform and other data solutions implementations.Key Responsibilities:Design and develop data integration...

  • Data Engineer

    4 days ago


    Chicago, Illinois, United States Diverse Lynx Full time

    Data Integration ExpertiseData integration is at the heart of our data engineering team, and we're looking for a skilled Data Engineer to join us in designing, building, and maintaining data pipelines for our Snowflake data model. As a Data Engineer, you will be responsible for implementing and maintaining data synchronization between on-premises Oracle...


  • Chicago, Illinois, United States The Judge Group Full time

    Job Title: Sr. Data Integration EngineerAt The Judge Group, we are seeking a highly skilled Sr. Data Integration Engineer to join our team. As a key member of our data integration team, you will be responsible for designing, developing, and implementing data integration processes that drive business value.Key Responsibilities:Design and develop data...


  • Chicago, Illinois, United States Spectraforce Technologies Full time

    Job SummaryThe Data Integration Engineer is a critical role that requires a strong understanding of plant process data and AVEVA PI Historian features. The successful candidate will work with internal stakeholders and external suppliers to improve the availability of plant process data.Key ResponsibilitiesConfigure and test AVEVA PI Plant Historian features,...


  • Chicago, Illinois, United States SPECTRAFORCE Full time

    Job Title: Data Integration Engineer (PI Historian)Duration: Long-term contractLocation: Remote or hybridPay Range: Competitive hourly rateKey Responsibilities:1. Configure and test AVEVA PI Plant Historian features, including PI Interfaces, PI Asset Framework, PI RT Reports, and PI Vision.2. Collaborate with industrial plant automation and controls...


  • Chicago, Illinois, United States Stellite Works LLC Full time

    Job Title: Data Integration ExpertLocation: Chicago, IL (downtown)Job Description:Proficiency in Python and Java programming languages.Working experience with relational databases.Experience with API development and integration.Experience with reading and writing from AWS S3 and Kafka.Experience with DevOps process and knowledge of containerization tools...


  • Chicago, Illinois, United States 1872 Consulting Full time

    Job SummaryThis position is a hands-on leadership role, where you'll oversee the technical aspects of our MuleSoft platform and enterprise data integration. You'll be responsible for managing a team of consultants offshore in India and ensuring the successful delivery of our data integration projects.Key Responsibilities Provides leadership and ongoing...


  • Chicago, Illinois, United States Compunnel Inc. Full time

    Data Integration ExpertiseCompunnel Inc. is seeking a highly skilled Data Engineer to lead the development of mid-scale to large-scale Data Integration (ETL) solutions. The ideal candidate will have a proven track record of implementing dynamic ETL solutions, performing data analysis and profiling, and interacting with client management.Key...

  • Data Engineer

    1 month ago


    Chicago, Illinois, United States IFF Full time

    Job Title: Data EngineerIFF is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data integration and synchronization processes across our core business applications and data warehouses.Key Responsibilities:Collaborate with the Data Architect and Chief Data Officer to...


  • Chicago, Illinois, United States LIFELENZ Full time

    Lead Integration EngineerLIFELENZ is a rapidly growing team of mathematicians, engineers, designers, computer scientists, strategists, and client success experts building a machine learning-based, advanced analytics workforce and human capital management platform. We have built and maintained over 20+ platforms over a 19-year period and have won many awards...


  • Chicago, Illinois, United States Health Care Service Corporation Full time

    Job SummaryHealth Care Service Corporation is seeking a skilled Data Integration Specialist to join our team. As a key member of our IT department, you will be responsible for developing technical specifications and designs for various projects and system enhancements. Your expertise in application domain knowledge will be invaluable in providing guidance to...


  • Chicago, Illinois, United States Strata Decision Technology Full time

    Job Summary:As a Consultant on our Data Integration (DI) team, you will be responsible for implementing our software, StrataJazz, and partnering directly with key team members at the largest health systems in the world. You will work closely with clients to understand and communicate integration specifications and plans for implementation. Additionally, you...


  • Chicago, Illinois, United States VAST Data Full time

    Job SummaryVAST Data is seeking a highly skilled Professional Services Engineer to join our team. As a key member of our team, you will be responsible for delivering exceptional technical expertise and support to our customers, ensuring a seamless experience with our data management solutions.Key ResponsibilitiesInstall, configure, and troubleshoot VAST Data...

  • Data Engineer

    2 weeks ago


    Chicago, Illinois, United States TechnoGen Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at TechnoGen. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems to support our business needs.Key Responsibilities:Design and implement data pipelines to collect, process, and analyze large datasetsDevelop and...


  • Chicago, Illinois, United States Health Care Service Corporation Full time

    Job Summary:We are seeking a highly skilled Data Integration Specialist to join our team at Health Care Service Corporation. As a key member of our team, you will be responsible for developing detailed technical specifications and designs for waterfall/XP projects and system enhancements.Key Responsibilities:Provide application domain knowledge to the ADM...

  • Senior Data Engineer

    2 months ago


    Chicago, Illinois, United States InterEx Group Full time

    Job Title: Senior Data EngineerLocation: Remote (preference), flexible work arrangementContract term: Contract to HireAbout the Role:We are seeking an experienced Senior Data Engineer to join our team at InterEx Group. The ideal candidate will have a strong background in building data pipelines, utilizing Azure Data Factory, Python, Databricks, and the Azure...


  • Chicago, Illinois, United States Ryan Specialty Full time

    Job SummaryRyan Specialty is a leading international specialty insurance firm seeking a highly skilled and experienced Data Engineering Manager to join our dynamic team. The ideal candidate will be instrumental in administering, optimizing, and innovating our data engineering practices and infrastructure, particularly in an Azure environment.Key...


  • Chicago, Illinois, United States BlueCloud Full time

    We are seeking a skilled Data Integration Specialist to join our team at BlueCloud. The ideal candidate will have experience with Informatica PowerCenter and a strong understanding of data integration concepts.The successful candidate will be responsible for designing, developing, and implementing complex data integration activities to support project...

  • Data Engineer

    1 month ago


    Chicago, Illinois, United States SpiderRock Holdings LLC Full time

    Job OpportunityWe are seeking a highly skilled Data Engineer to join our team at SpiderRock Holdings LLC. As a Data Engineer, you will play a critical role in developing and maintaining our data infrastructure, ensuring the accuracy and reliability of our data products.Key ResponsibilitiesDesign, develop, and implement data pipelines and architectures to...


  • Chicago, Illinois, United States BlueCloud Full time

    Job DescriptionWe are seeking a highly skilled Data Integration Specialist to join our team at BlueCloud. As a key member of our data integration team, you will be responsible for designing, developing, and implementing complex data integration solutions using Informatica PowerCenter.Key Responsibilities:Design and develop data integration mappings and...