Sr. Data Integration Engineer

3 weeks ago

chicago, United States The Judge Group Full time

WORK TO BE PERFORMED:

  • Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.
  • Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data sources, transforming as per provided business rules or data mappings, and loading into target databases/services including DB2, AWS S3, and Apache Iceberg.
  • Serve as a subject matter expert on multiple data integration projects, ensuring consistent design and efficient data processing.
  • Play a leading role in Build, Test, and Implementation phases of assigned projects, with a diverse development team spread across multiple locations.
  • Provide Level 2 and Level 3 technical support to mission-critical applications.
  • Perform process improvement and re-engineering with an understanding of technical data problems and solutions as they relate to the current and future business environment.
  • Analyze complex distributed production deployments and make recommendations to optimize performance.
  • Design and develop innovative data solutions for demanding business situations.
  • Develop and document Data Integration standards and procedures.
  • Design reusable and portable Data Integration components.
  • Transform flat delimited files into multiple formats, including Parquet, JSON, and Protobuf.
  • Play a supporting role in Build, Test, and Implementation phases of assigned projects, with a diverse development team spread across multiple locations.
  • Investigate production Data Integration issues and work to determine the root cause of problems.



SKILL AND EXPERIENCE REQUIRED:

  • 5+ years in IT application development, with at least 5 years in Data Integration (ETL) Development, using tools such as Python, SQL and Unix Shell Scripting.
  • Experienced practitioner with a proven track record of implementing mid-scale to large-scale Data Integration (ETL) solutions, performing data analysis and profiling, interacting with client management, and designing and architecting dynamic ETL solutions.
  • Working knowledge for Data Types and Databases including Relational, Dimensional, Vertical and No SQL databases.
  • Hands-on experience with data cleansing and data visualization and familiarity with Hadoop Ecosystem.
  • Experience with platforms such Hive and Trino/Starburst.
  • Strong conceptual knowledge of file formats such as JSON, Parquet and Protobuf.
  • Capable of writing and optimizing SQL queries and stored procedures.
  • Exposure to AWS Services including but not limited S3, PostgreSQL, Apache Iceberg and Kafka.
  • Ideal candidate would have worked on a Scrum Team and familiar with using tools such as Jira and Git.
  • Experience developing containerized Data Integration solutions using Kubernetes, Rancher, and CI/CD pipelines using Harness, Jenkins and Artifactory is a plus.
  • Experience working with scheduling tools such as UC4, Control-M, or Autosys is a plus.

  • Sr. Data Integration Engineer

    1 month ago

    chicago, United States The Judge Group Full time

    WORK TO BE PERFORMED:Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data...

  • Sr. Data Integration Engineer

    2 months ago

    Chicago, United States The Judge Group Full time

    WORK TO BE PERFORMED:Responsible for the design, development, implementation, and maintenance of new and existing Data Integration processes within the Strategic Data Platform and other data solutions implementations.Design, develop, maintain, enhance, and monitor Data Integration processes sourcing data from various structured and semi-structured data...

  • Sr. Data Engineer

    6 months ago

    Chicago, United States Ampcus Full time

    Position: Sr. Data Engineer Location: Chicago, IL. (Hybrid) Duration: + Months Contract Summary: We are seeking an experienced data engineer to contribute to a high data volume Electronic Medical Records (EMR) application. This critical system not only requires ongoing production maintenance but also demands enhancements through integration with...

  • Sr. Data Engineer

    2 months ago

    Chicago, United States fairlife, LLC Full time

    fairlife, LLC is a Chicago-based nutrition company that creates great-tasting, nutrition-rich and dairy products to nourish consumers.With nearly $3B in annual retail sales, fairlife s portfolio of delicious, lactose-free, real dairy products includes: fairlife ultra-filtered milk; Core Power High Protein Shakes, a sports nutrition drink to support...

  • Senior Data Modeler

    1 month ago

    chicago, United States Prairie Consulting Services Full time

    Senior Data Modeler / Sr Data Engineer - (Contract - Hybrid, Chicago, IL or Tempe, AZ)We are seeking a Senior Data Modeler with exceptional data modeling and SQL skills for a contract position, requiring 3 days per week on-site in either Chicago, IL, or Tempe, AZ.MUST have:PowerBISQLEnd to End experience - design, analysis, knowing how the data models will...

  • Senior Data Modeler

    2 months ago

    Chicago, United States Prairie Consulting Services Full time

    Senior Data Modeler / Sr Data Engineer - (Contract - Hybrid, Chicago, IL or Tempe, AZ)We are seeking a Senior Data Modeler with exceptional data modeling and SQL skills for a contract position, requiring 3 days per week on-site in either Chicago, IL, or Tempe, AZ.MUST have:PowerBISQLEnd to End experience - design, analysis, knowing how the data models will...

  • Senior Data Engineer

    4 weeks ago

    Chicago, Illinois, United States fairlife Full time

    Job DescriptionAt fairlife, LLC, we're building a best-in-class Data and Decision Intelligence (DDI) ecosystem to drive our digital transformation. As a Sr. Data Engineer, you'll play a key role in delivering this vision by translating technical requirements into targeted solutions that fit into our broader data framework, architecture, and roadmap.Key...

  • Sr. Software Engineer

    3 weeks ago

    Chicago, United States DTI Full time

    WHO WE ARE: Founded in 2007, DTI (Diversified Technology, Inc.) is a successful African American owned IT Consulting/Staffing firm based in Chicago's Loop. WHAT WE DO: We focus on providing delivery, staffing, and supported services such as enterprise integration/implementations including, but not limited to, CRM, EAM, ERP, PMO, and QA. We service clients in...

  • Data Integration Architect

    3 weeks ago

    Chicago, Illinois, United States The Judge Group Full time

    Data Integration and ETL Development The Judge Group is seeking an experienced Data Integration and ETL Development Specialist to join our team. As a key member of our data integration team, you will be responsible for designing, developing, and implementing large-scale data integration solutions using various tools and technologies such as Python, SQL,...

  • Sr. Lead, Cloud Engineer, Data Platforms

    6 months ago

    Chicago, United States Northern Trust Corporation Full time

    About Northern Trust: Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. Northern Trust is proud to provide innovative financial services and guidance to the world’s most successful individuals, families, and institutions by remaining true to our...

  • Azure Senior Data Engineer

    4 weeks ago

    Chicago, Illinois, United States Cyclotron, Inc. Full time

    Job DescriptionSr. Data EngineerLevel: SeniorDepartment: AzureLocation: Fully RemoteType: Full-TimeJob SummaryCyclotron, Inc. is seeking a highly skilled Senior Data Engineer to lead the creation of high-value data-driven solutions leveraging our proven implementation methodology and solutions for enterprise projects. The ideal candidate will have extensive...

  • Sr. Data Analyst

    3 weeks ago

    Chicago, United States Procom Full time

    BMO is currently sourcing for a Sr. Data Analyst position on a 12-month contract. Summary of Role: Sr. Data Analyst role in Business Intelligence at BMO, based in Chicago with a hybrid work model, supporting EMM/MM/LMM strategic project for legacy data migrations. Project: EMM/MM/LMM strategic project for legacy data migrations to BMO platforms. Years of...

  • Sr. Data Engineer

    2 weeks ago

    Chicago, United States Argo Group Full time

    Job DescriptionJob DescriptionArgo Group is a leader in specialty insurance with a vibrant culture built on respect, equality, wellness and opportunity. We're an innovative organization that's small enough to be agile and big enough to make a difference in our industry. Our flexible workplace is continuously evolving to ensure all employees feel:...

  • Data Engineer

    1 month ago

    chicago, United States Robert Half Full time

    Data Ingestion and Integration: You may need to ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure. For example, you could use Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) of data from an on-premises SQL Server database to Azure Blob Storage.Data Transformation and...

  • Data Engineer

    1 month ago

    chicago, United States Robert Half Full time

    Data Ingestion and Integration: You may need to ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure. For example, you could use Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) of data from an on-premises SQL Server database to Azure Blob Storage.Data Transformation and...

  • Data Engineer

    1 month ago

    Chicago, United States Robert Half Full time

    Data Ingestion and Integration: You may need to ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure. For example, you could use Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) of data from an on-premises SQL Server database to Azure Blob Storage.Data Transformation and...

  • Data Integrity

    6 months ago

    Chicago, United States Guggenheim Partners Full time

    Position Summary The Data Integrity Team Lead will manage and develop a small team and will be responsible for ensuring the day-to-day accuracy and consistency of all aspects of critical portfolio management data across all asset classes on a daily basis. This involves but is not limited to defining, implementing and monitoring processes that ensure...

  • Data Engineer

    1 month ago

    chicago, United States Compunnel Inc. Full time

    Job Title: Data EngineerLocation: Chicago, ILDuration: Long TermLooking for Data Engineer with Python/ Java with minimum 10yrs of experience.3 positions for Data Engineer with Python and JavaWORK TO BE PERFORMED:Migration of data sourcing from databases to target systems using external Api’s .Write efficient, scalable, and reusable code in Python and Java...

  • Data Engineer

    3 weeks ago

    chicago, United States Compunnel Inc. Full time

    Job Title: Data EngineerLocation: Chicago, ILDuration: Long TermLooking for Data Engineer with Python/ Java with minimum 10yrs of experience.3 positions for Data Engineer with Python and JavaWORK TO BE PERFORMED:Migration of data sourcing from databases to target systems using external Api’s .Write efficient, scalable, and reusable code in Python and Java...

  • Data Engineer

    2 months ago

    Chicago, United States Compunnel Inc. Full time

    Job Title: Data EngineerLocation: Chicago, ILDuration: Long TermLooking for Data Engineer with Python/ Java with minimum 10yrs of experience.3 positions for Data Engineer with Python and JavaWORK TO BE PERFORMED:Migration of data sourcing from databases to target systems using external Api’s .Write efficient, scalable, and reusable code in Python and Java...