Data Engineer

2 weeks ago

Lake Forest, United States Beacon Hill Full time

our client is actively seeking a Data Engineer to support their growing GenAI Team.


This position will be hybrid - 2-3 days onsite per week in Mettawa, IL


SUMMARY

The Engineer will be responsible for the technical development of data, analytics, and GenAI solutions. They will assist in the architecture, design, build, and testing of these applications, ensuring that these fit-for-purpose solutions meet current and future business needs. The Engineer will also troubleshoot system issues including the performance of root cause analysis and recommendations for remediating these issues.


Day to day

  • Independently design and develop data, software, or technology solutions to answer business questions. Demonstrate proficiency across a range of technologies related to programming languages, data integration, data warehousing, and data visualization and analysis.
  • Play a key role in creating and maintain optimal data pipeline architecture
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability & elasticity etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL/NoSQL and AWS ‘big data’ technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Continuously seek to improve existing methods and processes.

Qualifications

  • Bachelors degree in relevant field and at least 4 years relevant experience OR Masters degree in relevant field and at least 2 years’ experience.
  • Hands-on experience with big data tools: Hadoop, Spark, Scala, HDFS - EMR, Cloudera etc
  • Hands-on experience with AWS cloud services as a platform and as an infrastructure
  • Working experience on any of the reporting tools such as Power BI, Qlik, etc
  • Implementation experience of DevOps CICD automations, Docker, Kubernetes is preferred
  • Good communication and interpersonal skills, with proven ability to build trust.
  • Interest in technology trends and application of technology to improve end user’s experience
  • Ability to understand the broad objectives of a project as well as his/her role in achieving those objectives and modify approach when required. Escalates open issues to management to ensure execution success and keeps stakeholders informed through effective verbal and written communication.
  • Learn, understand and master new methods and technologies, and act as a resource or mentor for others.
  • Partner with vendors and provide input into overall project time and cost estimates.
  • Produces and maintains required technical documentation associated with work product.
  • Understand and adhere to corporate standards regarding applicable Corporate and Divisional Policies, including code of conduct, safety, SOX compliance, data security, and the software development lifecycle.

Preferred:

  • Strong SQL skills with the ability to write efficient queries
  • Experience analyzing large sets of data from various sources
  • Ability to troubleshoot issues and provide timely resolution for end-users
  • Ability to work independently and as part of a team in a fast-paced environment
  • Understanding of Data Governance concepts and principles is a plus
  • Any experience with Data Lineage tools like Alation is a plus
  • Experience with designing or implementing GenAI solutions

  • Senior Data Engineer

    4 weeks ago

    Lake Forest, California, United States Capital One Full time

    Job Title: Senior Data EngineerAbout the Role:Capital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems. You will work closely with cross-functional teams to deliver high-quality solutions that meet the needs of our...

  • Senior Staff Data Engineer

    3 weeks ago

    Lake Forest, Illinois, United States Grainger Businesses Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team at Grainger Businesses. As a Data Engineer, you will be responsible for designing, building, and deploying scalable data solutions using AWS, Snowflake, Databricks, and Postgres.Key Responsibilities:Recommend and implement the data architecture and data accessibility strategy for...

  • Data Quality Engineer

    4 weeks ago

    Forest Lake, Minnesota, United States Search Leaders Full time

    Data Quality EngineerAt Search Leaders, we're seeking an experienced Data Quality Engineer to join our team in the Data Quality and Delivery division. As a key member of our team, you'll collaborate with internal teams, stakeholders, and clients to ensure the smooth operation and high reliability of our data pipelines.Key Responsibilities:Implement and...

  • Senior Staff Data Engineer

    4 weeks ago

    Lake Forest, California, United States Grainger Businesses Full time

    Job Summary:We are seeking a highly skilled Data Engineering Lead to join our team at Grainger Businesses. As a key member of our data engineering team, you will be responsible for designing, building, and deploying scalable data solutions using AWS, Snowflake, Databricks, and Postgres. Key Responsibilities:* Recommend and implement the data architecture and...

  • Senior Staff Data Engineer

    3 weeks ago

    Lake Forest, United States Grainger Businesses Full time

    Work Location Type: Hybrid As a leading industrial distributor with operations primarily in North America, Japan and the United Kingdom, We Keep The World Working® by serving more than 4.5 million customers worldwide with products delivered through innovative technology and deep customer relationships. With 2023 sales of $16.5 billion, we’re dedicated to...

  • Data Analytics Solutions Engineer

    4 weeks ago

    Forest Lake, Minnesota, United States Intuitive Technology Group Full time

    Job SummaryAs a Data Analytics Solutions Engineer at Intuitive Technology Group, you will play a key role in designing and delivering cloud healthcare analytic solutions. Collaborate with data engineers, data scientists, and actuaries to develop innovative data engineering lifecycle solutions, including research, proof of concepts, design, development,...

  • Senior Staff Data Engineer

    3 weeks ago

    Lake Forest, United States Grainger Full time

    Work Location Type:Hybrid As a leading industrial distributor with operations primarily in North America, Japan and the United Kingdom, We Keep The World Working by serving more than 4.5 million customers worldwide with products delivered through innovative technology and deep customer relationships. With 2023 sales of $16.5 billion, we're dedicated to...

  • Data Engineer

    4 weeks ago

    Forest Lake, Minnesota, United States Omni Inclusive Full time

    Job SummaryAs a Senior Data Engineer at Omni Inclusive, you will be responsible for designing and developing data pipelines and data storage using cloud technologies. You will work with AWS GovCloud and develop data pipelines using AWS technologies such as Aurora, DynamoDB, RedShift, S3, Glue, and Lambda. You will also troubleshoot data-related issues and...

  • Senior Data Engineer

    1 month ago

    Forest Park, Georgia, United States NISA Investment Advisors Full time

    Job DescriptionNISA Investment Advisors, LLC is seeking a highly skilled Senior Engineer, Data Management to join our Data Engineering team. The successful candidate will be responsible for developing and maintaining data pipelines for various stakeholders across the enterprise.The Senior Engineer will define, design, develop, unit test, and support ETL...

  • Data Architect

    4 weeks ago

    Forest Lake, Minnesota, United States Ampact Full time

    About the RoleAmpact is seeking a highly skilled Data Engineer to own its data and architecture. This individual will play a pivotal role in designing, implementing, and maintaining robust data management processes and procedures. Leveraging expertise in data architecture, integration, and governance, the successful candidate will collaborate...

  • Data Engineer Data Analytics

    4 weeks ago

    Lake Mary, Florida, United States Apex Systems Full time

    Job Title: Data Engineer Data AnalyticsJob Summary:We are seeking a highly skilled Data Engineer to join our team at Apex Systems. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and architectures. You will work closely with cross-functional teams to develop and implement data solutions that meet...

  • Data Engineer

    3 weeks ago

    Salt Lake, Utah, United States University of Utah Full time

    Job SummaryUniversity Analytics & Institutional Reporting (UAIR) is seeking a skilled Data Engineer to join our Data Warehouse Team. This role will participate in designing, building, testing, implementing, and maintaining data transformation pipelines.The ideal candidate will have a strong understanding of relational database concepts, proficiency in Oracle...

  • Strategic Data Insights Manager

    3 weeks ago

    Lake Forest, Illinois, United States Abbott Laboratories company Full time

    Abbott Laboratories, a leading global healthcare company, seeks an experienced Analytics and Data Strategy Manager to join its team. As a key member of the organization, you will be responsible for generating and delivering analysis and insights through advanced analytics, with the ability to translate technical aspects of analytics and metrics into...

  • Data Engineer

    4 weeks ago

    Salt Lake, Utah, United States AAPC Full time

    Data EngineerThis is a remote role that requires a talented Data Engineer with expertise in AWS to join our data team. We are looking for someone who can design, build, and maintain robust data pipelines and architectures to support our data-driven decision-making processes.In this role, you will work closely with data analysts and scientists to ensure data...

  • Data Architect

    2 months ago

    Lake Forest, United States CitiusTech Full time

    Sr Solutions Architect - Databricks & AWSWho we are: -At CitiusTech, we constantly strive to solve the industry's greatest challenges with technology, creativity, and agility. With over 8,500 healthcare technology professionals worldwide, CitiusTech powers healthcare digital innovation, business transformation, and industry-wide convergence for over 140...

  • Senior Data Engineer

    3 weeks ago

    Silver Lake, Kansas, United States Walmart Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Walmart Global Tech. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines to support our business needs.Key ResponsibilitiesDesign and implement data pipelines and architectures to support business...

  • Senior Data Engineer

    4 weeks ago

    Salt Lake, Utah, United States Kesta IT Full time

    About This RoleWe are seeking a Senior Data Engineer to join our team at KēSTA I.T. This is a unique opportunity to work with cutting-edge technology, innovate, and make a significant impact in a thriving and stable organization.ResponsibilitiesAs a Senior Data Engineer, you will be integral in creating and managing advanced data infrastructure and...

  • Data Engineer

    4 weeks ago

    Salt Lake, Utah, United States University of Utah Full time

    About the RoleThe University of Utah is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data transformation pipelines, processes, and reporting structures to support data science, strategic reporting, and enterprise integrations.Key ResponsibilitiesResearch source data...

  • Senior Data Engineer

    4 weeks ago

    Silver Lake, Kansas, United States Walmart Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Walmart Global Tech. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures to support our business needs.Key Responsibilities:Design and implement data pipelines and architectures to support...

  • Senior Data Engineer

    4 weeks ago

    Silver Lake, Kansas, United States Walmart Full time

    Job Title: Senior Data EngineerWalmart Global Tech is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to identify business needs and develop solutions to meet those needs.Design...