Data Engineer

3 weeks ago


Erlanger, United States Archer Daniels Midland Company Full time
Job Description

Data Engineer - Data Analyst
This is an exempt level position.

Summary:

Data Engineer/Analyst will work on designing, building, and implementing a data foundation to support a strategic analytics project that drives strategic growth for ADM. This involves liaising with functional teams that build or acquire the underlying data, application owners to understand raw or source data structures, and end users to accurately design strategic data marts. Finally, designing and building data pipelines, ETL/ELT integrations, constructing and modifying data marts, preparing (cleaning, transforming) data, and collaborating with extended team members to design impactful business solutions. Data Engineer needs to have specifically expert technical knowledge of Python, AzureAI and RAG and platforms and software technology (ETL/ELT, SQL, PySpark, Power BI, Python), deep expertise in data management techniques, ability to drive effective support of data analysis and model management, and experience with IT project management practices

Responsibilities:
  • Standardize data and reporting across businesses and teams to enable consistency and quality of key business data
  • Design and develop enterprise data warehouse platform that conforms to consistent methodologies, standards and industry best practices
  • Design, develop, test and document data integrations and assist with deployment, validation and hypercare
  • Maintain and support Azure integrations like ADF, Synapse and AI using technical documentation
  • Participate in designing overall logical & physical data warehouse and data mart models and architectures to support business requirements
  • Develop and maintain SQL, PL/SQL, PySpark, Python code as needed
  • Assist with review to confirm technical feasibility of integration development objects based on integration principles and best practices
  • Understand and navigate a wide array of source data systems (enterprise data warehouses, relational databases, IT systems, in house and COTS applications, documents, APIs, unstructured data, big data, Vector database etc.)
  • Analyze data and assist with developing insights (e.g., via data visualization tools like Power BI / SAC) to enable business decision making
  • Propose new methodologies to demonstrate data to improve existing methodologies
  • Developing prototypes and proof of concepts for required solutions
  • Implementing information security standards in enterprise data warehouse
  • Prepare and present ideas and recommendations to colleagues and management
  • Document solutions through high/low level design documentation
  • Learn new groundbreaking data science and analytic tools as needed
  • Contribute to development of the overall solution approach
  • Recommend solutions to address gaps
  • Assist with development estimation
  • Supervise and review activities of consultants
Requirements:
  • 4-year Bachelor's degree or equivalent in IT, Computer Science, Science, Engineering, Statistics, Programming, Business Analytics, Mathematical or related field
  • At least 6 years of enterprise BI and Analytics technical experience implementing data warehouse and data marts in an Agile environment
  • 5 years of recent experience using data integration, ETL, ELT, data replication, and data warehouse automation tools such as Qlik Replicate, Microsoft Azure Data Factory, Databricks and Microsoft SQL Server Integration Services
  • 5 years of recent experience in data processing using SQL, PySpark, Python
  • Experience sourcing data from ERP data sources, e.g., SAP, JD Edwards, PeopleSoft, Oracle EBS in support of analytic product development and business transformation projects
  • Experience with MPP systems, Azure Synapse, ML and AI preferred
  • Experience with databases like SAP HANA,SQLMI, Synapse
  • Experience in delivering Cloud based Data Solutions in Azure
  • Experience with Data Virtualization technologies and tools, Denodo preferred
  • Working knowledge of BI architecture, dimensional modeling, data warehousing best practices, and data integration standard methodologies
  • Experience in delivering solutions using iterative development methodologies like Agile, KanBan, DevOps
  • Experience working with Big Data technologies such as PySpark, Kafka, DataBricks, Hive, or equivalent
  • Experience with visualization technologies and services including Microsoft Power BI and SAP Analytics Cloud is plus.
  • Working knowledge of Python ML libraries like Scikit-learn/PyTorch or Azure ML
  • Experience working in DevOps / CICD framework
  • High accountability with a demonstrated ability to deliver
  • Strong communication skills including design documentation
  • Strong collaboration skills working with architecture, design and development teams
  • "AJCIND" REF: 80887BR
#IncludingYou

Diversity, equity, inclusion and belonging are cornerstones of ADM's efforts to continue innovating, driving growth, and delivering outstanding performance. We are committed to attracting and retaining a diverse workforce and create welcoming, truly inclusive work environments - environments that enable every ADM colleague to feel comfortable on the job, make meaningful contributions to our success, and grow their career. We respect and value the unique backgrounds and experiences that each person can bring to ADM because we know that diversity of perspectives makes us better, together.

We are committed to ensuring all qualified applicants receive consideration for employment regardless of race, color, ethnicity, disability, religion, national origin, gender, gender identity, gender expression, marital status, sexual orientation, age, protected veteran status, or any other characteristic protected by law.

We welcome everyone to apply, especially those individuals who are underrepresented in our industry, as we strive to ensure our workforce represents the world that we help to feed: people of color, women, gender non-conforming, LGBTQIA+, veterans and persons with disabilities. For more information regarding our efforts to advance Diversity, Equity, Inclusion & Belonging, please visit our website here: Diversity, Equity and Inclusion ADM.

Benefits and Perks

Enriching the quality of life for the world begins by taking care of our colleagues. In addition to competitive pay, we support your diverse needs with a comprehensive total rewards package to enhance your well-being, including:
  • Physical wellness - medical/Rx, dental, vision and on-site wellness center access or gym reimbursement (as applicable).
  • Financial wellness - flexible spending accounts, health savings account, 401(k) with matching contributions and cash balance plan, discounted employee stock purchasing program, life insurance, disability, workers' compensation, legal assistance, identity theft protection.
  • Mental and social wellness - Employee Assistance Program (EAP), Employee Resource Groups (ERGs) and Colleague Giving Programs (ADM Cares).
Additional benefits include:
  • Paid time off including paid holidays.
  • Adoption assistance and paid maternity and parental leave.
  • Tuition assistance.
  • Company-sponsored training and development resources, such as LinkedIn Learning, language training and mentoring programs.
*Benefits may vary for bargained locations, confirm benefit eligibility with your recruiter.
  • Data Engineer

    4 days ago


    Erlanger, United States Hiring Now! Full time

    Job Description Data Engineer - Data Analyst This is an exempt level position. Summary: Data Engineer/Analyst will work on designing, building, and implementing a data foundation to support a strategic analytics project that drives strategic growth for ADM. This involves liaising with functional teams that build or acquire the underlying data, application...

  • Sr Data Engineer

    6 days ago


    Erlanger, United States Archer Daniels Midland Company Full time

    Job DescriptionSr. Data EngineerJob Summary Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance? ADM is seeking a Sr. Data Engineer, someone who thrives in an environment continuously integrating and deploying data products and analytics driving business value. The Sr. Data...


  • Erlanger, United States JobRialto Full time

    Must-haves 8+ years of experience with Python engineering with expertise with large language modules 5+ machine learning and engineering Machine learning building generative AI models, understand how to condense or expand that data Experience working with Azure cloud Dealing with massive amounts of data -- how much 6+ months with one of the following: Prompt...


  • Erlanger, United States Waites Full time

    Manufacturing EngineerThis is a brand new role on our technology & engineer team! What we are: Fun, fast-paced, client-focused, people-centric, inviting, flexible, and rapidly growing.What we are not: Overly structured, uncompromising, disengaged, or disconnected. We are seeking a self-motivated team player with exceptional manufacturing & engineering...

  • Manufacturing Engineer

    23 hours ago


    Erlanger, United States Waites Full time

    Manufacturing EngineerThis is a brand new role on our technology & engineer team! What we are: Fun, fast-paced, client-focused, people-centric, inviting, flexible, and rapidly growing.What we are not: Overly structured, uncompromising, disengaged, or disconnected. We are seeking a self-motivated team player with exceptional manufacturing & engineering...

  • Manufacturing Engineer

    22 hours ago


    Erlanger, United States Waites Company Inc Full time

    Manufacturing EngineerThis is a brand new role on our technology & engineer team! What we are: Fun, fast-paced, client-focused, people-centric, inviting, flexible, and rapidly growing.What we are not: Overly structured, uncompromising, disengaged, or disconnected. We are seeking a self-motivated team player with exceptional manufacturing & engineering...


  • Erlanger, United States Diverse Lynx Full time

    Position: Network Voice Engineer Location: Erlanger KY//Decatur IL, (Onsite) Job Type: Full-time Relevant Experience (in Yrs.) Deployment and management of Voice telephony infrastructure Implementation and maintaining contact center environment Deployment and support for third party telephony integrations Data gathering, configuration readiness and...


  • Erlanger, United States NV5 Global, Inc. Full time

    Overview COME JOIN OUR TEAM! We have an exciting job opening for a Part-Time Health Physics Technician in Erlanger, KY. If you are passionate about making a difference and have the qualifications listed below, we want you to join our team at NV5. We are a group of highly skilled individuals dedicated to delivering innovative solutions for our clients. This...


  • Erlanger, United States NV5 Global, Inc. Full time

    Overview COME JOIN OUR TEAM! We have an exciting job opening for a Part-Time Health Physics Technician in Erlanger, KY. If you are passionate about making a difference and have the qualifications listed below, we want you to join our team at NV5. We are a group of highly skilled individuals dedicated to delivering innovative solutions for our clients. This...


  • Erlanger, Kentucky, United States NV5 Global, Inc. Full time

    Overview COME JOIN OUR TEAM We have an exciting job opening for a Part-Time Health Physics Technician in Erlanger, KY. If you are passionate about making a difference and have the qualifications listed below, we want you to join our team at NV5. We are a group of highly skilled individuals dedicated to delivering innovative solutions for our clients. This...


  • Erlanger, Kentucky, United States Parker Hannifin Corporation Parker Aerospace Group Full time

    CNC Machine Operator 3Location: Erlanger, KY, United StatesJob Family : Manufacturing Job Type : RegularPosted : Apr 26, 2024Job ID: 48148 Job DescriptionCNC Machinist will be required to perform tasks related to program editing, set-up, operation, trouble-shooting and preventive maintenance for CNC machines, custom process machines and production support...


  • Erlanger, United States CASM (Complete Aviation Services and Modification) Full time

    Job Duties: Perform Line maintenance (On-call and scheduled) work on various customers' aircraft. Perform routine maintenance and airworthiness releases (within the scope of Approval) returning aircraft to service. Responsible for servicing, inspecting, and maintaining aircraft, aircraft engines, and associated components; effectively performs work to...

  • Automotive Technician

    17 hours ago


    Erlanger, United States Avis Budget Group Full time

    $22.00/hourShift Premium may ApplyImmediately hiring! We're looking for responsible, detailed people who are ready to accelerate their automotive repair career! Whether you have worked in an auto garage or car dealership, this job is for you! Join our team of driven professionals at Avis Budget Group enterprise. What You'll Do: As an automotive technician,...

  • Project Drafter

    3 days ago


    Erlanger, United States Vincent Lighting Systems Full time

    Job DescriptionJob DescriptionProject DrafterThis is a full-time position working with the systems integration and rigging teams to provide design and submittal drawings required per job. A successful candidate will be a motivated individual who is interested in providing best-in-class customer service and has the technical skills to complete tasks on time...

  • Sensory Specialist

    4 weeks ago


    Erlanger, United States Archer Daniels Midland Company Full time

    Job Description PGCS Sensory Specialist - Erlanger, KY This is a full-time, exempt position. Job Summary: The PGCS Sensory Specialist role is a North America technical execution position that is responsible to ensure all PGCS related materials meet PGCS sensory specification prior to release. This role will directly confirm and release all PGCS materials...


  • Erlanger, United States Perfetti Van Melle Full time

    OVERVIEWPerfetti Van Melle (makers of Mentos, Airheads, Dentyne, Trident and Bubblicious!) is one of the world's largest manufacturers and distributors of confectionery and chewing gum with global brands that are being enjoyed in more than 150 countries worldwide. We're currently seeking a passionate and enthusiastic Safety, Health, Environmental, and Risk...


  • Erlanger, United States Archer Daniels Midland Company (ADM) Full time

    GT Sr Integrations Manager - Global Technology Exempt level position. A DM requires the successful completion of applicable pre-employment drug screen, medical questionnaire and a background check. The GT Sr Integrations Development Manager is responsible for establishing and driving activities that contribute to planning, budgeting, resourcing,...


  • Erlanger, Kentucky, United States Archer Daniels Midland Company (ADM) Full time

    GT Sr Integrations Manager - Global Technology Exempt level position. A DM requires the successful completion of applicable pre-employment drug screen, medical questionnaire and a background check. The GT Sr Integrations Development Manager is responsible for establishing and driving activities that contribute to planning, budgeting, resourcing,...

  • Technical Analyst I

    12 hours ago


    Erlanger, United States Cartamundi - The United States Playing Card Company Full time

    Job DescriptionJob DescriptionJoin the worldwide leader in playing cards and in “play” solutions. Play is what keeps us going, and it always has been our greatest motivation. That's why we live different, play different.The Technical Analyst I will be the first point of contact for local support for various hardware and software needs of the business...


  • Erlanger, United States Hiring Now! Full time

    Job Description GT Sr Integrations Manager - Global Technology Exempt level position. ADM requires the successful completion of applicable pre-employment drug screen, medical questionnaire and a background check. The GT Sr Integrations Development Manager is responsible for establishing and driving activities that contribute to planning, budgeting,...