Data Engineer

1 week ago


Detroit, United States Apollo ITS Full time
Job Title: Data Engineer
Location: Metro Detroit, MI-Hybrid
Duration: 12 Months
Note:
  • Must be LOCAL to Metro Detroit - HYBRID 3 days in office in Ann Arbor.
  • Interview: 20 mins with manager, 1 hour with manager and 1-2 team members (ETL scenarios and SQL Assessment)
Team/Project:
  • Will be working with the HR team on the UKG software (vendor). They have a BA that interfaces with the vendor but always helpful to have a technical person there as well. This software holds store team member data, log ins, hours, time off etc. All the HR data for store employees.
  • Mirandas team is about 13-14 devs and some BA's
Notes from intake we had for previous role:
  • Main tools
    • ETL-Talend; DataStage/Informatica might work but lets begin w talend
    • SQL Server DB
  • Outside of that all other things are a plus
    • Cloud- Azure is the plan, Kafka (for streaming- its helpful),
    • Databricks/Lakehouse (Esp for mar-tech people)
    • Python/shell scripting would be nice
  • Don't see a big need for big-data, IoT given domain
  • Comms are big; 2-4 years of Experience is what they want

Additional Job Details
The data engineering specialist will primarily focus on development of large volume information ingestion and transformation. This position is responsible for orchestrating data interfaces into (and out of) our Enterprise Data Warehouse using Talend, SQL, Python and other data engineering solutions.
GENERAL RESPONSIBILITIES
  • Design and develop ETL (Talend) / SQL / Python based processes to perform complex data transformation processes.
  • Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms (RDBMS, Lakehouse, No-SQL platforms)
  • Build Data Integration solutions to handle batch / streaming / IoT data on ETL, Big-Data platforms.
  • Develop and Deliver changes in the Enterprise Data Warehouse according to Data Warehousing best practices
  • Gather requirements and construct documentation to aid in maintenance and code reuse in accordance with team processes and standards
  • Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms
  • Monitor scheduled jobs and improve reliability of ongoing processing
  • Monitor, measure, and enhance ways to improve system performance
  • Ability to multi-task deliverables and manage them in an efficient manner.
  • Performs other duties as assigned
  • Qualifications
  • Understanding and Hands-on experience with key technologies (SQL, ETL, Data modeling, data processing)
  • Strong SQL skills with Relational DBMS technology - SQL Server
  • 2-4 yrs Hands-on experience with ETL tools (Talend preferred)
  • Good understanding and expertise in relational database concepts and data processing concepts
  • Experience in handling multiple data formats (Delimited file, JSON, XML etc.)
  • Experience with data lakehouses (Databricks) and cloud technologies (Aure) a plus
  • Experience with Customer and digital marketing data, including implementing Customer Data Platform and Identity Resolution solutions and integrating with a ESP (Salesforce), a plus
  • Hands on experience designing and implementing data ingestion techniques for real time processes (IoT, eCommerce) a plus.
  • Development experience in a Big-Data environment a Plus; Spark, Kafka, Message Queues
  • Experience with shell scripting / Python a plus
  • Strong communication skills (oral and written)
  • Good analytical and problem solving skills
  • Knowledge of CRM, MDM, HR Reporting and Business Intelligence a plus
  • Candidate must be thorough and detail-oriented and a team player
  • Able to work on multiple priorities in a deadline-driven environment
TOP MUST HAVES:
  • ETL (Talend)
  • SQL
  • Cloud (azure) and Kafka are helpful

  • Data Engineer

    1 week ago


    Detroit, United States Infinity Consulting Solutions Full time

    We have partnered with our client in their search for a Data Engineer. Responsibilities Assist in designing, developing, and supporting scalable data pipelines and ETL processes Optimize data systems and infrastructure Contribute to the maintenance and improvement of existing systems integrations Skills Required T-SQL and MS SSIS Experience developing...

  • Cloud Data Engineer

    2 months ago


    Detroit, United States Detroit Tigers Full time

    JOB SUMMARY: The Detroit Tigers are currently seeking a Cloud Data Engineer, Baseball Systems. This role will be responsible for designing, managing, and automating data processes across our data architecture to support Baseball Operations initiatives. This position will report to the Director, Baseball Systems. KEY RESPONSIBILITIES: Design, implement, and...


  • Detroit, Michigan, United States AHEAD USA Full time

    About AHEADAHEAD is a leading provider of digital business platforms, leveraging advances in cloud infrastructure, automation, analytics, and software delivery to help enterprises deliver on the promise of digital transformation.Our CultureWe prioritize creating a culture of belonging, where all perspectives and voices are represented, valued, respected, and...


  • Detroit, Michigan, United States Canonical - Jobs Full time

    Overview">Canonical, a pioneering tech firm at the forefront of the global move to open source, is seeking a highly skilled Data Automation Engineer for its enterprise solutions team. With a strong focus on innovation and excellence, Canonical challenges talented individuals to think differently and work smarter.">Salary and Benefits">The base pay for this...


  • Detroit, United States General Motors Full time

    Hybrid: This means the successful candidate is expected to report to their primary location (Tuesday, Wednesday & Thursday) three times per week, at minimum.The Role:Software-defined vehicles represent a new paradigm for automakers and consumers, fueled by technological advancements and an escalating demand for transportation solutions that are not only...

  • Sr. Data Engineer

    4 months ago


    Detroit, United States Amrock Full time

    Amrock, LLC has multiple openings for the position of Sr. Data Engineer (Ref# SDEAMR). Work Location: 662 Woodward Ave. Detroit, MI 48226. Position may telecommute from anywhere in the U.S. Job Duties: Employ a variety of programming languages as the primary data developer across one or more project teams. Design and build mechanisms to move, integrate,...

  • Data Input Clerk

    3 weeks ago


    Detroit, United States GAR Engineering Full time

    GAR Engineering is seeking a detail-oriented and efficient Data Input Clerk to join our dynamic team. In this role, you will be responsible for accurately entering and maintaining a wide range of data essential to our engineering projects. This position requires a keen eye for detail, excellent organizational skills, and the ability to work independently...

  • Data Input Clerk

    3 weeks ago


    Detroit, United States GAR Engineering Full time

    GAR Engineering is seeking a detail-oriented and efficient Data Input Clerk to join our dynamic team. In this role, you will be responsible for accurately entering and maintaining a wide range of data essential to our engineering projects. This position requires a keen eye for detail, excellent organizational skills, and the ability to work independently...

  • IT Data Analyst

    2 months ago


    Detroit, United States Tech Tammina Full time

    Role: IT Data Analyst Location: Detroit, MI (Day one onsite, Hybrid) Duration: Long term Rate: Market The main function of a Data Analyst is to coordinate changes to computer databases, test, and implement the database applying knowledge of database management systems. Top 4 must-have hard skills: Data visualization & data analysis Extracting, processing...

  • Data Analyst

    5 days ago


    Detroit, Michigan, United States Rock Family of Companies Full time

    About the RoleWe are seeking a highly skilled Data Scientist to join our team at the Rock Family of Companies. As a Data Scientist, you will be responsible for performing exploratory data analysis, feature engineering, and predictive modeling to provide actionable insights and strategic direction for business leaders.ResponsibilitiesAnalyze, manipulate, and...


  • Detroit, Michigan, United States Amrock Full time

    Job Summary:Amrock seeks a highly skilled Senior Big Data Developer to join our team. In this role, you will be responsible for designing and building mechanisms to move, integrate, cleanse, and publish large volume datasets. You will develop and maintain infrastructure of data, including setting ETL processes, and design and support new and evolving sources...

  • Data Scientist

    1 week ago


    Detroit, United States Amrock Full time

    The Rock Family of Companies is made up of nearly 100 separate businesses spanning fintech, sports, entertainment, real estate, startups and more. We're united by our culture - a drive to find a better way that fuels our commitment to our clients, our community and our team members. We believe in and build inclusive workplaces, where every voice is heard and...

  • Analytics Engineer I

    4 months ago


    Detroit, United States Blue Cross Blue Shield of Michigan Full time

    TITLE: Analytics Engineer I * * Duties: Design, develop, document and test advanced data systems that supports building of artificial intelligence/machine learning models. Identify, integrate, and cleanse data source information for processing. Document and communicate opportunities for improvement identified in the data, such as scalability or quality...


  • Detroit, United States Global Channel Management Full time

    About the job DevOps Engineer/DataOps Engineer DevOps Engineer/DataOps Engineer needs 3+ years experience with AWS Core services (Lambda, S3, ECS, Glue, Kinesis, IAM, CloudWatch, EC2, EKS etc.) DevOps Engineer/DataOps Engineer requires: Detroit, MI ; Charlotte, NC 4 years of experience working with CI/CD tools (Gitlab, GitHub etc.) Solid experience with...

  • Data Scientist

    4 months ago


    Detroit, United States Blue Cross Blue Shield of Michigan Full time

    We have an exciting Data Scientist opportunity availablein our Analytics Center of Excellence - the power hub of analytics for Blue Cross Blue Shield of Michigan (BCBSM)! About the Role You will be working with various verticals within organization (e.g., actuaries, marketing, commercial, government and retail business etc.) to solve important business...

  • Data Scientist

    4 days ago


    Detroit, United States Blue Cross Blue Shield of Michigan Full time

    We have an exciting Data Scientist opportunity availablein our Analytics Center of Excellence - the power hub of analytics for Blue Cross Blue Shield of Michigan (BCBSM)! About the Role You will be working with various verticals within organization (e.g., actuaries, marketing, commercial, government and retail business etc.) to solve important business...


  • Detroit, United States Geotab Full time

    Who we are Geotab is a global leader in IoT and connected transportation and certified "Great Place to Work." We are a company of diverse and talented individuals who work together to help businesses grow and succeed, and increase the safety and sustainability of our communities. Geotab is advancing security, connecting commercial vehicles to the internet...


  • Detroit, Michigan, United States GAR Engineering Full time

    Highly Accurate Data Entry Clerk PositionGAR Engineering is seeking a detail-oriented and efficient data entry specialist to join our dynamic team.This role requires a keen eye for detail, excellent organizational skills, and the ability to work independently while collaborating with various departments.Main Responsibilities:Data entry into databases and...


  • Detroit-Shoreway, United States Penske Truck Leasing Full time

    Data Science Manager Beachwood, OH. or Remote for the right person As a Data Science Manager, you will drive the development and implementation of Machine Learning and Artificial Intelligent solutions for Penske next-generation Supply Chain & Logistics products. With a robust background in data science and industry experience with machine learning, coding,...

  • CHC Data Analyst

    3 days ago


    Detroit, United States Abacus Full time

    The client is under MiDeal, which is the same contract we have for the State of Michigan Direct employees. These positions can be hybrid, but the client prefers that employee works in the office. I don't have the duration of the assignment yet. Let me know if there are any questions. The determined salary is based on their level of expertise. Location: 115...