Lead Data Engineer

4 weeks ago

Phoenix, United States PrePass, LLC Full time
Job DescriptionJob Description

About PrePass

PrePass® is North America's most utilized and technologically advanced weigh station bypass and toll payment platform. Proven PrePass technologies enable safe, qualified motor carriers to bypass inspection facilities at highway speeds, saving them time, fuel, and money while reducing emissions. As the only provider to offer bypass and tolling solutions, PrePass technology allows fleets to regain control of toll costs, eliminate toll violations, and automatically resolve max toll disputes. PrePass is the only preclearance system developed, owned, and operated in the United States of America as well as the American Trucking Associations’ only Endorsed Corporate Partner. That’s why more than 105,000 fleets subscribe over 750,000 commercial vehicles to PrePass services.

Position Description

As a Lead Data Engineer, you will be at the forefront of pioneering solutions that cater to the evolving demands of our growing business. In this capacity, you will take the lead in formulating the design, development, and implementation of our next-generation, cloud-native data architecture. Additionally, you will mentor and guide a team of talented data engineers. This position demands a blend of technical acumen and strategic thinking. We’re looking for a trailblazer who thrives on innovation and is committed to continuous learning. You should be equally adept at coding as you are in conceptualizing and communicating complex solutions across various teams and domains. This is a hybrid position based in Phoenix.

Your Key Responsibilities

  • Design and implement highly scalable, distributed architecture using Azure Databricks, Delta Lake, and other Microsoft Azure services.
  • Act as a technical expert, lead projects, and optimize production systems to ensure reliability, performance, scalability, and security.
  • Partner with Product Management and Engineering leadership to architect and build solutions that deliver on roadmap features.
  • Implement best practices in Microsoft Azure for data quality, data governance, data security, data lineage, and data cataloging.
  • Guide and mentor less experienced engineers.
  • Oversee and provide leadership to a team of approximately 5 engineers.
  • Actively monitor workflows and compute to identify refinements that will improve efficiency and reduce costs.
  • Build comprehensive solutions for orchestration and observation.
  • Troubleshoot system issues, prioritize fixes, and distribute work among the team.
  • Prepare, manage, and supervise code releases to Production.
  • Spearhead prototyping exercises and demonstrate value and feasibility of the solutions and architecture.

Requirements

Qualifications

Required

  • Bachelor’s degree in computer science, related technical field, or equivalent experience.
  • Minimum 8 years of overall experience in designing and building large scale database solutions, with at least 2 years in a leadership role.
  • Minimum 3 years programming experience in Python and Pyspark.
  • Expert SQL skills.
  • Extensive experience building ETL/ELT solutions using Azure Databricks, Azure Data Factory, or similar tools.
  • Experience designing data structures and models for data lakes.
  • Thorough understanding of distributed storage and distributed computing.
  • Proficiency with reporting and data visualization tools, specifically PowerBI.
  • Proficiency with SSIS.
  • Versed in software production engineering practices, version control, code peer reviews, automated testing, and CI/CD.
  • Exceptional collaborative abilities, with a talent for navigating fluid environments and embracing change.
  • A commitment to staying abreast of emerging technologies and industry best-practices to drive continuous improvement in development methodologies.

Preferred

  • Understanding of ML and AI concepts, algorithms, and techniques.
  • Experience with both batch and streaming data sources.
  • Familiarity with No-SQL databases.
  • Familiarity of event driven architecture – queues, batches, and pub/sub models.
  • Experience working with data from enterprise systems like ERPs and CRMs.
  • Familiarity with DevOps CI/CD implementation methodologies

Benefits

How We Will Take Care of You

  • Robust benefit package that includes medical, dental, and vision that start on date of hire.
  • Paid Time Off, to include vacation, sick, holidays, and floating holidays.
  • 401(k) plan with employer match.
  • Company-funded “lifestyle account” upon date of hire for you to apply toward your physical and mental well-being (i.e., ski passes, retreats, gym memberships).
  • Tuition Reimbursement Program.
  • Employee Assistance Program (available at no cost to you).
  • Voluntary benefits, to include but not limited to Legal and Pet Discounts.
  • Company-sponsored and funded “Culture Team” that focuses on the Physical, Mental, Professional well-being of employees.
  • Community Give-Back initiatives.
  • Culture that focuses on Employee Development initiatives.

  • Lead Data Engineer

    3 months ago

    Phoenix, United States PrePass, LLC Full time

    Job DescriptionJob DescriptionAbout PrePassPrePass® is North America's most utilized and technologically advanced weigh station bypass and toll payment platform. Proven PrePass technologies enable safe, qualified motor carriers to bypass inspection facilities at highway speeds, saving them time, fuel, and money while reducing emissions. As the only...

  • Team Lead Data Engineer(Hybrid Onsite)

    4 weeks ago

    Phoenix, United States Strategic Employment Full time

    Job DescriptionJob DescriptionA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL...

  • Team Lead Data Engineer(Hybrid Onsite)

    6 days ago

    Phoenix, United States Strategic Employment Full time

    Job DescriptionJob DescriptionA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL...

  • Team Lead Data Engineer(Hybrid Onsite)

    4 weeks ago

    Phoenix, United States Strategic Employment Full time

    Job DescriptionJob DescriptionA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL...

  • Team Lead Data Engineer(Hybrid Onsite)

    2 weeks ago

    Phoenix, United States Strategic Employment Full time

    Job DescriptionJob DescriptionA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL...

  • Data Engineering Expert

    23 hours ago

    Phoenix, Arizona, United States Purple Drive Full time

    About the Role:Purple Drive is seeking a highly experienced Data Engineering professional to join our team. As a Data Engineering Expert, you will be responsible for designing and implementing data ingestion pipelines from Oracle Recruitment Cloud to a Big Data Environment, both on-prem and cloud-based.Key Responsibilities:Design and develop data...

  • Technical Program Director

    2 days ago

    Phoenix, Arizona, United States Aligned Data Centers Full time

    Job DescriptionJob Title: Technical Program Director - Data Center ExpertJob Summary:We are seeking a highly skilled Technical Program Director to lead our data center projects from inception to completion. As a key member of our team, you will be responsible for driving projects forward, ensuring timely delivery, and maintaining high-quality standards.Key...

  • Data Engineer

    4 weeks ago

    Phoenix, Arizona, United States American Express Full time

    You Lead the Way. We've Got Your BackWith the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities, and each other. Here, you'll learn and grow as we help you create a career...

  • Facilities Lead

    2 months ago

    Phoenix, United States Aligned Data Centers Full time

    JOB TITLE: Critical Facility Technician (CFT)REPORTS TO: Facility ManagerSUMMARY: Does the thought of joining one of the fastest-growing, privately held data center companies sound exciting to you? Do you enjoy collaborating with team members to drive and operate some of the industry’s leading and most innovative infrastructure solutions? At Aligned, not...

  • Data Engineer

    1 month ago

    Phoenix, Arizona, United States American Express Full time

    You Lead the Way. We've Got Your Back.With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you'll learn and grow as we help you create a career...

  • Senior Lead Mechanical Engineer

    3 months ago

    Phoenix, United States WSP Full time

    This Opportunity kW Mission Critical Engineering, a member of WSP USA, is currently initiating a search for a Senior Lead Mechanical Engineer for our kW Tempe, Arizona office: 40 E. Rio Salado Parkway, Suite 445 Tempe AZ 85281. As a Senior Lead Mechanical Engineer with us, you will design complex cooling and HVAC systems including air distribution...

  • Data Engineer

    3 months ago

    Phoenix, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionRequired SkillsBig Data Engineer with 3-4 years of hands-on Spark/Scala and Hive experience. The candidate must be able to work a hybrid schedule with the team in Phoenix, AZ (onsite every Tues/Wed/Thurs). If the candidate is not located in Phoenix, but wiling to relocate and work onsite, they can begin working remotely and then...

  • Big Data Engineer

    2 weeks ago

    Phoenix, United States Lorvenk Technologies Full time

    Position :Big Data EngineerLocation: Phoenix, AZ ( Local are preferred)Key Skills : Big Data; ETL - Big Data / Data Warehousing; PySpark; Spark; HiveJob Description:Qualifications10+ years of software development experience and leading teams of engineers and scrum teams6+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and...

  • Big Data Engineer

    2 weeks ago

    Phoenix, United States Lorvenk Technologies Full time

    Position :Big Data EngineerLocation: Phoenix, AZ ( Local are preferred)Key Skills : Big Data; ETL - Big Data / Data Warehousing; PySpark; Spark; HiveJob Description:Qualifications10+ years of software development experience and leading teams of engineers and scrum teams6+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and...

  • Data Engineer

    1 month ago

    Phoenix, United States Russell Tobin & Associates Full time

    What are we looking for in our Data Engineer? Russell Tobin's client, a non-profit healthcare company is seeking a Data Engineer in  Phoenix, AZ Apply Now! Employment Type: Full time / Hybrid Location: Phoenix, AZ Pay rate: $125k-$135k per annum Responsibilities: Key technologies: MSFT SQL Server, SSIS, Python, Azure and or...

  • Vice President of Data Engineering and Analytics

    2 days ago

    Phoenix, Arizona, United States PetSmart Full time

    About the RoleThe Vice President of IT – Data and Engineering is a critical leadership position at PetSmart, responsible for driving the company's data and analytics strategy. This role requires a seasoned executive with a strong technical background and excellent leadership skills.Key ResponsibilitiesStrategic Leadership: Provide vision and direction for...

  • Engineer - Big Data - LUMI

    2 months ago

    Phoenix, United States American Express Full time

    You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you’ll learn and grow as we help you create...

  • Gas Resource Management Lead

    2 weeks ago

    Phoenix, Arizona, United States Vantage Data Centers Full time

    Gas Planning Manager at Vantage Data Centers Vantage Data Centers is in search of a meticulous Gas Planning Manager to direct the strategic oversight and administration of gas resources across our data centers. This position entails formulating and executing supply strategies, nurturing supplier relationships, ensuring operational effectiveness, and...

  • Data Engineer

    2 weeks ago

    Phoenix, United States VMC Soft Technologies, Inc Full time

    *****************ONLY W2 CONTRACT*****************#NOC2CMinimum Qualifications:• BS or MS degree in computer science, computer engineering, or other technical discipline, or equivalent work experience.• 8+ years of overall software design and development experience.• Familiarity with Agile or other rapid application development methods.• Hands-on...

  • Data Engineer

    3 weeks ago

    Phoenix, United States Russell Tobin Full time

    Senior Data Engineer FTE | Permanent Role $125K - $145K base salaryPhoenix, AZ (Hybrid / 2 days in office and 3 days remote work)Key technologies: MSFT SQL Server, SSIS, Python, Azure and or AWSRequirements:8+ years of experienceNice to have:10+ Years of Data Engineering experienceHealthcare domain knowledgeBenefits that Russell Tobin offers:Russell Tobin...