Lead Data Engineer

3 months ago

Phoenix, United States PrePass, LLC Full time
Job DescriptionJob Description

About PrePass

PrePass® is North America's most utilized and technologically advanced weigh station bypass and toll payment platform. Proven PrePass technologies enable safe, qualified motor carriers to bypass inspection facilities at highway speeds, saving them time, fuel, and money while reducing emissions. As the only provider to offer bypass and tolling solutions, PrePass technology allows fleets to regain control of toll costs, eliminate toll violations, and automatically resolve max toll disputes. PrePass is the only preclearance system developed, owned, and operated in the United States of America as well as the American Trucking Associations’ only Endorsed Corporate Partner. That’s why more than 105,000 fleets subscribe over 750,000 commercial vehicles to PrePass services.

Position Description

As a Lead Data Engineer, you will be at the forefront of pioneering solutions that cater to the evolving demands of our growing business. In this capacity, you will take the lead in formulating the design, development, and implementation of our next-generation, cloud-native data architecture. Additionally, you will mentor and guide a team of talented data engineers. This position demands a blend of technical acumen and strategic thinking. We’re looking for a trailblazer who thrives on innovation and is committed to continuous learning. You should be equally adept at coding as you are in conceptualizing and communicating complex solutions across various teams and domains. This is a hybrid position based in Phoenix.

Your Key Responsibilities

  • Design and implement highly scalable, distributed architecture using Azure Databricks, Delta Lake, and other Microsoft Azure services.
  • Act as a technical expert, lead projects, and optimize production systems to ensure reliability, performance, scalability, and security.
  • Partner with Product Management and Engineering leadership to architect and build solutions that deliver on roadmap features.
  • Implement best practices in Microsoft Azure for data quality, data governance, data security, data lineage, and data cataloging.
  • Guide and mentor less experienced engineers.
  • Oversee and provide leadership to a team of approximately 5 engineers.
  • Actively monitor workflows and compute to identify refinements that will improve efficiency and reduce costs.
  • Build comprehensive solutions for orchestration and observation.
  • Troubleshoot system issues, prioritize fixes, and distribute work among the team.
  • Prepare, manage, and supervise code releases to Production.
  • Spearhead prototyping exercises and demonstrate value and feasibility of the solutions and architecture.

Requirements

Qualifications

Required

  • Bachelor’s degree in computer science, related technical field, or equivalent experience.
  • Minimum 8 years of overall experience in designing and building large scale database solutions, with at least 2 years in a leadership role.
  • Minimum 3 years programming experience in Python and Pyspark.
  • Expert SQL skills.
  • Extensive experience building ETL/ELT solutions using Azure Databricks, Azure Data Factory, or similar tools.
  • Experience designing data structures and models for data lakes.
  • Thorough understanding of distributed storage and distributed computing.
  • Proficiency with reporting and data visualization tools, specifically PowerBI.
  • Proficiency with SSIS.
  • Versed in software production engineering practices, version control, code peer reviews, automated testing, and CI/CD.
  • Exceptional collaborative abilities, with a talent for navigating fluid environments and embracing change.
  • A commitment to staying abreast of emerging technologies and industry best-practices to drive continuous improvement in development methodologies.

Preferred

  • Understanding of ML and AI concepts, algorithms, and techniques.
  • Experience with both batch and streaming data sources.
  • Familiarity with No-SQL databases.
  • Familiarity of event driven architecture – queues, batches, and pub/sub models.
  • Experience working with data from enterprise systems like ERPs and CRMs.
  • Familiarity with DevOps CI/CD implementation methodologies

Benefits

How We Will Take Care of You

  • Robust benefit package that includes medical, dental, and vision that start on date of hire.
  • Paid Time Off, to include vacation, sick, holidays, and floating holidays.
  • 401(k) plan with employer match.
  • Company-funded “lifestyle account” upon date of hire for you to apply toward your physical and mental well-being (i.e., ski passes, retreats, gym memberships).
  • Tuition Reimbursement Program.
  • Employee Assistance Program (available at no cost to you).
  • Voluntary benefits, to include but not limited to Legal and Pet Discounts.
  • Company-sponsored and funded “Culture Team” that focuses on the Physical, Mental, Professional well-being of employees.
  • Community Give-Back initiatives.
  • Culture that focuses on Employee Development initiatives.

  • Mechanical Engineering Lead

    2 weeks ago

    Phoenix, Arizona, United States Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading provider of data center infrastructure, committed to delivering exceptional facilities and services to our customers. Our mission is to empower businesses to thrive in a rapidly changing digital landscape.Job OverviewWe are seeking a highly skilled Mechanical Engineering Lead to join our Design &...

  • Data Engineering Lead: Data Governance

    4 days ago

    Phoenix, Arizona, United States TechStar Group Full time

    Job Title: Data Engineering Lead: Data GovernanceAt TechStar Group, we are seeking an experienced Data Engineering Lead to join our team. As a key member of our data engineering team, you will be responsible for leading the Azure Data Ingestion and Integration activities from onshore for our on-off team of around 8 people.Key Responsibilities:Collaborate...

  • Data Engineering Lead: Data Governance

    5 days ago

    phoenix, United States TechStar Group Full time

    Client – Large Financial ClientLOCAL to Phoenix AZ - Strictly Local candidates Only with 12 + years of experienceHybrid, Any Visa, $65/hr on C2CLocal candidates Only (No Relocation Candidates)Data Engineering Lead: Data Governance is a mustResponsibilities• Lead the Azure Data Ingestion and Integration activities from onshore for the on-off team of...

  • Data Engineering Lead: Data Governance

    5 days ago

    Phoenix, United States TechStar Group Full time

    Client – Large Financial ClientLOCAL to Phoenix AZ - Strictly Local candidates Only with 12 + years of experienceHybrid, Any Visa, $65/hr on C2CLocal candidates Only (No Relocation Candidates)Data Engineering Lead: Data Governance is a mustResponsibilities• Lead the Azure Data Ingestion and Integration activities from onshore for the on-off team of...

  • Data Engineering Lead

    1 week ago

    Phoenix, Arizona, United States CommonSpirit Health Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at CommonSpirit Health. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and solutions that drive business insights and decision-making.Key ResponsibilitiesDesign and implement...

  • Lead Data Architect

    2 weeks ago

    Phoenix, Arizona, United States Strategic Employment Partners (SEP) Full time

    Job Title: Lead Data EngineerAbout the Role:We are seeking a highly skilled Lead Data Engineer to join our team at Strategic Employment Partners (SEP). As a Lead Data Engineer, you will play a critical role in designing, implementing, and maintaining data infrastructure and processes that drive our business operations.Key Responsibilities:Lead a team of data...

  • Team Lead Data Engineer(Hybrid Onsite)

    4 weeks ago

    Phoenix, United States Strategic Employment Full time

    Job DescriptionJob DescriptionA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL...

  • Data Engineer

    1 week ago

    Phoenix, Arizona, United States Centraprise Full time

    Job Title: GCP Data EngineerLocation: RemoteJob Type: Direct Client RequirementAbout the Role:We are seeking a highly skilled GCP Data Engineer to join our team at Centraprise. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on Google Cloud Platform.Key Responsibilities:Design and...

  • Data Engineering Expert

    3 weeks ago

    Phoenix, Arizona, United States Purple Drive Full time

    About the Role:Purple Drive is seeking a highly experienced Data Engineering professional to join our team. As a Data Engineering Expert, you will be responsible for designing and implementing data ingestion pipelines from Oracle Recruitment Cloud to a Big Data Environment, both on-prem and cloud-based.Key Responsibilities:Design and develop data...

  • Team Lead Data Engineer(Hybrid Onsite)

    1 month ago

    Phoenix, United States Strategic Employment Full time

    Job DescriptionJob DescriptionA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL...

  • Technical Program Director

    3 weeks ago

    Phoenix, Arizona, United States Aligned Data Centers Full time

    Job DescriptionJob Title: Technical Program Director - Data Center ExpertJob Summary:We are seeking a highly skilled Technical Program Director to lead our data center projects from inception to completion. As a key member of our team, you will be responsible for driving projects forward, ensuring timely delivery, and maintaining high-quality standards.Key...

  • Data Engineer

    7 days ago

    Phoenix, Arizona, United States Virtuous Full time

    About VirtuousVirtuous is a mission-driven organization dedicated to empowering nonprofits to build better relationships with their donors. Our modern software platform provides elegant tools for fundraising, marketing, volunteerism, and online giving, helping charities achieve their goals.We're a team of talented individuals driven to disrupt the status quo...

  • Senior Data Engineer

    2 weeks ago

    Phoenix, Arizona, United States Harnham Full time

    Unlock Your Potential as a Senior Data EngineerAbout the RoleHarnham is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures, developing efficient ETL pipelines, and ensuring data governance and security.Key...

  • Senior Data Infrastructure Engineer

    5 days ago

    Phoenix, Arizona, United States Strategic Employment Partners (SEP) Full time

    Strategic Employment Partners (SEP) - Lead Data EngineerA SaaS company with over 25 years of experience is seeking a Lead Data Engineer to join their team. As a key member of the data infrastructure team, you will design, implement, and maintain critical data processes and infrastructure in Azure Data Factory. Your leadership skills will be essential in...

  • Senior Data Engineer

    1 week ago

    Phoenix, Arizona, United States Harnham Full time

    Senior Data EngineerUnlocking Business Potential through Data Innovation$110,000 to $150,000 base salaryPhoenix, AZ - 5 days per week onsiteAbout the CompanyHarnham is a leading recruitment agency specializing in data and technology roles. Our team of experts is dedicated to connecting top talent with innovative companies.About the RoleWe are seeking a...

  • Data Engineer

    5 days ago

    Phoenix, Arizona, United States Western Alliance Bank Full time

    Job Title: Data Engineer IIWe are seeking a highly skilled Data Engineer II to join our Business Intelligence and Data Engineering team at Western Alliance Bank. As a key member of our team, you will be responsible for designing, developing, and maintaining core databases that support our company using data modeling and data warehousing techniques.Key...

  • Big Data Engineer

    1 week ago

    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Syntricate Technologies. As a key member of our digital transformation team, you will be responsible for designing, developing, and implementing large-scale Big Data applications using the Hadoop ecosystem.Key Responsibilities:Design and develop Big Data...

  • Facilities Lead

    3 months ago

    Phoenix, United States Aligned Data Centers Full time

    JOB TITLE: Critical Facility Technician (CFT)REPORTS TO: Facility ManagerSUMMARY: Does the thought of joining one of the fastest-growing, privately held data center companies sound exciting to you? Do you enjoy collaborating with team members to drive and operate some of the industry’s leading and most innovative infrastructure solutions? At Aligned, not...

  • Data Center Sales Engineer

    9 hours ago

    Phoenix, Arizona, United States Pkaza LLC Full time

    Job Title: Data Center Sales EngineerThis is an exciting opportunity to work with a leading OEM that provides mission-critical equipment solutions for data centers. As a Data Center Sales Engineer, you will be responsible for developing new business and maintaining existing clients in the mission critical data center space.Responsibilities:Develop new...

  • Data Engineer

    4 months ago

    Phoenix, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionRequired SkillsBig Data Engineer with 3-4 years of hands-on Spark/Scala and Hive experience. The candidate must be able to work a hybrid schedule with the team in Phoenix, AZ (onsite every Tues/Wed/Thurs). If the candidate is not located in Phoenix, but wiling to relocate and work onsite, they can begin working remotely and then...