Lead Data Engineer
3 weeks ago
About PrePass
PrePass® is North America's most utilized and technologically advanced weigh station bypass and toll payment platform. Proven PrePass technologies enable safe, qualified motor carriers to bypass inspection facilities at highway speeds, saving them time, fuel, and money while reducing emissions. As the only provider to offer bypass and tolling solutions, PrePass technology allows fleets to regain control of toll costs, eliminate toll violations, and automatically resolve max toll disputes. PrePass is the only preclearance system developed, owned, and operated in the United States of America as well as the American Trucking Associations’ only Endorsed Corporate Partner. That’s why more than 105,000 fleets subscribe over 750,000 commercial vehicles to PrePass services.
Position Description
As a Lead Data Engineer, you will be at the forefront of pioneering solutions that cater to the evolving demands of our growing business. In this capacity, you will take the lead in formulating the design, development, and implementation of our next-generation, cloud-native data architecture. Additionally, you will mentor and guide a team of talented data engineers. This position demands a blend of technical acumen and strategic thinking. We’re looking for a trailblazer who thrives on innovation and is committed to continuous learning. You should be equally adept at coding as you are in conceptualizing and communicating complex solutions across various teams and domains. This is a hybrid position based in Phoenix.
Your Key Responsibilities
- Design and implement highly scalable, distributed architecture using Azure Databricks, Delta Lake, and other Microsoft Azure services.
- Act as a technical expert, lead projects, and optimize production systems to ensure reliability, performance, scalability, and security.
- Partner with Product Management and Engineering leadership to architect and build solutions that deliver on roadmap features.
- Implement best practices in Microsoft Azure for data quality, data governance, data security, data lineage, and data cataloging.
- Guide and mentor less experienced engineers.
- Oversee and provide leadership to a team of approximately 5 engineers.
- Actively monitor workflows and compute to identify refinements that will improve efficiency and reduce costs.
- Build comprehensive solutions for orchestration and observation.
- Troubleshoot system issues, prioritize fixes, and distribute work among the team.
- Prepare, manage, and supervise code releases to Production.
- Spearhead prototyping exercises and demonstrate value and feasibility of the solutions and architecture.
Requirements
Qualifications
Required
- Bachelor’s degree in computer science, related technical field, or equivalent experience.
- Minimum 8 years of overall experience in designing and building large scale database solutions, with at least 2 years in a leadership role.
- Minimum 3 years programming experience in Python and Pyspark.
- Expert SQL skills.
- Extensive experience building ETL/ELT solutions using Azure Databricks, Azure Data Factory, or similar tools.
- Experience designing data structures and models for data lakes.
- Thorough understanding of distributed storage and distributed computing.
- Proficiency with reporting and data visualization tools, specifically PowerBI.
- Proficiency with SSIS.
- Versed in software production engineering practices, version control, code peer reviews, automated testing, and CI/CD.
- Exceptional collaborative abilities, with a talent for navigating fluid environments and embracing change.
- A commitment to staying abreast of emerging technologies and industry best-practices to drive continuous improvement in development methodologies.
Preferred
- Understanding of ML and AI concepts, algorithms, and techniques.
- Experience with both batch and streaming data sources.
- Familiarity with No-SQL databases.
- Familiarity of event driven architecture – queues, batches, and pub/sub models.
- Experience working with data from enterprise systems like ERPs and CRMs.
- Familiarity with DevOps CI/CD implementation methodologies
Benefits
How We Will Take Care of You
- Robust benefit package that includes medical, dental, and vision that start on date of hire.
- Paid Time Off, to include vacation, sick, holidays, and floating holidays.
- 401(k) plan with employer match.
- Company-funded “lifestyle account” upon date of hire for you to apply toward your physical and mental well-being (i.e., ski passes, retreats, gym memberships).
- Tuition Reimbursement Program.
- Employee Assistance Program (available at no cost to you).
- Voluntary benefits, to include but not limited to Legal and Pet Discounts.
- Company-sponsored and funded “Culture Team” that focuses on the Physical, Mental, Professional well-being of employees.
- Community Give-Back initiatives.
- Culture that focuses on Employee Development initiatives.
-
Team Lead Data Engineer
4 weeks ago
Phoenix, United States Strategic Employment Full timeA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL (Extract, Transform, Load) processes...
-
Lead Critical Facilities Engineer, NA
4 weeks ago
Phoenix, United States Vantage Data Centers Full timeAbout Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...
-
Lead Data Engineer(Hybrid Onsite in Phoenix)
4 weeks ago
Phoenix, United States Strategic Employment Partners Full timeA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL (Extract, Transform, Load) processes...
-
Lead Data Engineer(Hybrid Onsite in Phoenix)
2 weeks ago
Phoenix, United States Strategic Employment Partners Full timeA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL (Extract, Transform, Load) processes...
-
Lead Data Engineer(Hybrid Onsite in Phoenix)
4 weeks ago
Phoenix, United States Strategic Employment Partners (SEP) Full timeA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL (Extract, Transform, Load) processes...
-
Lead Data Engineer(Hybrid Onsite in Phoenix)
2 weeks ago
Phoenix, United States Strategic Employment Partners (SEP) Full timeA SaaS company which has been in business for over 25 years is looking for a Lead Data Engineer to add to their team. You will play a key role in designing, implementing, and maintaining data infrastructure and processes critical to our business operations. You will be leading a team responsible for creating efficient ETL (Extract, Transform, Load) processes...
-
Data Engineering
1 month ago
Phoenix, United States Diverse Lynx Full timeData Engineer- Oracle Fusion cloud: Learning & Talent AZ-Phoenix-85054 Relevant Experience(in yrs) = 5-8 years Technical/Functional Skills • Must have 5-8 years of Data Engineering experience in a Big Data environment. • Strong Data transformation/ETL skills using Spark, Python, PySpark, HiveQL • Must have hands on experience building data ingestion...
-
Data Engineer
1 week ago
Phoenix, United States Virtuous Full timeAbout Us Virtuous is on a mission to inspire global generosity by helping nonprofits build better relationships with their donors. We offer a modern software platform that provides mid-sized charities with elegant tools for fundraising, marketing, volunteerism, and online giving. Our talented team is driven to disrupt the status quo in the nonprofit sector....
-
Data Engineer
1 month ago
Phoenix, United States Virtuous Full timeAbout Us Virtuous is on a mission to inspire global generosity by helping nonprofits build better relationships with their donors. We offer a modern software platform that provides mid-sized charities with elegant tools for fundraising, marketing, volunteerism, and online giving. Our talented team is driven to disrupt the status quo in the nonprofit sector....
-
Facilities Lead
2 weeks ago
Phoenix, United States Aligned Data Centers Full timeJOB TITLE: Critical Facility Technician (CFT)REPORTS TO: Facility ManagerSUMMARY: Does the thought of joining one of the fastest-growing, privately held data center companies sound exciting to you? Do you enjoy collaborating with team members to drive and operate some of the industry’s leading and most innovative infrastructure solutions? At Aligned, not...
-
Senior Lead Mechanical Engineer
2 months ago
Phoenix, United States WSP Full timeThis Opportunity kW Mission Critical Engineering, a member of WSP USA, is currently initiating a search for a Senior Lead Mechanical Engineer for our kW Tempe, Arizona office: 40 E. Rio Salado Parkway, Suite 445 Tempe AZ 85281. As a Senior Lead Mechanical Engineer with us, you will design complex cooling and HVAC systems including air distribution...
-
Data Engineer
2 months ago
Phoenix, United States Virtuous Full timeJob DescriptionJob DescriptionAbout UsVirtuous is on a mission to inspire global generosity by helping nonprofits build better relationships with their donors. We offer a modern software platform that provides mid-sized charities with elegant tools for fundraising, marketing, volunteerism, and online giving.Our talented team is driven to disrupt the status...
-
GenAI Engineer
4 weeks ago
Phoenix, United States Data Affect Full timeAbout Data Affect: We are a boutique data/service management firm specializing in the delivery of data governance, enterprise data strategy, solutions architecture, data warehousing, data integrations, data security & privacy management, IT service management, business analysis (and) agile project management services to diverse clients across multiple...
-
GenAI Engineer
1 month ago
Phoenix, United States Data Affect Full timeAbout Data Affect: We are a boutique data/service management firm specializing in the delivery of data governance, enterprise data strategy, solutions architecture, data warehousing, data integrations, data security & privacy management, IT service management, business analysis (and) agile project management services to diverse clients across multiple...
-
Lead Data Analyst
1 month ago
Phoenix, Arizona, United States American Express Full timeYou Lead the Way. We've Got Your Back.With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you'll learn and grow as we help you create a career...
-
Critical Operations Tech Overnight
1 month ago
Phoenix, United States QTS Data Centers Full timeLearn what makes QTS a unique place to grow your career! SUMMARY The Critical Operations Technician I is responsible for the installation, repair, and maintenance of IT, electrical, mechanical, plumbing/piping equipment, machinery and controls located in the interior and exterior of building. This role monitors operations and conducts a routine and ongoing...
-
Data Engineer
1 week ago
Phoenix, United States RIT Solutions, Inc. Full timeData Engineer 3 days Phoenix, As a Data Engineer at our client, you will play a crucial role in designing, building, and maintaining the data architecture that powers our analytical and operational capabilities. You will work closely with developers, QA's, Scrum Master and other stakeholders to ensure data availability, reliability, and integrity. Your...
-
GCP Data Engineer
3 weeks ago
Phoenix, United States M3BI - A Zensar Company Full timeClient is looking for someone who is good at: Strong in GCP and PythonKnowledge on migration projectsexperience on building re-usable idempotent pipelinesemphasize on data engineering principles on pipelines being builtcomprehensive knowledge on some of the core GCP servicesJOB SUMMARY & PRINCIPAL DUTIES:A solid experience and understanding of considerations...
-
Data Engineer
1 week ago
Phoenix, United States Cloud BC Labs Full timeJob DescriptionJob DescriptionPOSITIONData EngineerLOCATIONHybrid- Phoenix, AZDURATIONCTH 9 Month conversionINTERVIEW TYPEVideoVISA RESTRICTIONSOnly GC or CitizensREQUIRED SKILLSNeeds STRONG GCP experienceProficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).Proven experience as a Data Engineer or in a similar...
-
DevOps Engineer III
5 days ago
Phoenix, United States NTT DATA Full timeNTT Data is assisting our healthcare client in search for a Temporary DevOps Engineer III located in the Phoenix metro. TYPE: Temp LOCATION: Must be local to metro Phoenix. Need to come in monthly for some meetings. PAY: $50 - $55 per hour Purpose of the job Serves as a DevOps Engineer supporting a dedicated DevOps team. This role will be responsible for...
