Senior Data Engineer

4 weeks ago

Provo, United States PrincePerelson and Associates Full time

Senior Data Engineer

Provo, Utah (Hybrid)

$160-180K/year

No Corp to Corp or sponsorship



As a Senior Data Engineer focusing on data automation and quality you will be expected to use a highly programmatic approach to solving the company’s data needs. This includes leveraging python and ANSI SQL to build data pipelines and quality tools using Spark, Databricks DLT pipelines, and other methods on the Databricks platform. This job is focused less on data architecture / structure and more on building resilient software. As such you should expect to be developing python code daily. In this role a successful data engineer is one who has the desire to build and maintain environments that run millions of lines of code with few or no failures while maintaining a high degree of accuracy.


Education

  • Bachelor’s degree (BS) in Computer Science, Statistics, Informatics, Information Systems or another quantitative field, or equivalent industry experience or other math based technical field that requires significant programing course work to complete the degree. (EcEn, Econ, Stats, etc.)
  • Desired 2 Year master’s degree (MS) in computer science or other math based technical field that requires significant programing.


Experience

  • 3-5 years As a technical data engineering experience specifically focusing on automation and quality using python and spark based technologies to process and automate data.
  • 3-5 years Experience designing cloud-based data pipelines using a variety of tools (e.g., Databricks, Fivetran, or similar).
  • 3-5 years Experience with cloud data technologies (e.g., Snowflake, AWS, Azure) and industry best practices around data in cloud platforms.


Knowledge, Skills, and Essential Abilities

  • Prior experience as a Data Engineer or similar technical data professional
  • Deep knowledge of Databricks and experience processing both streaming (Kinesis) and batch data at scale using python.
  • A strong desire to be a Team player and build a collaborative environment.
  • Possess a very strong understanding of python and ANSI SQL including accessing remote data outside of the base environment using HTTP, Rest APIs, etc.
  • Demonstrated ability to learn new platforms and technologies.
  • Build and maintain the data infrastructure required to transform OLTP data sources into usable data structures optimized for business intelligence and data engineering.
  • Design, implement, and maintain the next-generation data pipelines using industry leading technologies such as Databricks.
  • In collaboration with IT and other business stakeholders, consolidate multiple complex data silos into a single enterprise data warehouse used for companywide data engineering and analytics.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Work with stakeholders including the Engineering, IT, and other Data Services teams to assist with data-related technical issues and support their data infrastructure needs.
  • Ensure compliance with security, data retention, and privacy policies to keep our data secure across multiple data centers and cloud vendors.
  • Create data tools for Data Engineering team members that assist them in building and optimizing our services.
  • Maintain current data pipelines to support business needs.
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Other duties as assigned by management.
  • Experience using multiple programming languages (e.g., SQL, , Spark, Python,) to create reproducible, automated processes to create data infrastructure and products for business users.
  • Advanced SQL knowledge and query optimization.
  • Experience building, maintaining, and optimizing (balancing speed and cost) cloud data warehouses.
  • Deep knowledge of OLAP vs OLTP database architectures
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience working with API’s and command line interface tools to automate data extraction, loading, and transformation.
  • Experience working with business users to develop automated quality assurance error checks.
  • Strong project management and organizational skills.
  • Ability to apply analytical and critical thinking to solve complex problems.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Demonstrate outstanding ethics, integrity, and judgment.
  • Exceptional written communication skills with specific ability to communicate concepts and ideas concisely and defend their validity.
  • Interact with others in a professional and mature manner.
  • Advanced understanding modern data warehouse practices
  • Experience with relational SQL and NoSQL databases, including MS SQL Server.
  • Experience building AWS infrastructure.



PrincePerelson & Associates is an Equal Opportunity Employer and we do not discriminate against applicants due to race, color, religion, sex, national origin, age, disability, genetics, veteran status, or on the basis of disability or any other federal, state or local protected class. All applicants applying for U.S. job openings must be authorized to work in the United States.

  • Senior Data Engineer

    4 weeks ago

    Provo, United States PrincePerelson and Associates Full time

    Senior Data EngineerProvo, Utah (Hybrid)$160-180K/yearNo Corp to Corp or sponsorshipAs a Senior Data Engineer focusing on data automation and quality you will be expected to use a highly programmatic approach to solving the company’s data needs. This includes leveraging python and ANSI SQL to build data pipelines and quality tools using Spark, Databricks...

  • Data Engineer II

    1 month ago

    Provo, United States Qualtrics Full time

    At Qualtrics, we create software the world’s best brands use to deliver exceptional frontline experiences, build high-performing teams, and design products people love. But we are more than a platform—we are the creators and stewards of the Experience Management category serving over 18K clients globally. Building a category takes grit,...

  • Software Engineer II, Data Platform

    2 months ago

    Provo, Utah, United States Qualtrics Full time

    At Qualtrics, we create software the world's best brands use to deliver exceptional frontline experiences, build high-performing teams, and design products people love. But we are more than a platform—we are the creators and stewards of the Experience Management category serving over 18K clients globally. Building a category takes grit, determination, and...

  • Senior Software Engineer

    2 weeks ago

    Provo, United States One Network Full time

    Senior Software Engineer - SIPR About the job Description: The Senior Software Engineer will be a member of the development team for One Network's Supply Chain Application module suite. ONE Network Supply Chain Application modules are built on the ONE Network Platform, a runtime and SDK for building enterprise business applications. The Supply Chain...

  • Data Engineer II

    1 month ago

    Provo, Utah, United States Qualtrics Full time

    At Qualtrics, we create software the world's best brands use to deliver exceptional frontline experiences, build high-performing teams, and design products people love. But we are more than a platform—we are the creators and stewards of the Experience Management category serving over 18K clients globally. Building a category takes grit, determination, and...

  • Senior Storage Solutions Engineer

    2 weeks ago

    Provo, Utah, United States Global Technical Talent Full time

    Senior Storage Solutions Engineer Contract Duration: 6 Months Job OverviewJoin a team of skilled engineers dedicated to crafting solutions for intricate challenges. This role involves developing innovative systems and processes that are integral to our core operations, facilitating rapid transactions. Our team ensures immediate access to essential deal data,...

  • Senior Engineering Manager

    1 week ago

    Provo, Utah, United States Paragon Services, LLC Full time

    Job OverviewPosition Title: Senior Engineering ManagerLocation: Provo, UT Essential Qualifications:At least 5 years of leadership experience in the management of HVAC systems and the maintenance of complex mechanical infrastructures.Completion of secondary education with specialized training in HVAC and related systems maintenance.Understanding of OSHA...

  • Senior .NET Software Engineer

    1 month ago

    Provo, United States Saxon Global Full time

    Position: Senior .NET Software Engineer Location : Provo, UT (Remote) Visa: No H1 Rate: $75/hr. on C2c Duration: 12+ Months As a Senior .Net Software Engineer for PredictIt you will get to work on challenging and rewarding projects across the tech stack: from creating innovative web experiences to redesigning the financial engine at the heart of...

  • Senior Mining Engineer

    3 days ago

    Provo, Utah, United States Lincoln Group Industrial Services Full time

    Job Opportunity: Lincoln Group Industrial Services is seeking a highly skilled Senior Mining Engineer to join their team on a direct-hire basis.About the Role:The ideal candidate will have a strong background in mining engineering, with excellent computer skills and the ability to manage multiple projects and budgeted accounts.Key Responsibilities:Develop...

  • Senior Java Engineer

    2 weeks ago

    Provo, Utah, United States HTC Global Services Full time

    About HTC Global ServicesAt HTC Global Services, we pride ourselves on a culture that fosters growth and innovation. Our dedicated workforce of 12,000 professionals is committed to integrating human expertise with technology to deliver impactful solutions that enhance value.Position OverviewWe are seeking a full-time Senior Java Developer to design and...

  • Senior Java Engineer

    2 weeks ago

    Provo, Utah, United States HTC Global Services Full time

    About HTC Global ServicesAt HTC Global Services, we pride ourselves on a culture that fosters career growth and development, as evidenced by our long-standing employees. With a global workforce of 12,000, we aim to integrate human expertise with technology to create impactful solutions that enhance value.Position OverviewWe are seeking a full-time Senior...

  • Senior Mechanical Engineer

    1 month ago

    Provo, United States Hypercraft Full time

    Job DescriptionJob DescriptionHypercraft’s mission is to make EV technology more-widely available to early adopters who believe in the many benefits of electric propulsion. We are among the first companies in the world to supply complete, electric-powered drive systems (powertrains) for manufacturers of vehicles in the automotive, racing, defense,...

  • Senior Systems Test Engineer

    2 weeks ago

    Provo, Utah, United States L3Harris Technologies Full time

    Job Title: Senior Systems Test EngineerAbout L3Harris Technologies:L3Harris Technologies is a dynamic global leader in aerospace and defense innovation, providing comprehensive solutions tailored to meet critical mission requirements. The organization specializes in advanced technologies across various domains including space, air, land, sea, and cyber, with...

  • Senior Battery Engineer

    1 month ago

    Provo, United States Hypercraft Full time

    Job DescriptionJob DescriptionHypercraft’s mission is to make EV technology more-widely available to early adopters who believe in the many benefits of electric propulsion. We are among the first companies in the world to supply complete, electric-powered drive systems (powertrains) for manufacturers of vehicles in the automotive, racing, defense,...

  • Senior Java Engineer

    2 weeks ago

    Provo, Utah, United States HTC Global Services Full time

    About HTC Global ServicesAt HTC Global Services, we pride ourselves on our commitment to fostering careers, as evidenced by our long-standing employees who reflect our positive work culture. We are a global organization with a workforce of 12,000 dedicated professionals, working together to integrate human expertise with technology to deliver impactful...

  • Senior Java Engineer

    1 week ago

    Provo, Utah, United States HTC Global Services Full time

    About HTC Global ServicesAt HTC Global Services, we are dedicated to fostering careers, as evidenced by our long-standing employees who exemplify our positive work culture. With a global workforce of 12,000, we aim to merge human expertise with technology to deliver impactful solutions that enhance value.Position OverviewHTC Global is seeking a full-time...

  • Senior Software Engineer

    2 weeks ago

    Provo, Utah, United States Care Full time

    About UsWe are a technology-driven company dedicated to addressing a fundamental human need: connecting families with exceptional care solutions. Our team consists of individuals who understand the importance of family and community, and we strive to create products that reflect our values.At our organization, we bring together innovators, collaborators, and...

  • Senior Java Software Engineer

    1 week ago

    Provo, Utah, United States HTC Global Services Full time

    About HTC Global ServicesAt HTC Global Services, we pride ourselves on a rich work culture that has shaped the careers of our long-tenured employees. Our global workforce of 12,000 is dedicated to integrating human expertise with technology to deliver impactful solutions that enhance value.Position OverviewWe are seeking a full-time Senior Java Developer to...

  • Senior Java Software Engineer

    2 weeks ago

    Provo, Utah, United States HTC Global Services Full time

    About HTC Global ServicesAt HTC Global Services, we pride ourselves on fostering a work environment that values long-term employee satisfaction and career growth. Our diverse workforce of 12,000 professionals is dedicated to integrating human expertise with technology to deliver impactful solutions that enhance value.Position OverviewWe are seeking a...

  • Senior Software Engineer

    1 week ago

    Provo, Utah, United States Care Full time

    About UsCare is a technology-driven organization dedicated to addressing a fundamental human need: connecting families with quality care services. Our team comprises individuals who understand the importance of care, as we are parents, caregivers, and community members ourselves. We are committed to creating a culture that reflects our mission and values.At...