Senior Data Engineer

1 month ago

Provo, United States PrincePerelson and Associates Full time

Senior Data Engineer

Provo, Utah - Hybrid

*Only candidates residing in the Untied States will be considered

No agencies

$160-175K/year



As a Senior Data Engineer focusing on data automation and quality you will be expected to use a highly programmatic approach to solving the company’s data needs. This includes leveraging python and ANSI SQL to build data pipelines and quality tools using Spark, Databricks DLT pipelines, and other methods on the Databricks platform. This job is focused less on data architecture / structure and more on building resilient software. As such you should expect to be developing python code daily. In this role a successful data engineer is one who has the desire to build and maintain environments that run millions of lines of code with few or no failures while maintaining a high degree of accuracy.


Education

  • Bachelor’s degree (BS) in Computer Science, Statistics, Informatics, Information Systems or another quantitative field, or equivalent industry experience or other math based technical field that requires significant programing course work to complete the degree. (EcEn, Econ, Stats, etc.)
  • Desired; 2 Year master’s degree (MS) in computer science or other math based technical field that requires significant programing.



Experience

  • 3-5 years As a technical data engineering experience specifically focusing on automation and quality using python and spark based technologies to process and automate data.
  • 3-5 years Experience designing cloud-based data pipelines using a variety of tools (e.g., Databricks, Fivetran, or similar).
  • 3-5 years Experience with cloud data technologies (e.g., Snowflake, AWS, Azure) and industry best practices around data in cloud platforms.



Essential Knowledge, Skills, and Abilities

  • Prior experience as a Data Engineer or similar technical data professional
  • Deep knowledge of Databricks and experience processing both streaming (Kinesis) and batch data at scale using python.
  • A strong desire to be a Team player and build a collaborative environment.
  • Possess a very strong understanding of python and ANSI SQL including accessing remote data outside of the base environment using HTTP, Rest APIs, etc.
  • Demonstrated ability to learn new platforms and technologies.
  • Build and maintain the data infrastructure required to transform OLTP data sources into usable data structures optimized for business intelligence and data engineering.
  • Design, implement, and maintain the next-generation data pipelines using industry leading technologies such as Databricks.
  • In collaboration with IT and other business stakeholders, consolidate multiple complex data silos into a single enterprise data warehouse used for companywide data engineering and analytics.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Work with stakeholders including the Engineering, IT, and other Data Services teams to assist with data-related technical issues and support their data infrastructure needs.
  • Ensure compliance with security, data retention, and privacy policies to keep our data secure across multiple data centers and cloud vendors.
  • Create data tools for Data Engineering team members that assist them in building and optimizing our services.
  • Maintain current data pipelines to support business needs.
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Other duties as assigned by management.
  • Experience using multiple programming languages (e.g., SQL, , Spark, Python,) to create reproducible, automated processes to create data infrastructure and products for business users.
  • Advanced SQL knowledge and query optimization.
  • Experience building, maintaining, and optimizing (balancing speed and cost) cloud data warehouses.
  • Deep knowledge of OLAP vs OLTP database architectures
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience working with API’s and command line interface tools to automate data extraction, loading, and transformation.
  • Experience working with business users to develop automated quality assurance error checks.
  • Strong project management and organizational skills.
  • Ability to apply analytical and critical thinking to solve complex problems.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Demonstrate outstanding ethics, integrity, and judgment.
  • Exceptional written communication skills with specific ability to communicate concepts and ideas concisely and defend their validity.
  • Interact with others in a professional and mature manner.
  • Advanced understanding modern data warehouse practices
  • Experience with relational SQL and NoSQL databases, including MS SQL Server.
  • Experience building AWS infrastructure.



PrincePerelson & Associates is an Equal Opportunity Employer and we do not discriminate against applicants due to race, color, religion, sex, national origin, age, disability, genetics, veteran status, or on the basis of disability or any other federal, state or local protected class. All applicants applying for U.S. job openings must be authorized to work in the United States.

  • Senior Data Engineer

    4 weeks ago

    Provo, Utah, United States PrincePerelson & Associates Full time

    Job SummaryPrincePerelson & Associates is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and implementing data pipelines using Databricks and other technologies. You will work closely with our data and analytics team to ensure the accuracy and reliability of our data...

  • Senior Data Engineer

    4 weeks ago

    Provo, Utah, United States Vivint Full time

    About the Role:Vivint is seeking a highly skilled Sr. Analytics Engineer to join our Analytics Engineering and Data Warehousing team. As a key member of this team, you will be responsible for developing the core service that provides data to the entire enterprise.You will work closely with our finance teams to build and maintain a data warehouse platform...

  • Senior Data Automation Engineer

    4 weeks ago

    Provo, Utah, United States PrincePerelson & Associates Full time

    Job SummaryPrincePerelson & Associates is seeking a highly skilled Data Automation and Quality Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining data pipelines and quality tools using Spark, Databricks DLT pipelines, and other methods on the Databricks platform.Key...

  • Senior Data Engineer

    2 weeks ago

    Provo, UT, United States PrincePerelson and Associates Full time

    Senior Data EngineerProvo, Utah - Hybrid*Only candidates residing in the Untied States will be consideredNo agencies$160-175K/yearAs a Senior Data Engineer focusing on data automation and quality you will be expected to use a highly programmatic approach to solving the company’s data needs. This includes leveraging python and ANSI SQL to build data...

  • Software Engineer

    2 weeks ago

    Provo, United States Rebuy Full time

    JOB POSTING Software Engineer - Data Sources Join the engineering team shaping the future of AI-powered shopping experiences across our global software platforms. About Us: Our team is small, highly motivated, and focused on engineering excellence. Our organization is for individuals who appreciate challenging themselves and who thrive on curiosity and...

  • Data Engineer

    1 month ago

    Provo, Utah, United States Aristotle Full time

    About AristotleAristotle is a leading player in the computer software industry, committed to advancing democracy around the world through innovative software solutions that empower organizations and individuals alike.Job Title: Data EngineerJob SummaryWe are seeking a talented and driven Data Engineer to join our dynamic team. As a Data Engineer, you will be...

  • Senior Analytics Engineer

    4 weeks ago

    Provo, Utah, United States Unicity Full time

    Company Overview:Unicity is a pioneering organization dedicated to creating innovative science-based products and solutions that promote metabolic health and enhance the quality of life for individuals worldwide.With a rich history spanning over three decades, Unicity has established itself as a leader in developing high-quality products that cater to the...

  • Data Engineer

    4 weeks ago

    Provo, Utah, United States CDC Foundation Full time

    The CDC Foundation is seeking a highly skilled Data Engineer to play a crucial role in advancing its mission by designing, building, and maintaining data infrastructure for a public health organization.This role is aligned to the Workforce Acceleration Initiative (WAI), a federally funded CDC Foundation program aimed at helping the nation's public health...

  • Data Engineer I

    4 weeks ago

    Provo, Utah, United States Vivint Full time

    Role SummaryAs an Analytics Engineer on our team, you will be responsible for developing the core service that provides data to the entire enterprise. This role requires expertise in SQL and cloud warehouse design, as well as experience with data modeling and data warehousing development.Key ResponsibilitiesDevelop and maintain a data warehouse platform that...

  • Senior Battery Engineer

    1 month ago

    Provo, Utah, United States Hypercraft Full time

    Job Title: Senior Battery EngineerHypercraft is a leading provider of electric vehicle propulsion technology, and we're seeking a highly skilled Senior Battery Engineer to join our team.About the RoleWe're looking for a seasoned engineer with expertise in battery system design, development, and integration. As a Senior Battery Engineer at Hypercraft, you'll...

  • Senior Mechanical Engineer

    1 month ago

    Provo, Utah, United States BAE Systems USA Full time

    Job DescriptionBAE Systems USA is seeking a Senior Mechanical Engineer to support the readiness and sustainment of the US Air Force Intercontinental Ballistic Missile (ICBM) program under the Integration Support Contract (ISC).The successful candidate will be part of a diverse and enthusiastic team who solves complex technical challenges. As a Senior...

  • Senior Mechanical Engineer

    1 month ago

    Provo, Utah, United States BAE Systems USA Full time

    Job SummaryBAE Systems USA is seeking a Senior Mechanical Engineer to join our team in McLean, Virginia. As a key member of our Intelligence & Security division, you will be responsible for supporting the readiness and sustainment of the US Air Force Intercontinental Ballistic Missile (ICBM) program under the Integration Support Contract (ISC).Key...

  • Cloud Data Engineer

    1 month ago

    Provo, Utah, United States Diverse Lynx Full time

    Data Transformation and ETL SpecialistWe are seeking a highly skilled Data Transformation and ETL Specialist to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data ingestion pipelines from Oracle Recruitment Cloud to a Big Data Environment.Key...

  • Senior Civil Engineer Position

    4 weeks ago

    Provo, Utah, United States Bureau of Reclamation Full time

    Job SummaryThe Bureau of Reclamation is seeking a highly skilled and experienced Senior Civil Engineer to join our team. As a Senior Civil Engineer, you will be responsible for leading and managing a team of engineers and technicians to design, develop, and implement civil engineering projects. You will work closely with other departments to ensure that...

  • Senior Software Engineer

    4 weeks ago

    Provo, Utah, United States PELATRON TECHNOLOGIES LLC Full time

    Job Summary:We are seeking a highly skilled Senior Software Engineer to join our team at Pelatron Technologies LLC. As a Senior Software Engineer, you will be responsible for leading efforts to generate and manage software requirements, software scrums and sprints, coding, regression testing, and all other software activities.Key Responsibilities:Provide...

  • Senior Software Engineer

    4 weeks ago

    Provo, Utah, United States PELATRON TECHNOLOGIES LLC Full time

    Job Summary:As a Senior Software Engineer at Pelatron Technologies LLC, you will lead efforts to generate and manage software requirements, software scrums and sprints, coding, regression testing, and all other software activities. You will provide mature leadership to the software team and provide technical expertise for the acquisition of computer system...

  • Data Engineer

    2 weeks ago

    Provo, Utah, United States Aristotle Corp Full time

    Aristotle Corp is seeking a skilled Data Engineer to contribute to the development of innovative software solutions that empower organizations and individuals alike.The successful candidate will be responsible for designing, developing, and deploying data integration solutions using Microsoft SQL Server technologies, including T-SQL programming, SSIS, and...

  • Data Engineer II

    4 weeks ago

    Provo, Utah, United States Qualtrics Full time

    About the RoleWe're seeking a highly skilled Data Engineer II to join our team, where you'll be responsible for developing scalable, fast, and robust data analytics solutions to solve complex business problems.As a key member of our Data Engineering Team, you'll collaborate closely with your team to collect and incorporate feedback into your feature design,...

  • Senior Electrical Engineer for ICBM Systems

    1 month ago

    Provo, Utah, United States BAE Systems USA Full time

    Job DescriptionWe are seeking a highly skilled Senior Electrical Engineer to join our team at BAE Systems USA. As a key member of our team, you will be responsible for supporting the Minuteman III (MMIII) Intercontinental Ballistic Missile (ICBM) weapon system as well as the Sentinel ICBM weapon system.The successful candidate will assist the Air Force...

  • Senior Backend Software Engineer

    4 weeks ago

    Provo, Utah, United States PrincePerelson & Associates Full time

    Job Title: Senior Backend Software EngineerWe are seeking a highly skilled Senior Backend Software Engineer to join our team at PrincePerelson & Associates. As a key member of our team, you will be responsible for designing, implementing, and maintaining domestic and international APIs and applications.Responsibilities:* Design and develop scalable and...