Senior Data Engineer

9 hours ago


Boulder, Colorado, United States Bayforce Full time
Job Title: Senior Data Engineer

Bayforce is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data workflows, handling complex data environments, and utilizing contemporary data platforms.

Key Responsibilities:
  • Design and implement efficient, scalable, and reliable data workflows using Databricks, PySpark, and SQL to handle large datasets.
  • Lead efforts to set up, maintain, and optimize Airflow, providing the engineering team with guidance on best practices.
  • Work closely with the environment manager to set up and maintain various environments (development, testing, and production) optimized for both performance and cost.
  • Collaborate on the design and development of operational data systems, ensuring they meet the needs of performance, scalability, and availability.
  • Constantly monitor and adjust data processes to optimize resource utilization and minimize delays in data handling.
  • Develop and enforce best practices for coding, testing, documentation, and deployment within the data engineering team.
Requirements:
  • 5+ years in data engineering, focusing on managing large-scale environments and building complex data workflows.
  • Extensive hands-on experience with Databricks.
  • Strong expertise in job scheduling and automation with Airflow.
  • Deep knowledge of Snowflake as a data warehousing tool.
  • Advanced proficiency in PySpark for distributed data operations.
  • Solid Python skills for scripting and building data workflows.
  • Expert-level SQL for managing and querying data.
  • Proven experience managing cloud-based environments.
  • Experience in creating and managing operational data systems.
Preferred Skills:
  • Experience with AWS, Azure, or GCP.
  • Familiarity with designing and implementing serverless solutions.
  • Hands-on experience with Data Lake/Delta Lake.
  • Experience in designing event-driven data workflows.
  • Knowledge of continuous integration and deployment in a data engineering context.

Bachelor's degree in Computer Science, Information Systems, or an equivalent field of study, or equivalent work experience.


  • Senior Data Engineer

    2 weeks ago


    Boulder, Colorado, United States HelloFresh Full time

    About HelloFreshHelloFresh is a leading meal-kit subscription service that aims to revolutionize the way people eat by making it more convenient and exciting to cook meals from scratch. With a global presence and a diverse team, we deliver delicious meals to millions of people worldwide.The RoleAs a Senior Data Engineer within the Global AI department, you...


  • Boulder, Colorado, United States Bayforce Full time

    Job Title: Senior Data EngineerBayforce is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems and workflows.Key Responsibilities:Data Workflow Development: Design and implement efficient, scalable, and...

  • Senior Data Architect

    2 weeks ago


    Boulder, Colorado, United States Bayforce Full time

    About the Role**Job Title:** Senior Data Engineer**Company:** Bayforce**Job Type:** Contract**Duration:** 4 Months (with potential for extensions and conversion to Full-Time Employee)**Location:** Remote (Denver or Boulder, CO options available)**About the Role:This is an exciting opportunity for a seasoned Senior Data Engineer to join Bayforce's team and...


  • Boulder, Colorado, United States IBM Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at IBM Consulting. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that meet the needs of our clients.Key ResponsibilitiesAssemble complex data sets that meet non-functional and functional requirementsIdentify,...


  • Boulder, Colorado, United States IBM Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at IBM Consulting. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that meet the needs of our clients.Key ResponsibilitiesAssemble complex data sets that meet non-functional and functional requirementsIdentify and...

  • Senior Data Architect

    3 weeks ago


    Boulder, Colorado, United States Bayforce Full time

    About the RoleWe are seeking a highly skilled Senior Data Architect to join our team at Bayforce. As a key member of our data engineering team, you will be responsible for designing and implementing efficient, scalable, and reliable data workflows using Databricks, PySpark, and SQL to handle large datasets.Key ResponsibilitiesData Workflow Development:...


  • Boulder, Colorado, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Amazon Marketing Cloud - Ads + AWS Applications team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and systems that support our advertising business.Key ResponsibilitiesDesign and implement data pipelines that extract and...

  • Senior Data Analyst

    1 week ago


    Boulder, Colorado, United States WSP Full time

    About the RoleWe are seeking a highly skilled Senior Consultant, Data Analysis & Engineering to join our Climate Resiliency and Sustainability practice. As a key member of our team, you will support our growing Sustainability, Energy and Climate Change offering by providing data-driven insights and solutions to our clients.Key ResponsibilitiesDevelop and...


  • Boulder, Colorado, United States Amazon Full time

    About the RoleWe are seeking an experienced Data Engineer to join our Amazon Marketing Cloud (AMC) team. As a Data Engineer, you will play a critical role in building and maintaining the infrastructure to answer questions with data, using engineering best practices, data management fundamentals, data storage principles, and operational excellence best...


  • Boulder, Colorado, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Amazon Marketing Cloud - Ads + AWS Applications team. As a Data Engineer, you will play a critical role in building and maintaining our data infrastructure, ensuring the seamless flow of data across our systems.Key ResponsibilitiesDesign and implement data pipelines to extract and...


  • Boulder, Colorado, United States Garmin International Inc Full time

    Job Title: Senior Software EngineerWe are seeking a highly skilled Senior Software Engineer to join our team at Garmin International Inc. in Boulder, CO.Job SummaryThis is a full-time position responsible for architecting, implementing, and testing the Garmin Pay feature. As a Senior Software Engineer, you will be part of a leadership capacity, contributing...


  • Boulder, Colorado, United States Bayforce Full time

    Job DescriptionBayforce is seeking a highly skilled Sr. Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing data workflows, handling complex data environments, and utilizing contemporary data platforms.Key Responsibilities:Data Workflow Development: Design and...


  • Boulder, Colorado, United States Spire Global Full time

    Job SummaryWe are seeking a highly skilled Senior Systems Engineer to join our team at Spire Global. As a key member of our engineering team, you will be responsible for the technical outcome of complex space missions.Key ResponsibilitiesTake overall technical ownership of Spire Space and/or Ground Systems from technical development through on-orbit...


  • Boulder, Colorado, United States Weather Stream Full time

    Job Title: Senior Mechanical EngineerWe are seeking a highly skilled Senior Mechanical Engineer to join our team at Weather Stream. As a key member of our engineering team, you will be responsible for designing and developing precision aerospace electro-mechanical and opto-mechanical flight hardware systems, components, and ground support and test...


  • Boulder, Colorado, United States SciTec Full time

    Job Title: Senior Systems EngineerWe are seeking a highly skilled Senior Systems Engineer to join our team at SciTec, a dynamic small business delivering advanced sensor data processing technologies and scientific instrumentation capabilities in support of National Security and Defense.Job SummaryThe successful candidate will be responsible for developing...


  • Boulder, Colorado, United States Garmin International Inc Full time

    Job Title: Senior Software EngineerWe are seeking a highly skilled Senior Software Engineer to join our team at Garmin International Inc. in Boulder, CO.Job SummaryThe successful candidate will be responsible for designing, implementing, and testing software systems and modules that support new technology or improve capability/performance of existing...


  • Boulder, Colorado, United States Spire Full time

    Job Title: Senior Mechanical EngineerWe are seeking a highly skilled Senior Mechanical Engineer to join our team at Spire Global. As a Senior Mechanical Engineer, you will be responsible for designing and analyzing the mechanical systems and payloads for our next-generation satellites.Key Responsibilities:Design and develop mechanical systems and components...


  • Boulder, Colorado, United States Otter Full time

    Job Title: Senior Software EngineerWe are seeking a highly skilled Senior Software Engineer to join our team at Otter. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable software solutions that meet the needs of our users.Responsibilities:Analyze user needs and develop software solutions that...


  • Boulder, Colorado, United States Spire Global Full time

    Job Title: Senior Electronics EngineerSpire Global is seeking a highly skilled Senior Electronics Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and integrating custom components for our next-generation satellite platform.Key Responsibilities:Design and integrate custom components for our satellite...


  • Boulder, Colorado, United States Google Full time

    About the RoleWe're seeking a highly skilled Senior Cloud Software Engineer to join our team at Google. As a key member of our Technical Infrastructure team, you will play a critical role in designing, developing, and maintaining our cloud infrastructure.As a Senior Cloud Software Engineer, you will be responsible for writing and testing product or system...