Senior Data Engineer

2 months ago

Boulder, United States Bayforce Full time

Description

Searching for a Sr. Data engineer who possess strong skills in developing, managing, and optimizing data workflows, handling complex data environments, and utilizing contemporary data platforms. This position requires expertise in Databricks, Airflow, Snowflake, PySpark, Python, and SQL, as well as the capability to design and maintain data ecosystems and operational data systems.


Responsibilities

  • Data Workflow Development: Design and implement efficient, scalable, and reliable data workflows using Databricks, PySpark, and SQL to handle large datasets.
  • Lead Airflow Optimization and Implementation: Lead efforts to set up, maintain, and optimize Airflow, providing the engineering team with guidance on best practices.
  • Environment Setup: Work closely with the environment manager to set up and maintain various environments (development, testing, and production) optimized for both performance and cost.
  • Operational Data Systems: Collaborate on the design and development of operational data systems, ensuring they meet the needs of performance, scalability, and availability.
  • Optimization: Constantly monitor and adjust data processes to optimize resource utilization and minimize delays in data handling.
  • Best Practices: Develop and enforce best practices for coding, testing, documentation, and deployment within the data engineering team.


Requirements

  • 5+ years in data engineering, focusing on managing large-scale environments and building complex data workflows.
  • Databricks: Extensive hands-on experience.
  • Airflow: Strong expertise in job scheduling and automation with Airflow.
  • Snowflake: Deep knowledge of Snowflake as a data warehousing tool.
  • PySpark: Advanced proficiency in PySpark for distributed data operations.
  • Python: Solid Python skills for scripting and building data workflows.
  • SQL: Expert-level SQL for managing and querying data.
  • Environment Management: Proven experience managing cloud-based environments.
  • Operational Data Stores: Experience in creating and managing operational data systems.
  • Bachelor’s degree in Computer Science, Information Systems, or an equivalent field of study, or equivalent work experience.


Preferred Skills:

  • Cloud Platforms: Experience with AWS, Azure, or GCP.
  • Serverless Technologies: Familiarity with designing and implementing serverless solutions.
  • Data Lakes: Hands-on experience with Data Lake/Delta Lake.
  • Event-Driven Pipelines: Experience in designing event-driven data workflows.
  • CI/CD: Knowledge of continuous integration and deployment in a data engineering context.
  • Big Data Tools: Experience with additional tools in the big data space is a plus.

  • Senior Data Engineer

    1 month ago

    Boulder, Colorado, United States Bayforce Full time

    Job Title: Senior Data EngineerBayforce is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data workflows, handling complex data environments, and utilizing contemporary data platforms.Key Responsibilities:Design and...

  • Senior Data Engineer

    3 weeks ago

    Boulder, Colorado, United States HelloFresh Full time

    About HelloFreshHelloFresh is a leading meal-kit subscription service that aims to revolutionize the way people eat by making cooking from scratch more convenient and exciting. With a global presence and a diverse team, we deliver delicious meals to millions of people worldwide.The RoleWe are seeking a highly skilled Senior Data Engineer to join our Global...

  • Senior Data Architect

    2 months ago

    Boulder, Colorado, United States Bayforce Full time

    Job Title: Senior Data EngineerBayforce is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems and workflows.Key Responsibilities:Data Workflow Development: Design and implement efficient, scalable, and...

  • Senior Data Engineer

    2 months ago

    Boulder, United States Bayforce Full time

    Role Title: Senior Data Engineer (Airflow Implementation)Employment Type: ContractDuration: 4 Months (with potential for extensions and conversion to Full-Time Employee)Preferred Location: Denver or Boulder, CO (Remote options available)Role Description:This client is searching for a Sr. Data Engineer who possess strong skills in developing, managing, and...

  • Senior Data Architect

    2 months ago

    Boulder, Colorado, United States Bayforce Full time

    About the Role**Job Title:** Senior Data Engineer**Company:** Bayforce**Job Type:** Contract**Duration:** 4 Months (with potential for extensions and conversion to Full-Time Employee)**Location:** Remote (Denver or Boulder, CO options available)**About the Role:This is an exciting opportunity for a seasoned Senior Data Engineer to join Bayforce's team and...

  • Senior Data Architect

    2 months ago

    Boulder, Colorado, United States Bayforce Full time

    About the RoleWe are seeking a highly skilled Senior Data Architect to join our team at Bayforce. As a key member of our data engineering team, you will be responsible for designing and implementing efficient, scalable, and reliable data workflows using Databricks, PySpark, and SQL to handle large datasets.Key ResponsibilitiesData Workflow Development:...

  • Senior GNC Engineer

    2 weeks ago

    Boulder, Colorado, United States Impulse Space Full time

    Senior Guidance, Navigation, and Control Engineer Job Summary We are seeking a highly skilled Senior Guidance, Navigation, and Control (GNC) Engineer to join our team at Impulse Space. As a key member of our Autonomous Systems department, you will be responsible for designing and developing robust control algorithms for spacecraft, generating control...

  • Senior Data Engineer, Measurement, Ad Tech, and Data Science

    2 weeks ago

    Boulder, Colorado, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Amazon Marketing Cloud (AMC) team. As a Data Engineer, you will play a critical role in building and maintaining the infrastructure to answer questions with data, using engineering best practices, data management fundamentals, data storage principles, and operational excellence best...

  • Data Engineer, Marketing Cloud Specialist

    2 weeks ago

    Boulder, Colorado, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Amazon Marketing Cloud team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and systems that support our advertising business.Key Responsibilities:Design and implement data pipelines to extract and process large datasets...

  • Senior Data Engineer, Measurement, Ad Tech, and Data Science

    3 weeks ago

    Boulder, Colorado, United States Amazon Full time

    About the RoleWe are seeking an experienced Data Engineer to join our Amazon Marketing Cloud (AMC) team. As a Data Engineer, you will play a critical role in building and maintaining the infrastructure to answer questions with data, using engineering best practices, data management fundamentals, data storage principles, and operational excellence best...

  • Senior Systems Engineer

    2 weeks ago

    Boulder, Colorado, United States SciTec Full time

    Job SummaryWe are seeking a highly skilled Senior Systems Engineer to join our team at SciTec. As a Senior Systems Engineer, you will be responsible for developing and implementing systems engineering processes aligned with IEEE 15288. You will also mentor other SciTec staff in systems engineering processes and methodologies, and coordinate between customer...

  • Senior GNC Engineer

    3 weeks ago

    Boulder, Colorado, United States Impulse Space Full time

    Senior Guidance, Navigation, and Control EngineerImpulse Space is seeking a highly skilled Senior Guidance, Navigation, and Control (GNC) Engineer to join our team. As a key member of our Autonomous Systems department, you will be responsible for designing and developing robust control algorithms for spacecraft, including satellite busses in LEO and GEO,...

  • Senior Data Engineer, Measurement, Ad Tech, and Data Science

    3 weeks ago

    Boulder, Colorado, United States Amazon Full time

    About the RoleWe are seeking an experienced Data Engineer to join our Amazon Marketing Cloud (AMC) team. As a Data Engineer, you will play a critical role in building and maintaining the infrastructure to answer questions with data, using engineering best practices, data management fundamentals, data storage principles, and operational excellence best...

  • Senior Data Scientist

    1 month ago

    Boulder, United States Emerson Full time

    Join Emerson for a dynamic, collaborative environment where your skills will be tested and your contributions drive business results. As a Senior Data Scientist, you'll blend traditional data science with a focus on engineered products and industrial goods. Innovate and excel in a dynamic organization committed to continuous improvement. If you would like to...

  • Senior Data Scientist

    2 weeks ago

    Boulder, Colorado, United States Zayo Group Full time

    Senior Data ScientistZayo Group is seeking a highly skilled Senior Data Scientist to join our team. As a key member of our data science team, you will be responsible for developing and delivering predictive and inferential models to improve business performance.Responsibilities:Lead the full model development lifecycle for data science models (ideate,...

  • Senior GNC Engineer

    3 weeks ago

    Boulder, Colorado, United States Impulse Space Full time

    Senior Guidance, Navigation, and Control EngineerImpulse Space is seeking a highly skilled Senior Guidance, Navigation, and Control (GNC) Engineer to join our team. As a key member of our Autonomous Systems department, you will be responsible for designing and developing robust control algorithms for spacecraft, including satellite busses in LEO and GEO,...

  • Data Analytics Senior Research Manager

    1 month ago

    Boulder, Colorado, United States Medtronic Full time

    Job Title: Data Analytics Senior Research ManagerJob Summary:We are seeking a highly skilled Data Analytics Senior Research Manager to join our team at Medtronic. As a key member of our R&D organization, you will be responsible for leading a team of data analysts and researchers to develop clinically meaningful algorithms for oximetry products.Key...

  • Senior GNC Engineer

    2 weeks ago

    Boulder, Colorado, United States Impulse Space Full time

    Job Summary:We are seeking a highly skilled Senior Guidance, Navigation, and Control (GNC) Engineer to join our team at Impulse Space. As a key member of our Autonomous Systems team, you will be responsible for designing and developing robust control algorithms for spacecraft, including satellite busses in LEO and GEO, large upper stages, and...

  • Senior Software Engineer

    2 weeks ago

    Boulder, Colorado, United States Convergent Research Full time

    Job DescriptionWe are seeking a highly skilled Senior Software Engineer to join our team at Convergent Research. As a key member of our software engineering team, you will be responsible for contributing to the architectural design, development, integration, optimization, and testing of our C-Star system.As a Senior Software Engineer, you will work closely...

  • Senior Systems Engineer

    1 week ago

    Boulder, Colorado, United States SciTec Full time

    Job DescriptionSciTec, a dynamic small business, is seeking a talented senior systems engineer to support our programs delivering Next-Generation Missile Warning software. This is a unique opportunity to join a small business delivering core capabilities for National defense. You will work within a fast-paced team delivering end-to-end software processing of...