High-Performance Data Architect

3 weeks ago


Boulder, Colorado, United States SciTec Full time
Job Overview:

We are seeking a highly skilled Data Engineer to join our team at SciTec, a dynamic small business with a mission to deliver advanced sensor data processing technologies and scientific instrumentation capabilities in support of National Security and Defense.

As a member of our Mission Data Processing program, you will design, build, and maintain scalable ETL pipelines for processing terabyte-scale streaming data and architect databases optimized for machine learning on on-premises hardware using open-source software. You should have expertise in data design patterns such as the Medallion Architecture and data lakehouse technologies to ensure efficient and reliable data processing. Additionally, you will bring DevOps expertise for pipeline automation, Infrastructure as Code (IaC) skills with tools like Terraform and Ansible, and a strong understanding of DevSecOps practices for maintaining secure and compliant data workflows.

Key Responsibilities:
  • Design and optimize ETL pipelines capable of handling high-throughput, low-latency data ingestion, especially during large data bursts
  • Implement robust asynchronous processing systems using ZeroMQ to handle large, serialized Protobuf messages
  • Create systems that efficiently process sudden, large volumes of data while maintaining performance
  • Design strategies for managing backpressure to prevent system overload during high data volumes
  • Develop fault-tolerant systems to safeguard data integrity and maintain reliability
  • Set up monitoring and alerting mechanisms for proactive response to sudden data load changes
  • Build and sustain high-performance databases on on-premises infrastructure, leveraging MinIO or similar object storage solutions for seamless integration with ML workflows
  • Apply and manage data design patterns such as the Medallion Architecture to organize data into Bronze, Silver, and Gold layers
  • Deploy Delta Lake solutions to combine the flexibility of data lakes with data warehouse performance
  • Implement containerization and orchestration solutions using Docker and Kubernetes, and build CI/CD pipelines for automated ETL workflows
  • Implement infrastructure provisioning and deployment automation using Terraform and/or Ansible
  • Uphold data governance and security protocols to ensure data integrity and compliance with DoD standards, including vulnerability scans and secure configurations
  • Lead the evaluation and adoption of open-source technologies that enhance data engineering capabilities
  • Work with subcontractors and DoD organizations across sites, accommodating hardware limitations and ensuring seamless integration
  • Maintain comprehensive documentation and train teams on best practices and tools in data engineering
  • Lead and provide guidance to developers and engineers on architecture, design, and testing decisions
  • Provides thought-leadership and subject matter expertise for data engineering and data pipeline orchestration across the company
  • Regularly communicate with customers, present status, and engage in program-level meetings and processes
Requirements and Qualifications:
  • Minimum 8 years of experience building and maintaining data pipelines/ETL solutions at scale
  • Proficiency in Python, C++, SQL, and RDBMS (PostgreSQL or similar)
  • Experience with object storage (e.g., MinIO), Protocol Buffers, and ZeroMQ
  • Familiarity with Data Version Control (DVC), Delta Lake, and the Medallion Architecture
  • Skilled in Docker, Kubernetes, CI/CD pipelines, and infrastructure automation (Terraform/Ansible)
  • Experience with high-throughput, low-latency systems, fault tolerance, and backpressure handling
  • Knowledge of data governance, versioning, auditing, rollback, and DevSecOps practices.
  • Active DoD Secret Clearance
  • Detail Oriented
  • Good verbal and written communication skills
Benefits Package:
  • Competitive salary ($141,000-$202,000/year) based on qualifications and experience
  • 3% Fully Vested Company 401K Contribution
  • 100% company-paid HSA Medical insurance, with a choice of 2 buy-up options
  • 80% company-paid Dental insurance
  • 100% company-paid Vision insurance
  • 100% company-paid Life insurance
  • 100% company-paid Long-term Disability insurance
  • Short-term Disability insurance
  • Annual Profit-Sharing Plan
  • Discretionary Performance Bonus
  • Paid Parental Leave
  • Generous Paid Time Off, including Holiday, Vacation, and Sick Pay
  • Flexible Work Hours


  • Boulder, Colorado, United States Automox Full time

    Job Title: Data ArchitectLocation: Remote (US)Salary Range: $180,000 - $250,000 per yearAbout Us: Automox is a rapidly growing, venture-backed SaaS company reinventing IT Operations with our cloud-native platform. Our platform processes tens of thousands of events per second, helping enterprises monitor, manage, and optimize their IT infrastructure in real...


  • Boulder, Colorado, United States SciTec Full time

    We have an immediate opening for a skilled High-Performance C++ Programmer to join our dynamic team at SciTec, Inc.As a member of our agile development team, you will collaborate with experts in image analysis, low-latency data processing, detection, and tracking algorithms for remote sensing systems to deliver Next-Generation Missile Warning software.Your...


  • Boulder, Colorado, United States SciTec Full time

    Sicitacorp is looking for an experienced Senior Data Engineer to lead the development of high-throughput systems for processing large datasets.In this role, you will design, implement, and maintain scalable ETL pipelines using Python, C++, SQL, and RDBMS, with a focus on high-performance databases on on-premises infrastructure.The ideal candidate will have...

  • Data Architect

    4 weeks ago


    Boulder, Colorado, United States Spire Full time

    Company OverviewSpire Global is a space-to-cloud analytics company that owns and operates the largest multi-purpose constellation of satellites. Its proprietary data and algorithms provide advanced maritime, aviation, and weather tracking worldwide.Job DescriptionThe Data Platform team at Spire is responsible for ingesting tens of thousands of events per...


  • Boulder, Colorado, United States SciTec Full time

    We are seeking a skilled C++ software engineer to join our team in supporting our programs delivering Next-Generation Missile Warning software. This role requires a talented individual who can work within a fast-paced team delivering end-to-end software processing of Overhead Persistent InfraRed (OPIR) sensor data for Missile Warning, Missile Defense,...


  • Boulder, Colorado, United States APR Consulting Full time

    Aerospace engineering requires the integration of advanced technologies to develop and implement complex systems. As an Algorithm and Systems Engineer, you will work with a team to design and analyze algorithms for state estimation and backend processes.This position is located in Boulder, CO and involves developing extendable and reusable algorithms to...


  • Boulder, Colorado, United States A2C Full time

    We are seeking an ERP Architect for Finance and Operations to join our A2C team. This role involves designing and implementing D365 F&O solutions that optimize financial processes, support operational efficiency, and align with the company's overall business strategy.The ideal candidate will have strong knowledge of the construction and engineering...

  • Senior Data Architect

    2 weeks ago


    Boulder, Colorado, United States Amazon Full time

    About the RoleWe are seeking an experienced Data Engineer to join our Amazon Marketing Cloud (AMC) team. The successful candidate will be responsible for designing, building, and maintaining large-scale data solutions and services using native AWS services.This is a unique opportunity to work on a greenfield product initiative that spans across multiple...


  • Boulder, Colorado, United States Spire Full time

    About UsSpire Global is a space-to-cloud analytics company that owns and operates the largest multi-purpose constellation of satellites.We provide advanced maritime, aviation, and weather tracking in the world. Our data infrastructure includes a global ground station network and 24/7 operations that provide real-time global coverage of every point on Earth.

  • Architect Design Lead

    2 weeks ago


    Boulder, Colorado, United States Cooper Carry, Inc Full time

    Job SummaryWe are seeking an experienced Project Architect to join our team as a Senior Design Lead. The successful candidate will have a strong track record of delivering high-quality projects on time and within budget.The estimated annual salary for this role is $95,000 - $115,000, based on industry standards and the candidate's experience.


  • Boulder, Colorado, United States Automox Technologies Full time

    A Career Defining OpportunityAchieve your full potential as a Chief Architect at Automox Technologies. Our revolutionary cloud-native platform is changing the game for endpoint security, and we need your expertise to take it to the next level.About AutomoxWe're a fast-growing company that's passionate about innovation and customer satisfaction. Our...


  • Boulder, Colorado, United States Mj3 Partners, Inc. Full time

    Welcome to Mj3 Partners, Inc., a leading developer of high-performance products.We are currently seeking a talented Embedded System Engineer to join our team.This role offers an exciting opportunity to design and develop active RF systems for our cutting-edge products.As an Embedded System Engineer, you will be responsible for:Architecting, developing and...


  • Boulder, Colorado, United States Cooper Carry, Inc Full time

    About the JobCooper Carry, Inc. is seeking a Senior Design Architect to join our team. As a key member of our design department, you will play a crucial role in developing creative designs that meet client expectations.The ideal candidate will have a strong understanding of building systems, excellent communication skills, and experience in software such as...


  • Boulder, Colorado, United States A2C Full time

    We are seeking an experienced Financial Systems Architect to join our team at A2C. This role involves designing and implementing Microsoft Dynamics 365 Finance and Operations solutions that optimize financial processes, support operational efficiency, and align with our company's overall business strategy.Key Responsibilities:Solution Design: Lead the...


  • Boulder, Colorado, United States SciTec Full time

    Job OverviewSciTec is a dynamic small business with the mission to deliver advanced sensor data processing technologies and scientific instrumentation capabilities in support of National Security and Defense.Salary and BenefitsWe offer a highly competitive salary package, including a $137,000- $194,000 / year salary range. Additionally, we provide:Employee...


  • Boulder, Colorado, United States SciTec Full time

    Company OverviewSciTec, Inc. is a dynamic small business that specializes in delivering advanced sensor data processing technologies and scientific instrumentation capabilities to support National Security and Defense.

  • Data Analyst

    3 weeks ago


    Boulder, Colorado, United States Electra Full time

    Electra's Mission:Electra is revolutionizing the iron production industry to tackle nearly 10% of global carbon dioxide emissions. Its patented process uses chemistry and renewable energy to transform various grades of iron ore into environmentally responsible pure iron at scale.About the Role:The 2025 Summer Internship Program is open to current...


  • Boulder, Colorado, United States Professional Employment Group of Colorado Full time

    Job Description:We are seeking an experienced Senior Network Engineer to join our team at Professional Employment Group of Colorado. The successful candidate will be responsible for designing, installing, configuring, maintaining, evaluating, and repairing the network infrastructure and application components to ensure network performance meets company and...


  • Boulder, Colorado, United States Spire Full time

    About the RoleSpire is seeking a seasoned Cloud-Native Data Engineer to join our Weather Product Data Engineering team. As a key member of this team, you will play a crucial role in taking our product pipeline, APIs, and other product delivery infrastructure to the next level.Key Responsibilities:Design, implement, maintain, and document web services and...


  • Boulder, Colorado, United States AllJobs Full time

    About the Role:We are looking for a detail-oriented Data Entry Operator to join our team at AllJobs. As a Data Entry Operator, you will be responsible for accurately and efficiently entering data into computer systems.Responsibilities:Enter data into computer systemsVerify accuracy of entered dataMaintain a business-like production...