Senior Data Engineer

4 days ago

Huntsville, United States SOSi Full time
Overview

SOSi is seeking a Senior Data Engineer to assist the MLOps Team in creating, maintaining, and automating workflows leveraging cutting-edge technologies and supporting a government customer in Huntsville, Alabama. This role will be responsible for delivering automation to key national security missions interacting with petabyte-scale data using High-Performance Computing (HPC) environment. We are hiring for the following locations:

  • Huntsville, AL
  • Washington, DC Region

In this role, you will lead a group of fellow Data Engineers and working with Data Scientists across the organization to construct digital infrastructure necessary to produce and deploy Machine Learning models. You will leverage scientific techniques to iteratively transform petabyte-scale data, construct efficient and effective Extract, Transform, and Load (ETL) pipelines, and refactor manual workflows into containerized-services. You will work with multiple database types including SQL and NoSQL databases, leveraging different storage techniques to maximize efficiency and capability of analytics products. Working on the client-site, you will be embedded with the end-user working to understand their processes and improve upon current standards.

 

The team will work with Open-Source technologies including:

  • Scripting languages such as Python and Go.
  • Databases such as Postgres and Arango DB.
  • Apache products including Apache Airflow, Apache Spark, Apache AGE.
  • Containerization software with Docker, Podman, Kubernetes, and Kubeflow.
  • Configuration management tools like yaml, Github, Gitlab, and FastAPI.
  • Agile tools such as Confluence, Jira, Scrum Methodologies.

SOSi is seeking Senior Data Engineering talent to unlock insights from massive datasets supporting strategic national security objectives. If you have a passion for data and want to apply your skills to impactful projects at scale, we want to hear from you


Essential Job Duties

  • Lead the design, build, and maintenance of ETL processes.
  • Configure storage systems for efficiency and effectiveness.
  • Architect and develop services and extend infrastructure to enable MLOps.
  • Oversee the integration of software components into functional data systems.
  • Write clean, testable, maintainable code in Python and other languages.
  • Create and maintain technical documentation for software systems.
  • Collaborate across teams to share knowledge and leading practices.

Minimum Requirements

  • Secret Security Clearance
  • Significant experience as a Data Engineer or in an advanced analytical role.
  • Extensive experience in data engineering and software development.
  • Expert-level proficiency with Python, GIT, YAML, Docker, and SQL.
  • Deep understanding of CI/CD, DevSecOps, and Agile methodologies.
  • Proven track record of developing back-end systems and services at scale.
  • Strong understanding of software design and system integration.
  • Experience leading and mentoring data engineering teams.

Preferred Qualifications

  • Top Secret Security Clearance with SCI eligibility
  • Experience as a Site Reliability Engineer (SRE).
  • Experience with Cloud-Native Services.
  • Experience with MLOps and/or DevOps.
  • Experience with large-scale data processing.
  • Experience with multi-INT analytics.
  • MS or PhD in Computer Science, Computer Engineering, Statistics, Mathematics, Physics or a quantitative field.

Work Environment

  • Working conditions are normal for an office environment.
  • Fast paced, deadline-oriented environment.
  • May require periods of non-traditional working hours including consecutive nights or weekends (if applicable).
  • Secret Security Clearance
  • Significant experience as a Data Engineer or in an advanced analytical role.
  • Extensive experience in data engineering and software development.
  • Expert-level proficiency with Python, GIT, YAML, Docker, and SQL.
  • Deep understanding of CI/CD, DevSecOps, and Agile methodologies.
  • Proven track record of developing back-end systems and services at scale.
  • Strong understanding of software design and system integration.
  • Experience leading and mentoring data engineering teams.
  • Lead the design, build, and maintenance of ETL processes.
  • Configure storage systems for efficiency and effectiveness.
  • Architect and develop services and extend infrastructure to enable MLOps.
  • Oversee the integration of software components into functional data systems.
  • Write clean, testable, maintainable code in Python and other languages.
  • Create and maintain technical documentation for software systems.
  • Collaborate across teams to share knowledge and leading practices.

  • Senior Data Engineer

    1 week ago

    Huntsville, Alabama, United States Full Visibility Full time

    Job Title: Senior Data EngineerWe are seeking an experienced Senior Data Engineer to work in a dynamic environment. The ideal candidate will have a strong foundation in data warehousing and reporting platform concepts, with the ability to recommend solutions and drive best practices.The Senior Data Engineer will be responsible for developing ETL mappings,...

  • Senior Data Engineer

    3 weeks ago

    Huntsville, United States HRUCKUS Full time

    Veteran-Owned Firm Seeking Senior Data Engineer for an Onsite Assignment in Huntsville, ALMy name is Stephen Hrutka. I manage a Veteran-Owned management consulting firm in Washington, DC, focused on Technical/ Cleared Recruiting for the DoD and IC.HRUCKUS helps other Veteran-Owned businesses recruit for positions across the VA, SBA, HHS, DARPA, and other...

  • Senior Data Engineer

    1 week ago

    Huntsville, United States HRUCKUS LLC Full time

    Veteran-Owned Firm Seeking Senior Data Engineer for an Onsite Assignment in Huntsville, ALMy name is Stephen Hrutka. I manage a Veteran-Owned management consulting firm in Washington, DC, focused on Technical/ Cleared Recruiting for the DoD and IC.HRUCKUS helps other Veteran-Owned businesses recruit for positions across the VA, SBA, HHS, DARPA, and other...

  • Data Engineer

    6 months ago

    Huntsville, United States Booz Allen Hamilton Full time

    Data Engineer The Opportunity:  Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need an experienced...

  • Senior Software Systems Engineer

    1 week ago

    Huntsville, United States Northrop Grumman Full time

    Company OverviewNorthrop Grumman is a pioneering leader in the field of defense and technology. With a rich history of innovation, we have been at the forefront of many groundbreaking advancements. Our culture thrives on intellectual curiosity, cognitive diversity, and inclusivity, making us an exciting place to work.Salary$102,400 - $153,600 per year,...

  • Senior Radar Systems Engineer

    3 days ago

    Huntsville, Alabama, United States CFD Research Corporation Full time

    Job Opportunity for a Senior Radar Systems EngineerEstimated Annual Salary: $120,000 - $160,000About CFD Research CorporationSince its inception in 1987, CFD Research has been a technology leader in engineering simulations and innovative designs. We have worked with government agencies, businesses, and academia to provide innovative solutions within the...

  • Data Engineer

    1 week ago

    Huntsville, United States Amentum Full time

    Your Impact: We are searching for a Top Secret cleared Data Engineer (SME) to join our team in Huntsville, AL. You will be working in an organization that’s mission is to accelerate operations through data and new analytical insights. The entire section leverages SAFe agile and works to provide the entire enterprise with tools and applications to assist...

  • Data Engineer

    3 weeks ago

    Huntsville, United States Yulista Full time

    StraitSys IncRegularPRIMARY FUNCTIONStraitSys is seeking a skilled Data Engineer / SQL Server DBA to manage, optimize, and enhance our SQL Server environments. This role is responsible for designing and maintaining SQL Server Integration Services (SSIS) ETL pipelines and supporting database operations across multiple environments. You will play a key role in...

  • Data Engineer

    4 weeks ago

    Huntsville, United States Yulista Full time

    StraitSys IncRegularPRIMARY FUNCTIONStraitSys is seeking a skilled Data Engineer / SQL Server DBA to manage, optimize, and enhance our SQL Server environments. This role is responsible for designing and maintaining SQL Server Integration Services (SSIS) ETL pipelines and supporting database operations across multiple environments. You will play a key role in...

  • Data Engineer

    1 week ago

    Huntsville, United States Yulista Full time

    StraitSys Inc Regular PRIMARY FUNCTION StraitSys is seeking a skilled Data Engineer / SQL Server DBA to manage, optimize, and enhance our SQL Server environments. This role is responsible for designing and maintaining SQL Server Integration Services (SSIS) ETL pipelines and supporting database operations across multiple environments. You will play a key...

  • Senior Radar Systems Engineer

    6 days ago

    Huntsville, Alabama, United States CFD Research Corporation Full time

    Job Title: Senior Radar Systems EngineerLocation: Huntsville, AL area - 100% onsite.About the JobWe are seeking a skilled Senior Radar Systems Engineer to join our team at CFD Research Corporation. The ideal candidate will have experience in radar analysis, systems engineering, and software development.Key ResponsibilitiesDesign, develop, and execute complex...

  • Senior Control Systems Engineer

    1 week ago

    Huntsville, Alabama, United States Cintel Inc Full time

         Job Title: Senior Control Systems Engineer     Job Summary:We are seeking a highly skilled Senior Control Systems Engineer to join our team at Cintel Inc. As a Senior Control Systems Engineer, you will be responsible for providing technical assistance in support of operating Facility Related Control Systems (FRCS). Your expertise will be...

  • Data Engineer

    4 weeks ago

    Huntsville, United States DealNews Full time

    Job DescriptionJob DescriptionDealNews is looking for a Data Engineer to create and manage BI and analytics solutions that turn data into knowledge.Are you someone who is passionate about building quality, sustainable systems and providing solid, data-driven solutions to problems? To be successful in this job, you must be analytical and accurate, yet...

  • Senior Configuration and Data Management Specialist

    4 weeks ago

    Huntsville, United States Leidos Full time

    Description We are seeking a talented Senior Configuration and Data Management Specialist to join our diverse team working on defense, space, cyber, and commercial projects. The ideal candidate will be responsible for ensuring the correctness and integrity of system, model, and drawing data, as well as implementing Configuration and Data Management processes...

  • Senior Mechanical Engineer

    3 days ago

    Huntsville, United States Applied Technology Solutions Full time

    The Senior Mechanical Engineer will develop innovative designs to challenging engineering problems for a wide variety of applications. The Senior Mechanical Engineer will perform as a task lead on many tasks and as an individual contributor in others. The Senior Mechanical Engineer will develop detailed design criteria from customer requirements and use...

  • Senior Data Scientist

    4 days ago

    Huntsville, Alabama, United States Axient Full time

    Axient's Senior Data Scientist: Data Driven InnovationAs a key member of our analytics team, you will work on developing cutting-edge MLOps workloads leveraging the latest technologies. Our team supports a government customer in Huntsville, Alabama, delivering automation to key national security missions interacting with petabyte-scale data on supercomputing...

  • Senior Electrical Engineer

    4 weeks ago

    Huntsville, United States O. Technical Solutions, LLC Full time

    Electrical Engineering. Integration Engineering.Worst Case Circuit Analysis. Senior Electrical Engineer. Electronic Technician. Site Project Manager. Senior Electrical Engineering.Experience in Worst Case Analysis (WCA) for Circuit Card Assembly (CCA) designs.• Experience with card test requirements and process.• Ability to interpret electrical circuits,...

  • SENIOR ELECTRICAL ENGINEER

    3 weeks ago

    Huntsville, United States BB&E Inc Full time

    Job DescriptionJob DescriptionSenior Electrical Engineer BB&E is a full service civil and environmental engineering and consulting firm, headquartered in Northville, Michigan, which services both the Federal and Industrial sectors throughout the United States. BB&E team members provide Environmental Consulting, Facilities Engineering and Program/Project...

  • Senior Principal Electrical Engineer

    1 week ago

    Huntsville, United States Blue-Halo.org Full time

    BlueHalo is looking for a Senior Principal Electrical Engineer to join the Kinetic Interceptor team. The Senior Principal Electrical Engineering role will work across a broad range of disciplines with an emphasis on product development, analysis and testing, and system integration. Responsibilities include developing and evaluating electrical circuit design...

  • Senior Principal RF Engineer

    1 week ago

    Huntsville, United States Blue-Halo.org Full time

    BlueHalo is looking for a Senior Principal RF Engineer to join the Kinetic Interceptor team. The Senior Principal RF Engineering role will work across a broad range of disciplines with an emphasis on product development, analysis and testing, and system integration. Responsibilities include developing and evaluating RF seeker design efforts, scheduling and...