AI Test Systems Engineer

1 week ago

Fort Belvoir, United States Tulk LLC Full time
Job Overview

Position: Test System Engineer - AI Quality Assurance

Tulk LLC is a prominent consulting firm specializing in technology and management solutions for government entities. Our dedicated team supports Defense and National Security sectors in the acquisition, design, management, and development of cutting-edge technology systems and operational practices to fulfill their missions. We provide a comprehensive benefits package, including health insurance, disability coverage, flexible work arrangements, performance bonuses, access to advanced technology, educational assistance, retirement plans, and more.

We seek candidates with diverse skills and interests to contribute to our mission. At Tulk LLC, we align our team members with projects that best suit their individual expertise and career aspirations. If you are interested in the role outlined below, we invite you to consider advancing your career with Tulk LLC.

As a Senior Test Systems Engineer (US Citizenship Required), you will oversee Application, System, and Integration Testing teams to ensure precise and timely GEOINT for various government agencies. Your primary responsibility will be to provide technical advisory support for AI Research and Development in Test and Evaluation (T&E) Automation and Verification of AI models, while identifying innovative capabilities, tools, and methodologies to keep pace with advancements in AI technology.

Key Responsibilities:

  • Perform diagnostic assessments on AI/ML systems and applications, evaluate performance and efficiency, document findings, and provide recommendations to government stakeholders.
  • Establish and maintain a technical framework for executing system-level integration specifications.
  • Prepare and deliver presentations at conferences, webinars, and online events.
  • Develop methodologies for analyzing and assessing AI-related risks and impacts.
  • Assist government clients in requirements engineering, solutions engineering, scheduling, integration, testing, evaluation, and analysis across various agencies.
  • Advise on solution designs based on requirements and emerging technologies for AI Assurance and Governance.
  • Create descriptive, diagnostic, predictive, and prescriptive insights/algorithms and translate them into development code.
  • Conduct statistical analyses to inform decision-making processes.
  • Implement governance processes for algorithms to ensure adherence to established principles.
  • Document procedures, conduct testing, and monitor performance metrics.
  • Rapidly iterate AI models to enhance accuracy and reliability.
  • Define business processes and acceptance criteria for testing and evaluation.
  • Author test planning documentation, execute test scenarios, and report potential issues.
  • Develop deep learning frameworks, optimize models, and manage real-time streaming data and distributed computing.
  • Create testing procedures for AI model verification and validation, collaborating with cross-functional teams for alignment.
  • Evaluate acceptance criteria for the complete AI model architecture and provide constructive feedback to development teams and government clients.

Required Qualifications:

  • US Citizenship is mandatory.
  • Top Secret SCI (TS/SCI) Security Clearance is required.
  • A Bachelor's degree or higher in Mathematics, Statistics, Computer Vision, Artificial Intelligence, Machine Learning, or a related STEM field, or equivalent expert-level work experience as a Test Systems Engineer.
  • Senior-level experience in scripting, statistics, and computer vision.
  • Over 10 years of experience with tools and technologies such as JMeter, Jenkins, Docker, Postman, Swagger, Nexus, Apigee, GitHub/GitLab, Java, Bash, Curl, XML, JSON, SQL, Python, JavaScript, or AWS/C2S.
  • Strong quantitative and qualitative analysis skills to support AI model assurance.
  • Senior-level experience with traditional, Agile, and DevOps development practices and associated testing strategies.
  • Experience with Test Driven Development using programming languages such as Python, C++, Matlab, R, or Java.
  • Experience in the field of geospatial intelligence.
  • Knowledge of AI Assurance, T&E or V&V-As-a-Service, and Explainable AI (XAI).
  • Experience in quality engineering solutions utilizing Automation, Augmentation, and Artificial Intelligence technologies.
  • Experience in coding and developing tests and evaluations for AI programs.
  • Familiarity with the SAFe framework and Model-Based Systems Engineering.

Preferred Qualifications:

  • Experience with Atlassian products such as Confluence and JIRA.
  • Familiarity with NGA Enterprise solutions, CI/CD pipelines, and DevSecOps.
  • Experience engineering solutions using Cloud-based technologies.
  • Experience with program transitions and technical capabilities.
  • Experience engineering solutions using structured and unstructured Big Data.

Hashtags:

#SeniorSystemsEngineer #TestSystemsEngineer #AIandML #GEOINT #TestandEvaluation #AIAssurance #Automation #Verification #AIModeling #DataAnalysis #DevOps #GeospatialIntelligence #SAFeFramework #CloudTechnologies #BigData #ModelBasedSystemsEngineering #SecurityClearance #USCitizenship #ITJobs #STEMCareers

  • AI Test Systems Engineer

    1 week ago

    Fort Belvoir, United States Tulk LLC Full time

    Job OverviewPosition: Test System Engineer - AI FocusTulk LLC is a premier consulting firm specializing in technology and management advisory services for the Federal Government. Our dedicated team supports Defense and National Security clients in the acquisition, design, management, and development of advanced technological systems and operational practices...

  • Senior AI Test Systems Engineer

    1 week ago

    Fort Belvoir, United States Tulk LLC Full time

    Job OverviewPosition: Senior Test Systems Engineer - AI & AutomationTulk LLC is a premier consulting firm specializing in technology and management solutions for the US Federal Government. Our dedicated team supports Defense and National Security sectors in acquiring, designing, and managing advanced technological systems to enhance their operational...

  • Senior Test Systems Engineer

    4 days ago

    Fort Belvoir, United States Tulk LLC Full time

    Job OverviewTULK LLC is a leading boutique consulting firm providing technology and management consulting services to the US Federal Government. Our expert team assists Defense and National Security clients in acquiring, designing, managing, and developing advanced technology systems and business practices to advance their missions.We are seeking a highly...

  • Test System Engineer for AI

    3 months ago

    Fort Belvoir, United States Tulk LLC Full time

    Job DescriptionJob DescriptionTest System Engineer - QA - Plans Programs & StrategyTULK is a leading boutique consulting firm providing technology and management consulting services to the US Federal Government. Our expert team assists Defense and National Security clients in acquiring, designing, managing, and developing advanced technology systems and...

  • Test System Engineer for AI

    2 months ago

    Fort Belvoir, United States Tulk LLC Full time

    Job DescriptionJob DescriptionTest System Engineer - QA - Plans Programs & StrategyTULK is a leading boutique consulting firm providing technology and management consulting services to the US Federal Government. Our expert team assists Defense and National Security clients in acquiring, designing, managing, and developing advanced technology systems and...

  • Test System Engineer

    2 months ago

    Fort Belvoir, United States Tulk LLC Full time

    Job DescriptionJob DescriptionTest System Engineer - QA - Plans Programs & StrategyTULK is a leading boutique consulting firm providing technology and management consulting services to the US Federal Government. Our expert team assists Defense and National Security clients in acquiring, designing, managing, and developing advanced technology systems and...

  • Test System Engineer

    3 months ago

    Fort Belvoir, United States Tulk LLC Full time

    Job DescriptionJob DescriptionTest System Engineer - QA - Plans Programs & StrategyTULK is a leading boutique consulting firm providing technology and management consulting services to the US Federal Government. Our expert team assists Defense and National Security clients in acquiring, designing, managing, and developing advanced technology systems and...

  • Lead Systems

    3 months ago

    Fort Belvoir, United States Kingfisher Systems, Inc. Full time

    Job DescriptionJob DescriptionLead Systems & Test Engineer Level IIITerminalKingfisher Systems, Inc. (Kingfisher) specializes in providing a full range of Information Technology, Cybersecurity, Intelligence, and support services to the U.S. Government. Kingfisher’s core competency is technology-enabled services with a specific focus on national security....

  • Lead Systems

    3 months ago

    Fort Belvoir, United States Kingfisher Systems, Inc. Full time

    Job DescriptionJob DescriptionLead Systems & Test Engineer Level IIIBasebandKingfisher Systems, Inc. (Kingfisher) specializes in providing a full range of Information Technology, Cybersecurity, Intelligence, and support services to the U.S. Government. Kingfisher’s core competency is technology-enabled services with a specific focus on national security....

  • Senior Test Engineer

    2 months ago

    Fort Belvoir, United States Kaimetrix, L.L.C. Full time

    Job DescriptionJob DescriptionSENIOR TEST ENGINEERROLEKaimetrix is hiring a Senior Test Engineer for a federal client in Fort Belvior, VA.  This role requires a deep understanding of Test and Evaluation (T&E) methodologies, military intelligence operations, and exceptional analytical skills to ensure operational excellence in intelligence missions.We will...

  • Senior Test Engineer

    2 months ago

    Fort Belvoir, United States Kaimetrix, L.L.C. Full time

    Job DescriptionJob DescriptionSENIOR TEST ENGINEERROLEKaimetrix is hiring a Senior Test Engineer for a federal client in Fort Belvior, VA.  This role requires a deep understanding of Test and Evaluation (T&E) methodologies, military intelligence operations, and exceptional analytical skills to ensure operational excellence in intelligence missions.We will...

  • Principle Systems Test Engineer

    3 weeks ago

    Fort Wayne, Indiana, United States BAE Systems Full time

    Job Description BAE Systems is seeking a Principal Systems Test Engineer in Fort Wayne. The BAE Systems Integrated Communications Solutions business is the primary source of VHF/UHF SATCOM Tactical Radio (TR) equipment to the Army and USAF. This team, based at Fort Wayne, is responsible for the Architecture, Specification, Development and Analysis of Mission...

  • Lead Systems Testing Engineer

    2 weeks ago

    Fort Wayne, Indiana, United States BAE Systems, plc Full time

    Position OverviewBAE Systems is on the lookout for a Principal Systems Test Engineer to enhance our team. This role is crucial in ensuring the reliability and performance of our advanced communication systems.Key ResponsibilitiesConduct comprehensive testing of VHF/UHF SATCOM Tactical Radio systems.Collaborate with cross-functional teams to define testing...

  • Lead Systems Testing Engineer

    2 weeks ago

    Fort Wayne, Indiana, United States BAE Systems, plc Full time

    Position OverviewBAE Systems is on the lookout for a Principal Systems Test Engineer to enhance our team.About the RoleThe Integrated Communications Solutions division at BAE Systems serves as a key provider of VHF/UHF SATCOM Tactical Radio (TR) systems for military applications.Key ResponsibilitiesConduct comprehensive testing of systems to ensure optimal...

  • Systems Engineer Baseband

    2 months ago

    Fort Belvoir, United States Kingfisher Systems, Inc. Full time

    Job DescriptionJob DescriptionBaseband Systems Engineer Work starting January 2025Kingfisher Systems, Inc. (Kingfisher) specializes in providing a full range of Information Technology, Cybersecurity, Intelligence, and support services to the U.S. Government. Kingfisher’s core competency is technology-enabled services with a specific focus on national...

  • Systems Engineering Specialist

    1 week ago

    Fort Belvoir, Virginia, United States ST2 ManTech Advanced Systems Intl Full time

    Overview:We are looking for a dedicated Systems Engineer to contribute to our innovative projects at ST2 ManTech Advanced Systems Intl. The successful candidate will play a crucial role in system analysis, modeling, simulation, and conducting technical evaluations.Key Responsibilities:Optimize system requirements for enhanced performanceCreate comprehensive...

  • Systems Engineering Specialist

    2 weeks ago

    Fort Belvoir, Virginia, United States ST2 ManTech Advanced Systems Intl Full time

    Opportunity for a Systems Engineering Specialist at ST2 ManTech Advanced Systems IntlWe are in search of a dedicated professional to engage in system evaluations, modeling, simulation, and comprehensive technical assessments. The successful applicant will possess a Bachelor's degree in a relevant STEM discipline, hold a DoD m IAT Level II certification, and...

  • Systems Engineering Specialist

    2 weeks ago

    Fort Belvoir, Virginia, United States ST2 ManTech Advanced Systems Intl Full time

    Position Overview:We are in search of a dedicated Systems Engineer to contribute to our innovative projects at ST2 ManTech Advanced Systems Intl. The successful candidate will engage in system analysis, modeling, simulation, and technical evaluations. A Bachelor's degree in a relevant STEM discipline, along with DoD m IAT Level II certification, is...

  • Systems Engineer

    2 months ago

    Fort Belvoir, United States Tulk LLC Full time

    Job DescriptionJob DescriptionSystems Engineer - MavenTULK is a leading boutique consulting firm providing technology and management consulting services to the US Federal Government. Our expert team assists Defense and National Security clients in acquiring, designing, managing, and developing advanced technology systems and business practices to advance...

  • Information Assurance Engineer

    2 weeks ago

    Fort Huachuca, United States Empower AI Full time

    Information Assurance EngineerJob ID 2023-7488Job LocationsUS-AZ-Fort HuachucaCategory IT: Information Assurance / Quality / Cyber SecurityType Regular Full-TimeOverviewEmpower AI is AI for government. Empower AI gives federal agency leaders the tools to elevate the potential of their workforce with a direct path for meaningful transformation....