AI Systems Evaluator
1 week ago
As an AI Systems Evaluator, you will be responsible for assessing the performance, capabilities, and reliability of AI models. Your work will ensure compliance with established standards and protocols.
Key Responsibilities:
- Conduct thorough evaluations of AI systems, implementing structured and scientifically valid assessment methods.
- Analyze existing safeguards within models to determine their effectiveness and reliability.
- Execute red-team operations on AI systems utilizing real-world adversarial strategies to uncover vulnerabilities and potential misuse.
- Innovate and enhance red-teaming and safety evaluation tools, products, and workflows to increase efficiency and scalability.
- Collaborate with cross-functional teams to devise creative solutions to challenges in AI safety.
- Communicate intricate AI concepts clearly to both technical and non-technical stakeholders.
- Contribute to the formulation of technical guidelines and best practices for AI safety.
Qualifications:
- U.S. citizenship is required.
- Males born after must be registered for Selective Service.
- Completion of Confidential Financial Disclosure, Form OGE-450 is mandatory.
- Designated and/or random drug testing is required.
Basic Requirements:
- IT-related experience is essential, which can be demonstrated through paid or unpaid work, or through intensive training such as IT certification.
- Candidates must exhibit proficiency in the following competencies:
1. Attention to Detail: Demonstrates thoroughness and conscientiousness in work.
2. Customer Service: Engages with clients to assess needs and provide quality service.
3. Oral Communication: Effectively conveys information to diverse audiences.
4. Problem Solving: Identifies issues and evaluates information to make sound recommendations.
Specialized Experience:
- For ZP-2210-IV: One year of specialized experience equivalent to the GS-12 level, demonstrating technical understanding of AI generative models and ML algorithms, and experience in evaluating safety and security vulnerabilities.
- For ZP-2210-V: One year of specialized experience equivalent to the GS-14 level, showcasing advanced understanding of AI models, leading cross-functional teams, and planning technical evaluations.
Additional Information:
- This position is part of NIST's Alternative Personnel Management System (APMS), which offers a pay-for-performance structure and various HR flexibilities.
- A trial period may be required, and this appointment can be extended up to four years without further competition.
- The position requires passing a drug test and filing an OGE-450 Confidential Financial Disclosure Report within 30 days of onboarding and annually thereafter.
Work-Life Balance:
NIST promotes a flexible work environment, offering various work-life balance options such as telework, flexible schedules, paid parental leave, and wellness programs.
-
AI Systems Evaluator
2 weeks ago
Washington, Washington, D.C., United States Department Of Commerce Full timePosition OverviewAs an AI Systems Evaluator, you will be responsible for the thorough evaluation and assessment of the functionality, capability, and reliability of AI models. Your work will ensure compliance with established guidelines and contribute to the development of structured and scientifically sound evaluations of AI systems.Key Responsibilities1....
-
AI Systems Evaluator
1 week ago
Washington, Washington, D.C., United States Department Of Commerce Full timePosition Overview:As an AI Systems Evaluator, you will be responsible for assessing the performance, reliability, and security of artificial intelligence models. Your role will involve ensuring compliance with established guidelines and conducting thorough evaluations of AI systems.Key Responsibilities:1. **Evaluation and Assessment**: Conduct structured and...
-
AI Systems Evaluator
2 weeks ago
Washington, Washington, D.C., United States Department Of Commerce Full timePosition Overview:As an AI Systems Evaluator, you will play a crucial role in ensuring the reliability and security of artificial intelligence models. Your responsibilities will include:Duties:1. **Assessment and Evaluation**: Conduct thorough evaluations of AI models to determine their functionality, capability, and reliability, ensuring compliance with...
-
AI Systems Evaluator
2 weeks ago
Washington, Washington, D.C., United States Department Of Commerce Full timePosition OverviewAs an integral member of the Department of Commerce, you will be responsible for assessing the performance, reliability, and security of artificial intelligence models. Your expertise will ensure that these systems adhere to established standards and best practices.Key Responsibilities1. Conduct thorough evaluations of AI models to determine...
-
AI Systems Evaluator
2 weeks ago
Washington, Washington, D.C., United States Department Of Commerce Full timePosition Overview:As an AI Systems Evaluator, you will play a critical role in ensuring the reliability and security of artificial intelligence models. Your responsibilities will include:Duties:Conducting thorough evaluations of AI models to assess their functionality, capabilities, and compliance with established standards.Designing and implementing...
-
Autonomy Systems Specialist, Shield AI
5 days ago
Washington, Washington, D.C., United States Shield AI Full timeAbout Shield AIShield AI is a venture-backed defense technology company that aims to protect service members and civilians with intelligent systems. Founded in 2015, the company is building the world's best AI pilot, Hivemind, which has flown various aircraft, including fighter jets and drones.Job SummaryWe are seeking an experienced Autonomy Engineer to...
-
Senior Software Engineer, Autonomy Systems
1 week ago
Washington, Washington, D.C., United States Shield AI Full timeAbout Shield AIShield AI is a leading defense technology company focused on developing intelligent systems to protect service members and civilians. Our mission is to create cutting-edge technology that meets the evolving needs of the defense industry.Job SummaryWe are seeking an experienced Autonomy Engineer to join our Hivemind Solutions team. As an...
-
AI Systems Engineer
1 week ago
Washington, Washington, D.C., United States ManTech Full timeJoin Our Innovative Team at ManTechManTech is seeking a talented AI Systems Administrator/Tools Engineer III to enhance our operations. This position focuses on the management and upkeep of the organization's artificial intelligence systems, including overseeing installations, configurations, and troubleshooting strategies. Candidates must possess relevant...
-
Lead Analyst in AI and Cloud Systems
1 week ago
Washington, Washington, D.C., United States ManTech Full timeAbout ManTech:Become part of a prominent organization in the technology and national security sector. At ManTech, we emphasize the importance of our workforce and provide engaging projects along with opportunities for professional advancement.Position: Mission Systems (AI/Cloud) Technology Sensing AnalystWork Location: Washington, DC area, Northern Virginia,...
-
AI Safety Specialist
3 days ago
Washington, Washington, D.C., United States Department Of Commerce Full timeAbout the RoleWe are seeking a highly skilled AI Safety Specialist to join our team at the Department of Commerce. As an AI Safety Specialist, you will play a critical role in ensuring the safety and security of AI systems.Key ResponsibilitiesEvaluate and assess the functionality, capability, and trustworthiness of AI models in compliance with relevant...
-
AI Quality Assurance Specialist
2 weeks ago
Washington, Washington, D.C., United States ManTech Full timeJoin Our Mission to Secure the FutureBecome a vital member of a multifaceted team at a leading organization where our workforce is prioritized. At ManTech International Corporation, you will contribute to safeguarding national security while engaging in pioneering projects that provide pathways for career growth.We are looking for a dedicated and skilled AI...
-
Washington, Washington, D.C., United States SRS ManTech SRS Technologies, Inc. Full timeJob SummarySRS ManTech SRS Technologies, Inc. is seeking a highly skilled Artificial Intelligence Test and Evaluation Specialist to join our team. As a key member of our organization, you will be responsible for providing test and evaluation expertise on a wide range of Science and Technology activities and missions.Key ResponsibilitiesProvide test and...
-
Washington, Washington, D.C., United States ST2 ManTech Advanced Systems Intl Full timeSafeguard Our Nation, Ignite Your Future Become a vital part of a diverse team while working at a leading organization in the industry, where our employees are prioritized. At ST2 ManTech Advanced Systems Intl, you will contribute to national security while engaging in innovative projects that provide opportunities for career growth. Currently, we are...
-
Senior Systems Analyst for Mission Technologies
2 weeks ago
Washington, Washington, D.C., United States ST2 ManTech Advanced Systems Intl Full timeSafeguard Our Nation, Empower Your Future Become a vital member of a diverse team within a leading organization, where employee welfare is paramount. At ST2 ManTech Advanced Systems Intl, you will contribute to national security while engaging in groundbreaking projects that provide pathways for career growth. We are currently seeking a dedicated and...
-
Washington, Washington, D.C., United States ST2 ManTech Advanced Systems Intl Full timeSafeguard Our Nation, Fuel Your Future Become a vital part of a diverse workforce while contributing to a leading organization in the industry, where employee welfare is paramount. At ST2 ManTech Advanced Systems Intl, you will play a key role in enhancing national security through innovative projects that provide pathways for career growth. We are...
-
Systems Evaluation Engineer
2 weeks ago
Washington, Washington, D.C., United States Insight Global Full timeJob Title: Systems Test EngineerEmployment Type: Direct HireWork Arrangement: Hybrid model with remote flexibilitySecurity Clearance: Active DoD Secret RequiredCompensation: Salary range of $90,000-$120,000 annuallyEssential Qualifications:Possession of an active DoD Secret clearanceBachelor's degree in a STEM field or a related disciplineA minimum of 3...
-
Systems Evaluation Engineer
2 weeks ago
Washington, Washington, D.C., United States Insight Global Full timeJob Title: Systems Test EngineerEmployment Type: Direct HireWork Arrangement: Hybrid (2-3 days remote each week)Security Clearance: Active DoD Secret RequiredCompensation: Salary Range: $90,000-$120,000 annuallyEssential Qualifications:Possession of an active DoD Secret clearanceBachelor's degree in a STEM field or related disciplineA minimum of 3 years of...
-
AI Engineer
1 week ago
Washington, Washington, D.C., United States Booz Allen Hamilton Full timeAbout the RoleWe are seeking a highly skilled AI Engineer to join our team at Booz Allen Hamilton. As a key member of our organization, you will be responsible for designing and developing cutting-edge artificial intelligence solutions that drive business growth and innovation.Key ResponsibilitiesDesign and develop machine learning models and algorithms to...
-
Senior AI and Machine Learning Engineer
1 week ago
Washington, Washington, D.C., United States Booz Allen Hamilton Full timeAbout the RoleWe are seeking a highly skilled and experienced Artificial Intelligence and Machine Learning Engineer to join our team dedicated to rapidly building, testing, and deploying cutting-edge AI solutions. Our team is looking for a hands-on subject matter expert with all processes related to data, including scraping, cleaning, processing, and...
-
AI Infrastructure Administrator
1 week ago
Washington, Washington, D.C., United States ManTech Full timeBecome a Part of ManTech's Innovative TeamManTech is seeking a talented AI Systems Administrator/Tools Engineer III to enhance our operations. This position is focused on the management and upkeep of our cutting-edge artificial intelligence systems, ensuring efficient installations, configurations, and resolution of technical challenges. Candidates must...
