Current jobs related to AI Systems Evaluator - Washington, Washington, D.C. - Department Of Commerce


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Principal Engineer, AI SystemsShield AI is a venture-backed defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Principal Engineer to join our team and contribute to the development of our AI systems.Job Summary:We are looking for a talented Principal Engineer to...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Staff Software EngineerShield AI is a venture-backed defense technology company that is building the world's best AI pilot. We are seeking a highly skilled Staff Software Engineer to join our Planning and Controls (PAC) team.About Shield AIShield AI is a company that is passionate about protecting service members and civilians with intelligent...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Staff Software EngineerShield AI is a venture-backed defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Staff Software Engineer to join our Planning and Controls (PAC) team.About the Role:Design and implement state-of-the-art planning algorithms, taking ideas from...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job SummaryShield AI is seeking a highly skilled Product Lifecycle Management (PLM) Systems Administrator to ensure our continued leadership in the development of applied artificial intelligence. This role encompasses managing the production, development, and test environments of Shield AI's PLM infrastructure and applications, including but not limited to...

  • AI Technical Lead

    4 days ago


    Washington, Washington, D.C., United States Integrity Defense Solutions Inc Full time

    Job DescriptionThis is a unique opportunity to join Integrity Defense Solutions Inc. as an AI Technical Lead. The successful candidate will be responsible for architecting, designing, and developing AI systems and solutions to support mission requirements.Key Responsibilities:Assist clients and other team members to identify, evaluate, develop, and utilize...

  • AI Technical Lead

    1 week ago


    Washington, Washington, D.C., United States Integrity Defense Solutions Inc Full time

    Job Summary:Integrity Defense Solutions Inc is seeking an experienced AI Technical Lead to join our team. As a key member of our AI line of business, you will be responsible for architecting, designing, and developing AI solutions to support mission requirements. Key Responsibilities:* Assist client and other IDS team members to identify, evaluate, develop...


  • Washington, Washington, D.C., United States BigBear Inc Full time

    Job SummaryWe are seeking a highly skilled AI-Powered Systems Administrator to join our team at BigBear Inc. The ideal candidate will have a strong background in cloud infrastructure, cybersecurity, and AI-powered decision intelligence solutions.Key ResponsibilitiesMaintain a CI/CD pipeline with JenkinsDeploy containers in Kubernetes/OpenShift...


  • Washington, Washington, D.C., United States Pixalate Full time

    Pixalate's AI VisionPixalate is a leading fraud protection, privacy, and compliance analytics platform for Connected TV (CTV) and Mobile Advertising. We provide cutting-edge SaaS technology solutions, data, and research to identify, quantity, and mitigate ad fraud and data privacy compliance risks in digital advertising.Our Research team (AFAC) has uncovered...

  • AI Trainer

    2 weeks ago


    Washington, Washington, D.C., United States Mansai Corporation Full time

    Job SummaryMansai Corporation is seeking a highly skilled AI Trainer to join our team. As an AI Trainer, you will be responsible for teaching Copilot 365 and other generative AI to Fund staff. Your role involves developing training materials, lesson plans, and collaborating with champions and representatives from various groups to ensure widespread adoption...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Description:Shield AI is seeking a highly motivated and innovative intern to join our team as a Flight Systems Integration Engineering Intern. As a member of our team, you will have the opportunity to work on cutting-edge AI autopilot development projects and contribute to the creation of intelligent systems that can make a positive impact.The ideal...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Information Systems Security ManagerShield AI is seeking an experienced Information Systems Security Manager (ISSM) to lead cybersecurity efforts within critical Government Programs. As an ISSM, you will play a key role in ensuring the security and compliance of our classified information systems.Key Responsibilities:Lead the implementation of...


  • Washington, Washington, D.C., United States Shield AI Full time

    Shield AI is seeking a highly experienced Senior Systems Engineering Manager to lead our Systems Engineering function. As a key member of our team, you will be responsible for defining, coordinating, and communicating important information and artifacts pertaining to Systems Engineering outputs.In this role, you will collaborate closely with software teams,...


  • Washington, Washington, D.C., United States Shield AI Full time

    Introduction to Shield AIShield AI is a venture-backed defense technology company whose mission is to protect service members and civilians with intelligent systems. As an Autonomy Engineer, you will be responsible for integrating the Shield AI reference pilot onto various aerial platforms. You will develop and tailor autonomous behaviors to fit the customer...

  • AI Security Engineer

    3 weeks ago


    Washington, Washington, D.C., United States The MITRE Corporation Full time

    Job Title: AI Security EngineerAt The MITRE Corporation, we're committed to tackling our nation's toughest challenges while fostering a fulfilling work-life balance. As an AI Security Engineer, you'll be part of a diverse team passionate about harnessing trustworthy and assured artificial intelligence to drive meaningful impact.Job SummaryWe're seeking a...


  • Washington, Washington, D.C., United States Empower Ai Inc. Full time

    Job SummaryEmpower AI Inc. is seeking a highly skilled Senior Network Engineer to lead the development and maintenance of network communications. The ideal candidate will possess expert knowledge of LAN/WAN systems and be able to design and install internal and external networks.Key ResponsibilitiesLead the development and maintenance of network...


  • Washington, Washington, D.C., United States Gunnison Consulting Group Inc Full time

    Job Title: AI/ML Solution ArchitectWe are seeking a highly skilled AI/ML Solution Architect to join our team at Gunnison Consulting Group Inc. As a key member of our team, you will be responsible for designing and developing advanced AI and machine learning solutions for our federal government clients.Key Responsibilities:Collaborate with cross-functional...


  • Washington, Washington, D.C., United States Shield AI Full time

    Job DescriptionShield AI is a defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Staff Software Engineer to join our Planning and Controls (PAC) team.Key ResponsibilitiesDesign and implement state-of-the-art planning algorithms for our AI pilot, HivemindOptimize the planning...


  • Washington, Washington, D.C., United States ST2 ManTech Advanced Systems Intl Full time

    Secure Our Nation, Ignite Your FutureAt ST2 ManTech Advanced Systems Intl, we're seeking a highly motivated and experienced Mission Systems Technology Sensing Analyst to join our team in the DMV area. As a key member of our team, you'll play a critical role in supporting our Cyber Innovation Lead in collecting and distributing knowledge for the team in AI/ML...


  • Washington, Washington, D.C., United States Shield AI Full time

    Shield AI is seeking a visionary leader to spearhead its cybersecurity efforts. As the Chief Information Security Officer, you will be responsible for developing and implementing a comprehensive security strategy that aligns with the company's business objectives.Key Responsibilities:Strategic Leadership: Lead and manage a high-performing cybersecurity team,...


  • Washington, Washington, D.C., United States Valiant Harbor International, LLC Full time

    Job Title: AI/ML Technical SETAValiant Harbor International, LLC is seeking a highly skilled AI/ML Technical SETA to support the Advanced Research Projects Agency for Health (ARPA-H) activities.The successful candidate will play a crucial role in the planning, coordination, and execution of related activities within the Resilient Systems Office (RSO).The...

AI Systems Evaluator

2 months ago


Washington, Washington, D.C., United States Department Of Commerce Full time
Position Overview
As an integral member of the Department of Commerce, you will be responsible for assessing the performance, reliability, and security of artificial intelligence models. Your expertise will ensure that these systems adhere to established standards and best practices.

Key Responsibilities
1. Conduct thorough evaluations of AI models to determine their functionality and compliance with safety protocols.
2. Design and implement structured assessments that are scientifically robust, ensuring the integrity of AI systems.
3. Perform red-team operations utilizing real-world adversarial strategies to uncover vulnerabilities and potential misuse of AI technologies.
4. Develop and refine innovative software tools and workflows aimed at enhancing the evaluation process of AI systems.
5. Collaborate with cross-functional teams to devise creative solutions addressing AI safety challenges.
6. Communicate complex AI concepts effectively to both technical and non-technical stakeholders.
7. Contribute to the formulation of technical guidelines and best practices in AI safety.

Qualifications
To qualify for this position, candidates must possess:
- U.S. citizenship and suitability for Federal employment.
- Relevant IT experience, demonstrated through paid or unpaid roles, or completion of intensive training (e.g., IT certification).

Core Competencies
1. Attention to Detail: Demonstrates thoroughness and conscientiousness in work.
2. Customer Service: Engages with clients to assess needs and provide quality solutions.
3. Oral Communication: Effectively conveys information to diverse audiences.
4. Problem Solving: Identifies issues and evaluates information to propose sound recommendations.

Experience Requirements
For ZP-2210-IV level, one year of specialized experience equivalent to GS-12 is required, focusing on AI generative models and machine learning algorithms. For ZP-2210-V level, candidates must have one year of specialized experience equivalent to GS-14, demonstrating advanced understanding and leadership in AI-related projects.

Work Environment
The Department of Commerce fosters a flexible and supportive work environment, offering various work-life balance options such as telework, flexible schedules, and wellness programs. As a federal employee, you will have access to a comprehensive benefits package designed to enhance your career experience.