Current jobs related to AI Systems Evaluator - Washington, Washington, D.C. - Department Of Commerce

  • Principal Software Engineer, AI Systems

    2 weeks ago

    Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Principal Engineer, AI SystemsShield AI is a venture-backed defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Principal Engineer to join our team and contribute to the development of our AI systems.Job Summary:We are looking for a talented Principal Engineer to...

  • Staff Software Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Staff Software EngineerShield AI is a venture-backed defense technology company that is building the world's best AI pilot. We are seeking a highly skilled Staff Software Engineer to join our Planning and Controls (PAC) team.About Shield AIShield AI is a company that is passionate about protecting service members and civilians with intelligent...

  • Staff Software Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Staff Software EngineerShield AI is a venture-backed defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Staff Software Engineer to join our Planning and Controls (PAC) team.About the Role:Design and implement state-of-the-art planning algorithms, taking ideas from...

  • PLM Systems Administrator

    7 days ago

    Washington, Washington, D.C., United States Shield AI Full time

    Job SummaryShield AI is seeking a highly skilled Product Lifecycle Management (PLM) Systems Administrator to ensure our continued leadership in the development of applied artificial intelligence. This role encompasses managing the production, development, and test environments of Shield AI's PLM infrastructure and applications, including but not limited to...

  • AI Technical Lead

    4 days ago

    Washington, Washington, D.C., United States Integrity Defense Solutions Inc Full time

    Job DescriptionThis is a unique opportunity to join Integrity Defense Solutions Inc. as an AI Technical Lead. The successful candidate will be responsible for architecting, designing, and developing AI systems and solutions to support mission requirements.Key Responsibilities:Assist clients and other team members to identify, evaluate, develop, and utilize...

  • AI Technical Lead

    1 week ago

    Washington, Washington, D.C., United States Integrity Defense Solutions Inc Full time

    Job Summary:Integrity Defense Solutions Inc is seeking an experienced AI Technical Lead to join our team. As a key member of our AI line of business, you will be responsible for architecting, designing, and developing AI solutions to support mission requirements. Key Responsibilities:* Assist client and other IDS team members to identify, evaluate, develop...

  • AI-Powered Systems Administrator

    1 week ago

    Washington, Washington, D.C., United States BigBear Inc Full time

    Job SummaryWe are seeking a highly skilled AI-Powered Systems Administrator to join our team at BigBear Inc. The ideal candidate will have a strong background in cloud infrastructure, cybersecurity, and AI-powered decision intelligence solutions.Key ResponsibilitiesMaintain a CI/CD pipeline with JenkinsDeploy containers in Kubernetes/OpenShift...

  • Machine Learning Engineer

    2 weeks ago

    Washington, Washington, D.C., United States Pixalate Full time

    Pixalate's AI VisionPixalate is a leading fraud protection, privacy, and compliance analytics platform for Connected TV (CTV) and Mobile Advertising. We provide cutting-edge SaaS technology solutions, data, and research to identify, quantity, and mitigate ad fraud and data privacy compliance risks in digital advertising.Our Research team (AFAC) has uncovered...

  • AI Trainer

    2 weeks ago

    Washington, Washington, D.C., United States Mansai Corporation Full time

    Job SummaryMansai Corporation is seeking a highly skilled AI Trainer to join our team. As an AI Trainer, you will be responsible for teaching Copilot 365 and other generative AI to Fund staff. Your role involves developing training materials, lesson plans, and collaborating with champions and representatives from various groups to ensure widespread adoption...

  • Flight Systems Integration Engineering Internship Opportunity

    1 week ago

    Washington, Washington, D.C., United States Shield AI Full time

    Job Description:Shield AI is seeking a highly motivated and innovative intern to join our team as a Flight Systems Integration Engineering Intern. As a member of our team, you will have the opportunity to work on cutting-edge AI autopilot development projects and contribute to the creation of intelligent systems that can make a positive impact.The ideal...

  • Information Systems Security Manager

    4 weeks ago

    Washington, Washington, D.C., United States Shield AI Full time

    Job Title: Information Systems Security ManagerShield AI is seeking an experienced Information Systems Security Manager (ISSM) to lead cybersecurity efforts within critical Government Programs. As an ISSM, you will play a key role in ensuring the security and compliance of our classified information systems.Key Responsibilities:Lead the implementation of...

  • Senior Systems Engineering Manager

    1 week ago

    Washington, Washington, D.C., United States Shield AI Full time

    Shield AI is seeking a highly experienced Senior Systems Engineering Manager to lead our Systems Engineering function. As a key member of our team, you will be responsible for defining, coordinating, and communicating important information and artifacts pertaining to Systems Engineering outputs.In this role, you will collaborate closely with software teams,...

  • Senior Software Engineer for Autonomy Solutions

    4 days ago

    Washington, Washington, D.C., United States Shield AI Full time

    Introduction to Shield AIShield AI is a venture-backed defense technology company whose mission is to protect service members and civilians with intelligent systems. As an Autonomy Engineer, you will be responsible for integrating the Shield AI reference pilot onto various aerial platforms. You will develop and tailor autonomous behaviors to fit the customer...

  • AI Security Engineer

    3 weeks ago

    Washington, Washington, D.C., United States The MITRE Corporation Full time

    Job Title: AI Security EngineerAt The MITRE Corporation, we're committed to tackling our nation's toughest challenges while fostering a fulfilling work-life balance. As an AI Security Engineer, you'll be part of a diverse team passionate about harnessing trustworthy and assured artificial intelligence to drive meaningful impact.Job SummaryWe're seeking a...

  • Senior Network Architect

    1 week ago

    Washington, Washington, D.C., United States Empower Ai Inc. Full time

    Job SummaryEmpower AI Inc. is seeking a highly skilled Senior Network Engineer to lead the development and maintenance of network communications. The ideal candidate will possess expert knowledge of LAN/WAN systems and be able to design and install internal and external networks.Key ResponsibilitiesLead the development and maintenance of network...

  • AI/ML Solution Architect

    2 weeks ago

    Washington, Washington, D.C., United States Gunnison Consulting Group Inc Full time

    Job Title: AI/ML Solution ArchitectWe are seeking a highly skilled AI/ML Solution Architect to join our team at Gunnison Consulting Group Inc. As a key member of our team, you will be responsible for designing and developing advanced AI and machine learning solutions for our federal government clients.Key Responsibilities:Collaborate with cross-functional...

  • Staff Software Engineer, Task Group Specialist

    1 week ago

    Washington, Washington, D.C., United States Shield AI Full time

    Job DescriptionShield AI is a defense technology company that aims to protect service members and civilians with intelligent systems. We are seeking a highly skilled Staff Software Engineer to join our Planning and Controls (PAC) team.Key ResponsibilitiesDesign and implement state-of-the-art planning algorithms for our AI pilot, HivemindOptimize the planning...

  • Senior Mission Systems Specialist

    2 weeks ago

    Washington, Washington, D.C., United States ST2 ManTech Advanced Systems Intl Full time

    Secure Our Nation, Ignite Your FutureAt ST2 ManTech Advanced Systems Intl, we're seeking a highly motivated and experienced Mission Systems Technology Sensing Analyst to join our team in the DMV area. As a key member of our team, you'll play a critical role in supporting our Cyber Innovation Lead in collecting and distributing knowledge for the team in AI/ML...

  • Chief Information Security Officer

    3 days ago

    Washington, Washington, D.C., United States Shield AI Full time

    Shield AI is seeking a visionary leader to spearhead its cybersecurity efforts. As the Chief Information Security Officer, you will be responsible for developing and implementing a comprehensive security strategy that aligns with the company's business objectives.Key Responsibilities:Strategic Leadership: Lead and manage a high-performing cybersecurity team,...

  • AI/ML Technical SETA Specialist

    1 week ago

    Washington, Washington, D.C., United States Valiant Harbor International, LLC Full time

    Job Title: AI/ML Technical SETAValiant Harbor International, LLC is seeking a highly skilled AI/ML Technical SETA to support the Advanced Research Projects Agency for Health (ARPA-H) activities.The successful candidate will play a crucial role in the planning, coordination, and execution of related activities within the Resilient Systems Office (RSO).The...

AI Systems Evaluator

2 months ago

Washington, Washington, D.C., United States Department Of Commerce Full time
Position Overview:
As an AI Systems Evaluator, you will play a critical role in ensuring the reliability and security of artificial intelligence models. Your responsibilities will include:

Duties:
  • Conducting thorough evaluations of AI models to assess their functionality, capabilities, and compliance with established standards.
  • Designing and implementing structured evaluations of AI systems to ensure scientific rigor.
  • Assessing existing safeguards within models to determine their effectiveness.
  • Executing red-team operations on AI systems utilizing real-world adversarial tactics to uncover vulnerabilities and potential misuse.
  • Developing and refining new tools and workflows for red-teaming and safety evaluations.
  • Continuously enhancing red-teaming techniques to improve efficiency and scalability.
  • Collaborating with cross-functional teams to devise innovative solutions to AI safety challenges.
  • Effectively communicating complex AI concepts to diverse audiences, both technical and non-technical.
  • Contributing to the formulation of technical guidelines and best practices for AI safety.

Requirements:
To qualify for this position, candidates must meet the following conditions:
  • U.S. citizenship.
  • Registration for Selective Service (for males born after a certain date).
  • Eligibility for Federal employment.
  • Completion of Confidential Financial Disclosure, Form OGE-450.
  • Designated and/or random drug testing may be required.

Qualifications:
Basic Requirements:

Applicants must possess IT-related experience, which can be demonstrated through paid or unpaid work, or completion of intensive training such as IT certification. All candidates must demonstrate proficiency in the following competencies:

  • Attention to Detail: Thoroughness in work and conscientiousness in attending to detail.
  • Customer Service: Ability to work with clients to assess needs and provide quality service.
  • Oral Communication: Effectively conveying information to various audiences.
  • Problem Solving: Identifying issues and generating sound recommendations.

For higher-level positions, specialized experience in AI generative models and machine learning algorithms is required, along with the ability to lead projects and teams.


Additional Information:
This position is part of a flexible work environment that supports work-life balance, offering various benefits such as telework options, flexible schedules, and wellness programs. Federal employees enjoy a comprehensive benefits package designed to enhance their career experience.