AI Test, Evaluation, Validation, and Verification Specialist with Security Clearance

2 weeks ago


Dept Of State, United States Bright Star Solutions LLC Full time
Bright Star Solutions is seeking an AI TEVV Specialist to support the Department of State in ensuring the reliability, security, and performance of AI technologies. The specialist will be instrumental in executing comprehensive testing procedures, evaluating the effectiveness and trustworthiness of AI systems, and providing expert recommendations to enhance functionality and mitigate risks. Key Responsibilities:
Lead the planning, execution, and documentation of comprehensive test, evaluation, validation, and verification activities for AI systems, algorithms, and models to assess their reliability, security, and compliance with regulatory standards and best practices.
Develop and execute detailed test plans, test cases, and test scenarios to validate the functionality, performance, and robustness of AI technologies. Collaborate with AI developers, data scientists, and subject matter experts to identify potential vulnerabilities, biases, and ethical considerations in AI systems and implement appropriate risk mitigation strategies.
Utilize advanced testing methodologies and tools, such as adversarial testing, penetration testing, and vulnerability scanning, to assess the resilience and security posture of AI solutions against emerging threats and attack vectors.
Generate reports with actionable insights. Qualifications:
Experience in AI testing, evaluation, validation, verification, cybersecurity, or related roles.
Proficiency in AI development frameworks, database design, understanding of structured query language (SQL), and familiarity with database management systems, programming languages (e.g., Python, TensorFlow, PyTorch, R, MLFlow), and cybersecurity tools, such as Splunk.
Knowledge of development, testing, and deployment of LLMs.
Knowledge of regulatory frameworks, standards, and guidelines related to AI trustworthiness, security, and validation is desirable. Salary Range:
$150,000-$190,000

  • Dept Of State, United States Bright Star Solutions LLC Full time

    Bright Star Solutions is seeking a dedicated Responsible AI Implementation Specialist to support the Department of State in operationalizing responsible artificial intelligence (AI) mandates and promoting ethical AI practices. The Specialist will be responsible for developing and implementing strategies, policies, and frameworks to ensure the ethical and...


  • state of new york, United States Outlier Full time

    Outlier is a platform that connects subject matter experts to help build the world's most advanced Generative AI. You will work on a variety of projects from generating training data in your discipline to advance these models to evaluating performance of models.As an AI Math Evaluator, you'll rate, review, and rewrite responses from AI models to enhance...


  • Dept Of State, United States MEC Energy Services, LLC Full time

    MANAGEMENT CONSULTANT – Duties and Responsibilities:• Assist in addressing cost, resource, and location related best practices recommendations.• Assist with strategic planning efforts focused on Consular Affair's future facility requirements and building related needs.• Support sourcing meetings and facilitate meetings as needed.• Draft, develop,...


  • Dept Of State, United States XMS Solutions Inc Full time

    We have a need for a Sr Project Manager to work onsite (SCIF) in the Foggy Bottom location of DC. Our projects involve the movement , conversion or migration from OnPrem Microsoft services (enterprise license) to cloud (Azure) solutions. Handling multiple concurrent project activities is key for this role.We also assist with directory level security in IGA...


  • Dept Commerce, United States TekStream Solutions, LLC Full time

    Continuity of Operations Planning and Emergency Management Planning SME (TS/SCI required)Location: Washington, DC 20230 (all work performed on-site) Herbert C. Hoover Building (HCHB) 1401 Constitution Avenue, NWWashington, DC. Due to the nature of work being done, remote flexibility is only approved on a limited basis Overview: Seeking a COOP and Emergency...


  • Dept Energy, United States Sigma Science Full time

    Where You Will Work:Sigma Science, Inc. (Sigma) is a New Mexico-based, small business that provides comprehensive engineering and technology services to federal and commercial clients. We solve our client’s most demanding challenges by hiring best-in-class leaders and employees, and partnering with trusted companies, industry leaders, and universities....


  • Dept Energy, United States AMSG, Inc. Full time

    AMSG is seeking a Stakeholder Management Subject Matter Expert (SME) to support an opportunity we are pursuing with the US Department of Energy (DOE) National Nuclear Security Administration (NNSA) Office of Management and Budget. This is a Contingent Hire position. AMSG supports a variety of Department of Defense (DoD), Department of Veterans Affairs (VA),...


  • Dept Justice, United States Entwined Technologies, Inc Full time

    Title: Database Administrator on Cyber Security Team Location: Washington, DC (remote) Employee Status: Regular / Full-time ***Must have an active DoD Secret Clearance or higher*** PRIMARY FUNCTION Perform SQL Database Administration and support activities for a Federal Government network. These activities include maintaining a SQL 2014 Data Warehouse as...


  • State College, United States Applied Research Laboratory at the Penn State University Full time

    The Penn State University Police and Public Safety Department is responsible for protecting and serving more than 100,000 students, employees, as well as visitors at campuses located throughout Pennsylvania.  We are a cohesive and centralized department with sworn police officers who have full law enforcement authority serving the 22 campuses with our...

  • Security Specialist

    5 days ago


    King of Prussia, United States Security Industry Specialists, Inc. Part time $19

    Security Specialist - PT/FlexAbout this position:Department: RetailLocation (City/State): King of Prussia, PAEmployment Type: PT/FlexAbout us:Security Industry Specialists, Inc. (SIS) provides security solutions to some of the most recognized companies and brands in the world. We deliver services that consistently exceed those of our peers. We accomplish...


  • Dept Homeland Security, United States InnovativeOne Technologies, LLC Full time

    Full Stack Developer Co-location: Primarily Co-Located; 3801 Nebraska Ave. Washington, DC (80% on-site) Clearance: Top Secret - SCI eligible Description Seeking Software Developers to join our team and help accelerate a federal mission client's discovery and delivery of identity and network-based intelligence insights to counter national security threats and...


  • State College, United States Applied Research Laboratory at the Penn State University Full time

    We are seeking a skilled Endpoint Systems Administrator to join our Computing Services Department at the Applied Research Laboratory (ARL) at Penn State University. ARL's purpose is to research and develop innovative solutions to challenging scientific, engineering, and technology problems in support of the Navy, the Department of Defense (DoD), and the...


  • State College, United States Applied Research Laboratory at the Penn State University Full time

    The Penn State University Police and Public Safety Department is responsible for protecting and serving more than 100,000 students, employees, as well as visitors at campuses located throughout Pennsylvania.  We are a cohesive and centralized department with sworn police officers who have full law enforcement authority serving the 22 campuses with our...


  • State College, United States Applied Research Laboratory at the Penn State University Full time

     JOB DESCRIPTION AND POSITION REQUIREMENTS:We are searching for an entry level Enterprise Systems Engineer to join our Applied Enterprise Systems Department at the Applied Research Laboratory (ARL) at Penn State University. The selected candidate will support ongoing research into systems that run the largest and most complex enterprises in the world. In...


  • Washington State, United States U.S. Department of Housing and Urban Development Full time

    ** Chief Information Security Officer****Department of Housing and Urban Development** The U.S. Department of Housing and Urban Development (HUD) is seeking highly qualified individuals who are willing to meet the challenges of public service and support our mission. At HUD, you'll have a once-in-a-lifetime opportunity to gain insight into housing policy...

  • Security Officer

    5 days ago


    King of Prussia, United States Allied Universal® Full time

    Security Officer - Flex Secret Clearance **Overview**: Allied Universal®, North America's leading security and facility services company, provides rewarding careers that give you a sense of purpose. While working in a dynamic, diverse and inclusive workplace, you will be part of a team that fuels a culture that will reflect in our communities and customers...

  • Security Officer

    6 days ago


    King Of Prussia, United States Allied Universal Security Full time

    Allied Universal, North America's leading security and facility services company, provides rewarding careers that give you a sense of purpose. While working in a dynamic, diverse and inclusive workplace, you will be part of a team that fuels a culture that will reflect in our communities and customers we serve. We offer medical, dental and vision coverage,...


  • State College, United States Applied Research Laboratory at the Penn State University Full time

     JOB DESCRIPTION AND POSITION REQUIREMENTS:The Vehicle Control and Dynamics Department of the Applied Research Laboratory (ARL) at Penn State is seeking a talented and experienced Flight Control and Dynamics Engineer to join our cross-functional team supporting the design, development, and validation of undersea vehicle flight controls from concept through...

  • Systems Engineer

    1 month ago


    State College, United States Applied Research Laboratory at the Penn State University Full time

     Systems EngineerWe are seeking a highly motivated, self-starting Research and Development Engineer to join our Agile Systems Engineering (ASE) Group of the Applied Research Laboratory (ARL) at Penn State University. You will support complex system development leveraging the latest technologies in areas such as hypersonic weapons, unmanned systems, advanced...

  • Security Officer

    6 days ago


    King Of Prussia, United States Allied Universal Security Full time

    Allied Universal, North America's leading security and facility services company, provides rewarding careers that give you a sense of purpose. While working in a dynamic, diverse and inclusive workplace, you will be part of a team that fuels a culture that will reflect in our communities and customers we serve. We offer medical, dental and vision coverage,...