Manager, Prompt Engineering

5 days ago

Washington, United States Scale AI, Inc. Full time

At Scale AI, we accelerate AI development by working at the forefront of AI, trust, and safety. We partner with leading businesses like OpenAI, Lyft, Meta, and more to develop LLM applications, improve training datasets, and make models more trustworthy and reliable.


Role


We are seeking a Prompt Engineering Manager to lead a team of experimental engineers who focus on application and use of AI in novel, creative ways. You will build skunkworks projects using state-of-the-art AI to support operations, research, and model evaluation teams. As prompt engineering evolves, you'll continuously learn and master the latest models, explore AI behaviors, and apply creativity in your work. You'll elevate your team's talent, collaborate across teams, and drive innovation in AI applications.


You will:


  • Lead and manage the Prompt Engineering team, fostering innovation and experimentation.
  • Develop LLM applications to solve complex problems and improve data quality.
  • Identify and address vulnerabilities in LLMs to enhance robustness.
  • Document model behaviors, including vulnerability and adversarial testing.
  • Collaborate with cross-functional teams to drive projects from concept to deployment.
  • Mentor team members, enhancing their skills in prompt engineering.
  • Analyze and communicate experimental results to stakeholders.

Ideally you'd have:


  • 5+ years of engineering experience.
  • Hands-on experience with state-of-the-art AI models.
  • Proficiency in Python, TypeScript, or JavaScript.
  • Experience building LLM-based applications or leveraging LLMs creatively. Hobby projects are ok, the more creative in their use of AI the better.
  • Leadership skills with some management or mentoring experience.
  • Strong communication and collaboration abilities.
  • A creative mindset with a passion for experimentation.

Nice to haves:


  • Experience with AI/LLM development or red teaming.
  • Familiarity with LLM evaluation metrics and statistical analysis.
  • Academic work related to language models or adversarial robustness.
  • Ideally you'd be able to collaborate in person with our teams in SF or NYC at least once a month.
#J-18808-Ljbffr

  • Behavioral Therapist

    3 weeks ago

    Washington, Washington, D.C., United States Prompt Recruiting Full time

    BCBA OpportunityAre you a passionate BCBA looking for a new challenge? Do you have a passion for serving individuals with disabilities? We are seeking a BCBA to join our team at Prompt Recruiting.Responsibilities:Oversee a caseload of 6-8 children in a center-based settingManage and train Registered Behavior Technicians (RBTs)Conduct assessments and...

  • Experienced BCBA Role for Disability Services

    7 days ago

    Washington, Washington, D.C., United States Prompt Recruiting Full time

    About the RoleColumbia, SC, and surrounding areas are in need of passionate BCBA professionals who can make a difference in the lives of children with disabilities. At Prompt Recruiting, we're seeking an exceptional BCBA to join our team and oversee a caseload of 6-8 children in a center-based setting.ResponsibilitiesManage and train RBTsConduct assessments...

  • Senior Design Engineer

    3 weeks ago

    Washington, Washington, D.C., United States Bohler Engineering Full time

    At Bohler Engineering, we're looking for a Senior Design Engineer to join our team. As a key member of our design team, you'll be responsible for engaging with external clients, perfecting your technical site design knowledge, and sharing your expertise with your team.As a Senior Design Engineer, you'll have the opportunity to work on a wide range of...

  • DNCG Systems Engineer

    3 weeks ago

    Washington, Washington, D.C., United States Engineering Services Network Full time

    Engineering Services Network is seeking a highly skilled DNCG Systems Engineer to join our team in the Aircraft Carrier Design and Systems Engineering Directorate (SEA 05V) at Naval Sea Systems Command (NAVSEA).This position will be based at the Washington Navy Yard and will serve as a Systems Engineer directly supporting the Nimitz (CVN68) and Ford (CVN78)...

  • Navigation Systems Engineer

    3 weeks ago

    Washington, Washington, D.C., United States Engineering Services Network Full time

    At Engineering Services Network, we are seeking a highly skilled Navigation Systems Engineer to join our team in the Aircraft Carrier Design and Systems Engineering Directorate (SEA 05V) at Naval Sea Systems Command (NAVSEA). This position will be based at the Washington Navy Yard, DC.The successful candidate will serve as a Navigation Systems Engineer...

  • Cybersecurity Expert: Information Systems Security Engineer

    7 days ago

    Washington, Washington, D.C., United States Praxis Engineering Full time

    Transformative Cybersecurity OpportunityAt Praxis Engineering, we're seeking a seasoned Cybersecurity Expert: Information Systems Security Engineer to spearhead the development of cutting-edge cybersecurity solutions.Your MissionAs a critical member of our team, you'll be responsible for safeguarding digital landscapes through technical security assessments,...

  • Engineer - Mid-Level

    5 days ago

    Washington, United States Engineering Services Network, Inc. Full time

    ESN Inc. is seeking a Mid-to-Senior Level Engineer with experience in Navy ship warfare system engineering including: Experience in Leadership and Technical roles onboard US Navy AEGIS Destroyers/Cruisers. Experience with FFG program would be desirable. Experience supporting a major Navy ship acquisition program to include financial, scheduling, product...

  • Commissioning Project Manager

    4 weeks ago

    Washington, Washington, D.C., United States Engineering Economics Full time

    About UsAt Engineering Economics, Inc., we pride ourselves on delivering innovative solutions to maximize building performance, extend system lifecycles, and reduce utility costs. Our team of experts consistently delivers high-quality results to our clients, including Fortune 500 organizations, national healthcare networks, prestigious universities, and...

  • Business Development Manager EMEA

    3 weeks ago

    Washington, Washington, D.C., United States OTTO Engineering Full time

    Job Title:Business Development Manager EMEAJob Summary:OTTO Engineering is seeking a highly skilled Business Development Manager EMEA to lead our sales efforts in the EMEA region. The successful candidate will be responsible for driving sales growth, managing channel partners, and providing training and support to end-users.Key Responsibilities:Develop and...

  • Senior Structural Engineer, ReStl Designers

    3 weeks ago

    Washington, Washington, D.C., United States TRC Worldwide Engineering Full time

    We are seeking a highly experienced Senior Structural Engineer to join our team at TRC Worldwide Engineering. The successful candidate will be an engineering professional with a strong background in structural design and project management.Key Responsibilities:Design a wide variety of building structures utilizing concrete, steel, masonry, and wood...

  • Senior Warfare Systems Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Engineering Services Network Full time

    Job DescriptionEngineering Services Network (ESN) is seeking a highly skilled Mid-to-Senior Level Engineer to join our team. As a key member of our engineering team, you will be responsible for delivering trusted solutions that support our nation's defense.Key ResponsibilitiesLead and participate in the development of Navy ship warfare system engineering...

  • Senior HVAC Engineer

    2 weeks ago

    Washington, United States Manpower Engineering Full time

    Summary of Job Description:  Operates, inspects, and maintains all HVAC, mechanical, electrical and plumbing equipment and systems in assigned facilities to obtain most efficient operating results and life expectancy. Assures that equipment is being maintained in an energy efficient, safe manner and down time is reduced to a minimum by anticipation of...

  • Senior Structural Engineer

    4 weeks ago

    Washington, Washington, D.C., United States TRC Worldwide Engineering Inc Full time

    Job SummaryWe are seeking a highly skilled Senior Structural Engineer to join our team at ReStl Designers, Inc. As a key member of our engineering team, you will be responsible for designing and developing structurally sound engineering solutions for a wide range of building structures.Key Responsibilities:Design and develop structural engineering solutions...

  • Senior HVAC Engineer

    2 weeks ago

    Washington, United States Manpower Engineering Full time

    Summary of Job Description: Operates, inspects, and maintains all HVAC, mechanical, electrical and plumbing equipment and systems in assigned facilities to obtain most efficient operating results and life expectancy. Assures that equipment is being maintained in an energy efficient, safe manner and down time is reduced to a minimum by anticipation of...

  • Senior HVAC Engineer

    2 months ago

    Washington, United States Manpower Engineering Full time

    Summary of Job Description:  Operates, inspects, and maintains all HVAC, mechanical, electrical and plumbing equipment and systems in assigned facilities to obtain most efficient operating results and life expectancy. Assures that equipment is being maintained in an energy efficient, safe manner and down time is reduced to a minimum by anticipation of...

  • Senior Design Engineer

    4 weeks ago

    Washington, DC , USA, United States Bohler Engineering Full time

    Join Our Team as a Senior Design EngineerWe are seeking a highly skilled Senior Design Engineer to join our team at Bohler Engineering. As a Senior Design Engineer, you will be responsible for designing site plans for some of the most recognizable brand name clients across a wide spectrum of industries.Key Responsibilities:Engage in valuable interactions...

  • Commissioning Project Manager

    3 weeks ago

    Washington, Washington, D.C., United States Engineering Economics Full time

    About Us:At Engineering Economics, Inc., we are a recognized leader in the facility and energy consulting marketplace. Our professionals consistently deliver innovative solutions to maximize building performance, extend system lifecycles, and reduce utility costs.We have formed strategic and valued partnerships with Fortune 500 organizations, national...

  • Configuration Management Specialist

    3 weeks ago

    Washington, Washington, D.C., United States Engineering Services Network Full time

    Engineering Services Network is seeking a highly motivated and detail-oriented Configuration Management Assistant to support the Ford Class Aircraft Carrier Configuration Manager.This role involves providing support in the review of change documentation, including slides, specification changes proposals, and schedule requests. The ideal candidate will be...

  • DNCG System Engineer

    5 days ago

    Washington, United States Engineering Services Network, Inc. Full time

    Founded in 1995, ESN is a Small Disadvantaged Business (SDB), Service-Disabled Veteran-Owned Small Business (SDVOSB) and Veteran Owned Small Business (VOSB). ESN delivers trusted solutions that support our nation's defense. For more than two decades, we have been providing our military and government customers with mission-critical services including...

  • Automation Systems Engineer

    3 weeks ago

    Washington, Washington, D.C., United States E Tech Group Full time

    Job OverviewE Tech Group is seeking a skilled Controls Engineer to join our team. As a key member of our team, you will be responsible for designing, deploying, testing, and maintaining control system projects. Your expertise will be essential in implementing technical solutions, collaborating with customers and associates, and delivering high-quality...