Director of Prompting

2 weeks ago


San Francisco CA, United States Valence Full time

Why Valence

Valence is a Series A (Insight Partners) B2B SaaS, and we’ve built the first-to-market generative AI leadership coach for large enterprises. Valence’s mission is to help the world work better together.

Our team, drawn from multidisciplinary backgrounds and top firms like McKinsey and Bridgewater, tackles the toughest problems facing leaders today by leveraging cutting-edge LLM-driven technology. We’re at the forefront of changing how learning and development happens at the world’s biggest companies.

We’ve been featured in the Harvard Business Review and are working with world-class companies like Coca-Cola, Nestlé, ServiceNow, AstraZeneca, Experian, Bristol Myers Squibb, and more.

The Role

Valence is augmenting advanced LLM technology with bespoke prompting processes. The Director of Prompting will work directly with our Co-Founders and Product, Engineering teams to further define our prompting function – setting systematic processes and improvement approaches to defining how our prompts provides clients with high quality coaching experiences. This role will be leading a team to methodically uncover and catalog the most effective strategies for prompting the LLM to iteratively improve the quality of coaching that Valence can deliver through Nadia, the LLM powered coach.

The field of prompt engineering is really new – no one yet knows exactly what the right set of skills and experiences are for this type of position. So, in your application we invite you to present a prompt engineering project involving large language models (LLMs) that stands out to you. We are looking for a project that demonstrates either a sophisticated and inventive prompting strategy or a thorough analysis of an LLM’s responses. For applicants with substantial machine learning (ML) background, a detailed ML project that required intricate dataset preparation and processing, along with comprehensive benchmarking, can also be considered in place of an LLM project.

Location and Work Environment

Candidate must be based in EST or PST, and this is a remote-friendly role. We get together at least quarterly to co-work. Candidates must not have any restrictions on their North American travel. We are a globally distributed team.

What You’ll Do

-Work with the Engineering, Product and C-Suite to roadmap evolving prompting priorities.

-Define and evolve the prompt architecture, including design, chaining, prompt goals.

-Develop a system to evaluate the quality and efficacy of prompts based on user feedback and KPIs.

-Build a system to maintain the library of high quality prompts or prompt chains.

-Write, test and iterate on prompts to achieve specific conversational outcomes as directed by the Product Team.

-Operationalize prompting as a function at Valence, build the processes, playbooks and systems needed.

-Hire and manage a team as required.

-Contribute to the AI Coach product being scalable and maintainable.

-Contribute to machine learning and large language model (LLM) pipelines and APIs, including -OpenAI (GPT-3.5 and GPT-4), Azure (OpenAI), Anthropic (Claude), and others.

-Anything else related to prompting that we think will rapidly accelerate our product.

What We’re Looking For

-8+ years of experience in a professionally challenging environment like top tier consulting or a high-growth startup.

-Data science, computer science, ML Engineering or other technical background. Experience with Python, SQL are preferred.

-Significant experience building with LLMs, prompting, ML in a personal or professional setting. -Ideally you have exposure to managing prompt structures (chaining, parallel prompts), developing the overall prompting architecture, aligning prompts to strategic goals.

-Writing, testing and iterating on prompts in a systemic way.

-Deeply systematic approach to thinking and work streams.

-Strong problem solving mindset to build net new prompting approaches.

-Proven leadership and collaboration skills working with engineers, product, C-Suite and others.

-Comfortable with direct feedback, debate and discussion to drive a cutting-edge technological approach forward.

-Energized doing repetitive and detail oriented work as part of a bigger strategic picture.

Diversity Equity and Inclusion

We are committed to fostering a diverse and inclusive environment where our team members, vendors, contractors and beyond feel valued and supported. We know that our commitment to inclusion and belonging enables us to do our best work overall. We strongly encourage applications from candidates of all backgrounds regardless of race, gender, sexual orientation, marital status, age, citizenship, disability, and national origin. Accommodations are available upon request for candidates taking part in all aspects of the hiring and selection process. We know applying for a job can be intimidating, please don’t hesitate to reach out – Allison Langille, Head of People jobs@valence.co.

#J-18808-Ljbffr

  • San Francisco, CA, United States Department of Veteran Affairs Full time

    The Home Based Primary Care (HBPC) Medical Director serves as the physician member of the HBPC leadership team and as a primary care provider for veterans enrolled in HBPC. The HBPC Medical Director is part of the Geriatrics, Palliative, and Extended (GPEC) service line. As a physician leader, the HBPC Medical Director leads interdisciplinary teams...


  • San Francisco, United States The New School of San Francisco Full time

    **WHO WE ARE** New School San Francisco is a public school currently serving over 400 kindergarten through 8th grade students from all corners of the city and from all backgrounds. We believe in a “hands on minds on” approach to learning that harnesses each student’s curiosity and encourages learners to construct their own meaning and knowledge through...

  • Board of Directors

    1 month ago


    San Francisco, United States Voice of Witness Full time

    **Join Our Board**: **Board Purpose and Scope of Responsibilities**: The purpose of the Voice of Witness Board of Directors is to help the organization further its mission of advancing human rights by amplifying the voices of people impacted—and fighting against—injustice. We’re seeking board members who will be enthusiastic partners as we embark on...


  • San Francisco, United States University of San Francisco Full time

    **Program Director, Master of Arts in Professional Communication** **University of San Francisco** **R0009306** **101 Howard** **Job Title**: Program Director, Master of Arts in Professional Communication **Job Summary**: The University of San Francisco's Master of Arts in Professional Communication (MAPC) provides the knowledge and skills for superior...

  • Development Director

    4 weeks ago


    San Francisco, United States ST VINCENT DE PAUL SOCIETY OF SAN FRANCISCO Full time

    **_Life changing work_**_ _**_* Welcoming staff - Generous benefits - Advancement opportunities_** **Join the St. Vincent de Paul Society of San Francisco and be part of the solution to break the cycles of homelessness and domestic violence in San Francisco**. - . - St. Vincent de Paul Society of San Francisco operates the Multi-Service Center - Northern...


  • San Francisco, United States University of California San Francisco Full time

    The Deputy Director is a critical member of the Institute for Global Health Sciences (IGHS) leadership team is in charge of pursuing the IGHS mission and executing the organization’s goals purposes. They will report to the Executive Director of IGHS and have overall duty for administrative and mission-purpose of IGHS activities, both domestic and global....


  • San Francisco, California, United States Department of Veteran Affairs Full time

    The Home Based Primary Care (HBPC) Medical Director serves as the physician member of the HBPC leadership team and as a primary care provider for veterans enrolled in HBPC. The HBPC Medical Director is part of the Geriatrics, Palliative, and Extended (GPEC) serviceline. As a physician leader, the HBPC Medical Director leads interdisciplinary teams across...


  • San Francisco, United States Department of Veteran Affairs Full time

    The Home Based Primary Care (HBPC) Medical Director serves as the physician member of the HBPC leadership team and as a primary care provider for veterans enrolled in HBPC. The HBPC Medical Director is part of the Geriatrics, Palliative, and Extended (GPEC) serviceline. As a physician leader, the HBPC Medical Director leads interdisciplinary teams across...


  • San Francisco, United States Department of Veteran Affairs Full time

    The Home Based Primary Care (HBPC) Medical Director serves as the physician member of the HBPC leadership team and as a primary care provider for veterans enrolled in HBPC. The HBPC Medical Director is part of the Geriatrics, Palliative, and Extended (GPEC) service line. As a physician leader, the HBPC Medical Director leads interdisciplinary teams across...


  • San Francisco, United States University of California San Francisco Full time

    Under the general direction of the Executive Director of Finance, Administration and Operations, The Assistant Director of Operations is responsible for the development and implementation of internal practices and systems and will contribute to the development of the organization’s operational strategy to support Health and Campus operations. They will...


  • San Francisco, United States University of California San Francisco Full time

    For position in Division of HIV, Infectious Diseases, and Global Medicine (Associate Medical Director, Ward 86) The University of California, San Francisco (UCSF) Department of Medicine, Division of HIV, Infectious Diseases and Global Medicine at Zuc Medical Director, Director, Associate, Medical, Health Science, Clinical, Healthcare

  • Development Director

    3 weeks ago


    San Francisco, California, United States ST VINCENT DE PAUL SOCIETY OF SAN FRANCISCO Full time

    Life changing work* Welcoming staff * Generous benefits * Advancement opportunities Join the St. Vincent de Paul Society of San Francisco and be part of the solution to break the cycles of homelessness and domestic violence in San Francisco. . St. Vincent de Paul Society of San Francisco operates the Multi-Service Center - Northern California's largest...

  • Development Director

    2 weeks ago


    San Francisco, California, United States ST VINCENT DE PAUL SOCIETY OF SAN FRANCISCO Full time

    Life changing workWelcoming staff * Generous benefits * Advancement opportunitiesJoin the St. Vincent de Paul Society of San Francisco and be part of the solution to break the cycles of homelessness and domestic violence in San FranciscoSt. Vincent de Paul Society of San Francisco operates the Multi-Service Center - Northern California's largest homeless...

  • Development Director

    2 weeks ago


    San Francisco, California, United States ST VINCENT DE PAUL SOCIETY OF SAN FRANCISCO Full time

    Life changing workWelcoming staff * Generous benefits * Advancement opportunitiesJoin the St. Vincent de Paul Society of San Francisco and be part of the solution to break the cycles of homelessness and domestic violence in San FranciscoSt. Vincent de Paul Society of San Francisco operates the Multi-Service Center - Northern California's largest homeless...


  • San Francisco, United States ST VINCENT DE PAUL SOCIETY OF SAN FRANCISCO Full time

    Life changing workWelcoming staff * Generous benefits * Advancement opportunitiesJoin the St. Vincent de Paul Society of San Francisco and be part of the solution to break the cycles of homelessness and domestic violence in San FranciscoSt. Vincent de Paul Society of San Francisco operates the Multi-Service Center - Northern California’s largest homeless...


  • San Francisco, United States University of San Francisco Full time

    Job Title: Associate Director of Annual Giving (Direct Marketing)Job Summary: University of San FranciscoThe University of San Francisco (USF) is recognized nationally and internationally as a leading Jesuit Catholic, urban university with a tremendously diverse student and faculty population and a global perspective. Established as San Francisco’s first...


  • San Francisco, United States Department of Veterans Affairs Full time

    Rewarding leadership opportunitiy caring for our nation's veterans!The Home Based Primary Care (HBPC) Medical Director serves as the physician member of the HBPC leadership team and as a primary care provider for veterans enrolled in HBPC. The HBPC Medical Director is part of the Geriatrics, Palliative, and Extended (GPEC) service line. As a physician...


  • San Francisco, California, United States Department of Veterans Affairs Full time

    Rewarding leadership opportunitiy caring for our nation's veteransThe Home Based Primary Care (HBPC) Medical Director serves as the physician member of the HBPC leadership team and as a primary care provider for veterans enrolled in HBPC. The HBPC Medical Director is part of the Geriatrics, Palliative, and Extended (GPEC) service line. As a physician leader,...


  • San Francisco, United States Department of Veterans Affairs Full time

    Rewarding leadership opportunitiy caring for our nation's veterans! The Home Based Primary Care (HBPC) Medical Director serves as the physician member of the HBPC leadership team and as a primary care provider for veterans enrolled in HBPC. The HBPC Medical Director is part of the Geriatrics, Palliative, and Extended (GPEC) service line. As a physician...

  • Aquatics Director II

    4 weeks ago


    San Francisco, United States YMCA of San Francisco Full time

    Imagine going to work knowing that what you do each day positively influences the lives of people and communities. As the nation's leading nonprofit organization committed to strengthening communities through youth development, healthy living and social responsibility, the YMCA of San Francisco offers more than just a job--we offer you a career with a future...