Research Prompt Engineer

3 weeks ago

San Francisco CA, United States Anthropic Limited Full time

Prompt engineering is the art of instructing large language models in a way that delivers the most nuanced and high quality outputs. It is a hybrid between programming, instructing, and iterative experimentation. As a research prompt engineer, your role would be to work with our finetuning researchers to help deliver the best results from our models. This will include but need not be limited to: building on existing prompting techniques, developing new prompting techniques, testing prompt effectiveness, documenting prompts, supporting prompt testing infrastructure, and running experiments using the prompts you help to develop. You will be engaged in creative and cutting-edge finetuning research that will improve the performance and safety of frontier models.

Given that this is a nascent field, we ask that you share with us a specific prompt engineering project on LLMs that you're proud of in your application Ideally this project should show off a complex and clever prompting architecture, or a systematic evaluation of an LLM's behavior in response to different prompts, or an example of using LLMs for a relevant ML task such as careful dataset curation and processing. There is no preferred task, we just want to see how you create and experiment with prompts. You can also include a short description of the process you used or any roadblocks you hit and how to deal with them, but this is not a requirement.

Responsibilities
  • Develop new, creative, and original prompting strategies for a wide range of research tasks relevant to our fine-tuning efforts.
  • Build upon and improve existing prompting techniques to increase their effectiveness and efficiency.
  • Test and assess the effectiveness of both existing and newly developed prompts.
  • Create and maintain documentation of prompts and promote internal knowledge sharing.
  • Help to create and maintain the infrastructure required for efficient prompt iteration and testing.
  • Work with finetuning researchers to run experiments using the prompts you have helped create.
  • Stay up-to-date with the latest research in prompt engineering and share knowledge with the team.
You may be a good fit if you
  • Have extensive prior experience exploring and testing language model behavior.
  • Have a high level familiarity with the architecture and operation of large language models.
  • Have good communication skills and an interest in working with researchers on difficult prompting tasks.
  • Have a creative hacker spirit and a love of puzzle solving.
  • Have a firm grasp of programming in Python and experience with data structures.
Strong candidates may also have experience with
  • Advanced degree in computer science, mathematics, statistics, physics, or a related technical field, or an advanced degree in a relevant non-technical field alongside evidence of programming experience.
  • Research experience in machine learning, natural language processing, or a related field.
  • Experience with large-scale model training and evaluation.
  • Passion for making powerful technology safe and societally beneficial.

Deadline to apply: None. Applications will be reviewed on a rolling basis.

#J-18808-Ljbffr

  • Prompt Engineers

    3 weeks ago

    San Francisco, United States Forhyre Full time

    Job DescriptionJob DescriptionWe are a cutting-edge technology company at the forefront of the Artificial Intelligence (AI) revolution. Our mission is to create intelligent solutions that transform industries and drive innovation. We are seeking a talented and motivated Prompt Engineer to join our dynamic team and play a pivotal role in shaping the future of...

  • AI Chatbot Prompt Engineer

    1 month ago

    San Francisco, United States Hire Digital Full time

    Job DescriptionJob DescriptionOutlier is a forward-thinking software development company that pushes artificial intelligence's boundaries. As a part of their ongoing projects, Outlier is building a cloud-based contact centre powered by artificial intelligence (AI). This innovative contact centre platform seamlessly integrates with customer relationship...

  • Research Engineer, Collective Alignment

    1 week ago

    San Francisco, United States OpenAI Full time

    About the team OpenAI's mission is to ensure that artificial general intelligence benefits all of humanity. OpenAI's Collective Alignment Team works on technical approaches to ensure that AGI is shaped democratically. We plan to do so by implementing a system for collecting and encoding public input on model behavior into our systems. While OpenAI has...

  • Research Engineer, Collective Alignment

    4 weeks ago

    San Francisco, United States OpenAI Full time

    About the team OpenAI's mission is to ensure that artificial general intelligence benefits all of humanity. OpenAI's Collective Alignment Team works on technical approaches to ensure that AGI is shaped democratically. We plan to do so by implementing a system for collecting and encoding public input on model behavior into our systems. While OpenAI has...

  • SR. RESEARCH ANALYST

    4 weeks ago

    San Antonio, United States Southwest Research Institute Full time

    Who We Are: The Sensor Sytems and Nondestructive Evaluation (NDE) Technology team is comprised of engineers, scientists, and technicians who develop sensor systems and inspection methodologies to assess the serviceability of a variety of structures from deep sea to deep space. Objectives of this Role: Develop sensors and sensor systems used to inspect...

  • ENGINEER - RESEARCH ENGINEER - Computational Material & Structural Integrity

    1 month ago

    San Antonio, United States Southwest Research Institute Full time

    Objectives of this Role: Join our team to perform fundamental and applied research through the development of advanced fatigue crack growth lifing methods for material and structural integrity assessments. Participate in individual and collaborative research projects that deal with applications in aerospace, engine, and manufacturing sectors. Apply...

  • AI Research Engineer

    2 weeks ago

    San Francisco, United States Cadre Full time

    Sr. AI Research EngineerExperience as a senior contributor at a high performing company Past work with large-scale ML systems, GPUs, kubernetes, pytorch Generative AI, diffusion, transformers expertise is a plus, especially in audio and music Aptitude for taking research advancements and turning them into real product solutions Knowledge of technological...

  • Research Scientist

    1 week ago

    San Francisco, CA, United States Factory Full time

    Factory is seeking a Research Scientist to join our team, focusing on the advancement and integration of cutting-edge AI technologies into our autonomous Droids.What you will do and achieve:Engage in ground-breaking research to advance the capabilities of our Droids, ranging from foundational improvements to the development of entirely new AI-native features...

  • Research Scientist/Software Engineer in Systems

    1 week ago

    San Francisco, CA, United States OpenAI Full time

    About the TeamOpenAI’s Scaling team operates at the far edge of all available innovations in AI — doing the engineering and research required to harness custom-built hyperscale supercomputers, the latest algorithmic improvements, and massive datasets to train AI models of unprecedented capability.We build our own model training software stack, solving...

  • LEAD ENGINEER

    4 weeks ago

    San Antonio, United States Southwest Research Institute Full time

    Who We Are:A team of engineers and technicians in SwRI's Space Sector who facilitate space science research through the fabrication and inspection of electronic printed circuit boards for spacecraft instrumentation, avionics, and electronics.Objectives of this Role: Manufacturing Engineer to lead...

  • LLM Engineer

    1 week ago

    San Francisco, United States Spellbrush Full time

    Here at Spellbrush, we're passionate about making a good anime game. We also happen to be the world's leading generative AI studio - we're the team behind niji?journey. We are currently investigating how AI can be used to help human artists perform masterpieces in the most complex medium of our times: videogames. Our games are characterized by a...

  • Researcher - Large Language Models, AML

    1 week ago

    San Jose, CA, United States TikTok Full time

    DescriptionTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This...

  • LLM Engineer

    3 weeks ago

    San Francisco, United States Spellbrush Full time

    Job DescriptionJob DescriptionHere at Spellbrush, we're passionate about making a good anime game.We also happen to be the world's leading generative AI studio — we're the team behind niji・journey.We are currently investigating how AI can be used to help human artists perform masterpieces in the most complex medium of our times:...

  • AI Research Engineer

    4 days ago

    San Francisco, United States Connectly Full time

    At Connectly we are building revolutionary conversational commerce experiences. Unlike traditional shopping where you have to download an app, or sign up on a website, we allow customers to engage and transact directly within the thread. By choosing Connectly you will join a VC-backed series A startup on a growth trajectory, work with our world-class team,...

  • Software Engineer, Research Infrastructure

    7 days ago

    San Francisco, United States Anthropic Limited Full time

    Anthropic is seeking an experienced engineer for our Research Infrastructure team. You'll lead initiatives supporting some of the largest, most sophisticated clusters in industry used to train, research, and ultimately serve AI models. Your work will be crucial in ensuring Anthropic is able to continue reliably and safely training frontier models! The...

  • Senior Operations Research Analyst

    5 days ago

    San Diego, United States Capstone Research Corporation Full time

    Job DescriptionJob DescriptionCapstone Research Corporation is seeking to expand our team. We are a customer-oriented engineering services company providing world class research and development support to the Department of Defense (DoD): Army, Navy, Air Force, Marines, and the Missile Defense Agency. Capstone offers 100% Company Provided Medical and Dental...

  • ENGINEER - RESEARCH ENGINEER - Mechanical Systems

    3 weeks ago

    San Antonio, United States Southwest Research Institute Full time

    Who We Are:The Mechanical Systems Section in the Strategic Aerospace Department provides electromechanical engineering support for several US Air Force Global Strike Command and Department of Defense programs. We are a multidisciplinary team of engineers that enjoy supporting the provide engineering...

  • Research Scientist

    2 weeks ago

    San Francisco, California, United States Factory Full time

    Factory is seeking a Research Scientist to join our team, focusing on the advancement and integration of cutting-edge AI technologies into our autonomous Droids.What you will do and achieve:Engage in ground-breaking research to advance the capabilities of our Droids, ranging from foundational improvements to the development of entirely new AI-native features...

  • Full-Stack Software Developer

    1 week ago

    San Francisco, United States Tilda Research Full time

    Why work at Tilda? Create a product which will redefine medical innovation: Tilda is a fully-integrated clinical trial network. We help pharma innovators leverage our unprecedented data insights, to better execute their clinical trial programs. Thus, we have the chance to institute a meaningful impact on millions of lives. You can help us realize that goal....

  • Machine Learning Research Engineer

    4 weeks ago

    San Francisco, California, United States Imbue (formerly Generally Intelligent) Full time

    In this role you'll work with our researchers to do cutting-edge deep learning research—conducting experiments, creating infrastructure, and developing tooling & visualizations—with the goal of developing more human-like machine intelligence.If interested, apply here or on Work at a StartupExample projectsImplement a self-supervised network using...