Principal Software Engineer LLM Services

3 weeks ago


Palo Alto, United States Obsidian Security Full time
Job DescriptionJob Description

About Us:

Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization.

Obsidian proudly offers the industry's most comprehensive and powerful SaaS defense solution. We are committed to solving the challenge of SaaS Security for our customers as efficiently and effectively as possible.

We're a passionate team optimizing for impact by solving some of the biggest challenges in cybersecurity today. We listen closely to our customers, iterate quickly, and (over) deliver to
delight them. Working at Obsidian means contributing to an industry-leading cybersecurity product in an environment where customer satisfaction, privacy, and data ethics are paramount.

About the role:

  • In your role as a Principal Software Engineer, you will focus on leveraging and optimizing Large Language Models (LLMs) along with the implementation of advanced AI technologies.
  • Your key responsibilities will include:
  • Development and Optimization of LLMs: Implement and fine-tune state-of-the-art Large Language Models for various applications, focusing on performance and accuracy.
  • Evaluating Model Performance: Conduct rigorous evaluations of LLMs, assessing effectiveness, efficiency, and business alignment.
  • Integration of Advanced AI Technologies: Implement Retrieval-Augmented Generation (RAG), function calling, and code interpreter technologies to enhance the capabilities of Large Language Models.
  • Research and Development: Stay abreast of the latest advancements in machine learning, particularly in LLMs, LLM agents, and large-scale neural network training.
  • Data and Model Parallel Training: Utilize data and model parallel training techniques for efficient handling of large-scale models.
  • GPU Cluster Management for Training: Oversee extensive training jobs on GPU clusters, ensuring optimal resource utilization for complex tasks.
  • Cross-Functional Collaboration and Leadership: Work with ML engineers, data scientists, and product teams, providing guidance and mentorship.
  • Documentation and Reporting: Maintain detailed documentation of methodologies, models, and results, communicating findings across the organization.


About you:

  • Bachelor's degree in Computer Science, Engineering, or related field. Advantage for Master's or PhD in Computer Science, AI, Linguistics, or related fields, with a focus on machine learning and natural language processing.
  • Must have working experience within Cyber Security and/or Compliance.
  • Experience with LLMs and Python: Extensive experience with python and proficiency in leveraging LLM's.
  • Expertise in Parallel Training and GPU Cluster Management: Some background in parallel training methods and managing large-scale training jobs on GPU clusters.
  • Analytical and Problem-Solving Skills: Ability to address complex challenges in model training and optimization.
  • Leadership and Mentorship Capabilities: Proven leadership in guiding projects and mentoring team members.
  • Communication and Collaboration Skills: Effective communication skills for conveying technical concepts and collaborating with cross-functional teams.
  • Innovation and Continuous Learning: Passion for staying updated with the latest trends in AI and machine learning.


Employee Benefits:

Our competitive benefits packages are designed to support our employees' well-being, both at work and at home.

  • Competitive compensation with equity and 401k
  • Comprehensive healthcare with dental and vision coverage
  • Flexible paid time off and paid holiday time off
  • 12 weeks of new parent or family leave
  • Personal and professional development resources


At Obsidian, we are proud to be an equal-opportunity employer. We value diversity and hire for talent, passion, and compassion. In compliance with federal law, all persons hired will be required to submit satisfactory proof of identity and legal authorization



  • Palo Alto, United States Obsidian Security Full time

    About Us: Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization. Obsidian proudly offers the...


  • Palo Alto, United States Obsidian Security Full time

    About Us: Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization. Obsidian proudly offers the...


  • Palo Alto, United States Obsidian Security Full time

    About Us: Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization. Obsidian proudly offers the...


  • Palo Alto, United States Obsidian Security Full time

    Job DescriptionJob DescriptionAbout Us:Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the...


  • Palo Alto, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite is the first full-stack, generative AI platform, from chip to model, optimized for...


  • Palo Alto, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite is the first full-stack, generative AI platform, from chip to model, optimized for...

  • Principal Engineer

    1 week ago


    Palo Alto, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite is the first full-stack, generative AI platform, from chip to model, optimized for...

  • Principal Engineer

    2 weeks ago


    Palo Alto, United States SambaNova Systems Full time

    The era of pervasive AI has arrived.  In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model,...


  • Palo Alto, United States AISERA Full time

    Aisera is a leading provider of AI Copilot solutions, utilizing AiseraGPT and Generative AI to facilitate business transformation and drive revenue growth through a self-service model. Aiseras AI Copilot uses industry and domain-specific LLMs to deliver human-like experiences and auto-remediate requests through AI workflows. With 400+ integrations and 1200+...


  • Palo Alto, United States AISERA Full time

    Aisera is a leading provider of AI Copilot solutions, utilizing AiseraGPT and Generative AI to facilitate business transformation and drive revenue growth through a self-service model. Aisera’s AI Copilot uses industry and domain-specific LLMs to deliver human-like experiences and auto-remediate requests through AI workflows. With 400+ integrations and...


  • Palo Alto, United States Asimily Full time

    Principal Software Engineer – Java Core Services 2,500+ Sites deployed at Globally 170th Fastest growing company and 2nd fastest growing in cybersecurity 100k+ 200+ Job Title Principal Software Engineer – Java Core Services Asimily is an IoT Security Platform. We were recognized as the third fastest-growing cybersecurity company in 2022 by Inc. 5000,...


  • Palo Alto, California, United States HP Inc. Full time

    Job SummaryThis role is responsible for leading the design, development, and optimization of embedded software and firmware for hardware products. The role ensures the identification and resolution of software and firmware issues, ensuring timely and effective solutions. The role creates and updates technical documentation, including design specifications,...


  • Palo Alto, United States OSI Engineering Full time

    You will join an organization that partners with companies to help unlock the potential of AI for their specific goals and helps them evolve together with the technology. They’re built to help large organizations that are looking to “lean into AI” in a thoughtful way. They offer a software platform that helps companies adopt AI-based models and...


  • Palo Alto, United States AISERA Full time

    Aisera is a leading provider of AI Copilot solutions, utilizing AiseraGPT and Generative AI to facilitate business transformation and drive revenue growth through a self-service model. Aisera’s AI Copilot uses industry and domain-specific LLMs to deliver human-like experiences and auto-remediate requests through AI workflows. With 400+ integrations and...


  • Palo Alto, United States OSI Engineering Full time

    You will join an organization that partners with companies to help unlock the potential of AI for their specific goals and helps them evolve together with the technology. They’re built to help large organizations that are looking to “lean into AI” in a thoughtful way. They offer a software platform that helps companies adopt AI-based models and...


  • Palo Alto, United States OSI Engineering Full time

    You will join an organization that partners with companies to help unlock the potential of AI for their specific goals and helps them evolve together with the technology. They’re built to help large organizations that are looking to “lean into AI” in a thoughtful way. They offer a software platform that helps companies adopt AI-based models and...


  • Palo Alto, United States OSI Engineering Full time

    You will join an organization that partners with companies to help unlock the potential of AI for their specific goals and helps them evolve together with the technology. They’re built to help large organizations that are looking to “lean into AI” in a thoughtful way. They offer a software platform that helps companies adopt AI-based models and...


  • Palo Alto, United States OSI Engineering Full time

    You will join an organization that partners with companies to help unlock the potential of AI for their specific goals and helps them evolve together with the technology. They’re built to help large organizations that are looking to “lean into AI” in a thoughtful way. They offer a software platform that helps companies adopt AI-based models and...


  • Palo Alto, United States OSI Engineering Full time

    You will join an organization that partners with companies to help unlock the potential of AI for their specific goals and helps them evolve together with the technology. They’re built to help large organizations that are looking to “lean into AI” in a thoughtful way. They offer a software platform that helps companies adopt AI-based models and...


  • Palo Alto, United States OSI Engineering Full time

    You will join an organization that partners with companies to help unlock the potential of AI for their specific goals and helps them evolve together with the technology. They’re built to help large organizations that are looking to “lean into AI” in a thoughtful way. They offer a software platform that helps companies adopt AI-based models and...