Principal Software Engineer LLM Services

3 weeks ago

Palo Alto, United States Obsidian Security Full time
Job DescriptionJob Description

About Us:

Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization.

Obsidian proudly offers the industry's most comprehensive and powerful SaaS defense solution. We are committed to solving the challenge of SaaS Security for our customers as efficiently and effectively as possible.

We're a passionate team optimizing for impact by solving some of the biggest challenges in cybersecurity today. We listen closely to our customers, iterate quickly, and (over) deliver to
delight them. Working at Obsidian means contributing to an industry-leading cybersecurity product in an environment where customer satisfaction, privacy, and data ethics are paramount.

About the role:

  • In your role as a Principal Software Engineer, you will focus on leveraging and optimizing Large Language Models (LLMs) along with the implementation of advanced AI technologies.
  • Your key responsibilities will include:
  • Development and Optimization of LLMs: Implement and fine-tune state-of-the-art Large Language Models for various applications, focusing on performance and accuracy.
  • Evaluating Model Performance: Conduct rigorous evaluations of LLMs, assessing effectiveness, efficiency, and business alignment.
  • Integration of Advanced AI Technologies: Implement Retrieval-Augmented Generation (RAG), function calling, and code interpreter technologies to enhance the capabilities of Large Language Models.
  • Research and Development: Stay abreast of the latest advancements in machine learning, particularly in LLMs, LLM agents, and large-scale neural network training.
  • Data and Model Parallel Training: Utilize data and model parallel training techniques for efficient handling of large-scale models.
  • GPU Cluster Management for Training: Oversee extensive training jobs on GPU clusters, ensuring optimal resource utilization for complex tasks.
  • Cross-Functional Collaboration and Leadership: Work with ML engineers, data scientists, and product teams, providing guidance and mentorship.
  • Documentation and Reporting: Maintain detailed documentation of methodologies, models, and results, communicating findings across the organization.


About you:

  • Bachelor's degree in Computer Science, Engineering, or related field. Advantage for Master's or PhD in Computer Science, AI, Linguistics, or related fields, with a focus on machine learning and natural language processing.
  • Must have working experience within Cyber Security and/or Compliance.
  • Experience with LLMs and Python: Extensive experience with python and proficiency in leveraging LLM's.
  • Expertise in Parallel Training and GPU Cluster Management: Some background in parallel training methods and managing large-scale training jobs on GPU clusters.
  • Analytical and Problem-Solving Skills: Ability to address complex challenges in model training and optimization.
  • Leadership and Mentorship Capabilities: Proven leadership in guiding projects and mentoring team members.
  • Communication and Collaboration Skills: Effective communication skills for conveying technical concepts and collaborating with cross-functional teams.
  • Innovation and Continuous Learning: Passion for staying updated with the latest trends in AI and machine learning.


Employee Benefits:

Our competitive benefits packages are designed to support our employees' well-being, both at work and at home.

  • Competitive compensation with equity and 401k
  • Comprehensive healthcare with dental and vision coverage
  • Flexible paid time off and paid holiday time off
  • 12 weeks of new parent or family leave
  • Personal and professional development resources


At Obsidian, we are proud to be an equal-opportunity employer. We value diversity and hire for talent, passion, and compassion. In compliance with federal law, all persons hired will be required to submit satisfactory proof of identity and legal authorization

  • Backend Software Engineer

    1 month ago

    palo alto, United States Acceler8 Talent Full time

    Backend Software EngineerIntroduction: Are you a skilled Backend Software Engineer looking to make an impact in a cutting-edge environment? Join our dynamic team, where we are reshaping hardware engineering with our advanced foundation model. Our mission is to enhance the hardware design process by leveraging innovations in semiconductors and AI. As a...

  • Backend Software Engineer

    1 month ago

    palo alto, United States Acceler8 Talent Full time

    Backend Software EngineerIntroduction: Are you a skilled Backend Software Engineer looking to make an impact in a cutting-edge environment? Join our dynamic team, where we are reshaping hardware engineering with our advanced foundation model. Our mission is to enhance the hardware design process by leveraging innovations in semiconductors and AI. As a...

  • Backend Software Engineer

    4 months ago

    Palo Alto, United States Acceler8 Talent Full time

    Backend Software EngineerIntroduction: Are you a skilled Backend Software Engineer looking to make an impact in a cutting-edge environment? Join our dynamic team, where we are reshaping hardware engineering with our advanced foundation model. Our mission is to enhance the hardware design process by leveraging innovations in semiconductors and AI. As a...

  • Founding Engineer, Machine Learning

    1 week ago

    Palo Alto, United States Lanai Software Full time

    About LanaiLanai Software is at the forefront of the GenAI revolution, empowering humans to achieve the extraordinary in the age of AI. Lanai's AI platform empowers large organizations and employees to discover, protect, and accelerate AI adoption, fostering innovation and unlocking unprecedented productivity. Backed by top investors, we're creating a world...

  • Principal Software Development Engineer

    3 weeks ago

    Palo Alto, United States Amadeus Full time

    Principal Software Development Engineer (m/f/d)Job Title: Principal Software Development Engineer (m/f/d)You probably think that working for an online travel agency that manages hundreds of millions of bookings per year or working for an airline that operates hundreds of thousands of flights per year must bring their fair share of challenges. If so, just try...

  • Embedded Software Engineer

    1 month ago

    Palo Alto, United States Axiom Software Solutions Limited Full time

    Job Title : Embedded Software Engineer Location : Palo Alto California Fulltime role Look for Ex NVidia / Qualcomm Company Exp Automotive QNX The following skills are critical: Resume should have explicit mention on the following: Strong experience with QNX RTOS (message passing multithreading memory management etc.). • ...

  • Embedded Software Engineer

    4 weeks ago

    Palo Alto, United States Axiom Software Solutions Limited Full time

    Job Title : Embedded Software Engineer Location : Palo Alto, California Look for Ex- NVidia / Qualcomm Company Exp + Automotive + QNX The following skills are critical: Resume should have explicit mention on the following: Strong experience with QNX RTOS (message passing, multithreading, memory management, etc.). • Experience with DDS middleware (e.g.,...

  • Senior LLM Researcher

    1 week ago

    Palo Alto, United States Fastino Full time

    Introduction: Are you ready to redefine the possibilities of AI and machine learning? Join us at Fastino as we pioneer the next generation of language models. Our team, boasting alumni from Google Research, Stanford, Cambridge, and Berkeley, is on a mission to develop specialized, efficient AI systems. If you're passionate about groundbreaking technology...

  • Principal Engineer, Infrastructure Software for AI

    5 days ago

    Palo Alto, United States SB Telecom America Corp. Full time

    Company Description:SB Telecom America Corp. offers innovative technology solutions to drive business growth and success. As part of the SoftBank Group, we focus on AI, IoT, Security, and Digital Marketing to create new business values for our clients. Our digital marketing services cater to the Japanese market with bilingual experts in the U.S. and...

  • Senior/Lead Software Engineer

    3 weeks ago

    Palo Alto, United States Aitopics Full time

    Senior/Lead Software Engineer - AI AgentsJob Category: Software EngineeringAbout SalesforceWe’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a...

  • Principal Engineer, Infrastructure Software for AI

    3 weeks ago

    palo alto, United States SB Telecom America Corp. Full time

    Company Description:SB Telecom America Corp. offers innovative technology solutions to drive business growth and success. As part of the SoftBank Group, we focus on AI, IoT, Security, and Digital Marketing to create new business values for our clients. Our digital marketing services cater to the Japanese market with bilingual experts in the U.S. and...

  • Principal Engineer, Infrastructure Software for AI

    3 weeks ago

    palo alto, United States SB Telecom America Corp. Full time

    Company Description:SB Telecom America Corp. offers innovative technology solutions to drive business growth and success. As part of the SoftBank Group, we focus on AI, IoT, Security, and Digital Marketing to create new business values for our clients. Our digital marketing services cater to the Japanese market with bilingual experts in the U.S. and...

  • Principal Engineer, Infrastructure Software for AI

    3 weeks ago

    Palo Alto, United States SB Telecom America Corp. Full time

    Company Description:SB Telecom America Corp. offers innovative technology solutions to drive business growth and success. As part of the SoftBank Group, we focus on AI, IoT, Security, and Digital Marketing to create new business values for our clients. Our digital marketing services cater to the Japanese market with bilingual experts in the U.S. and...

  • Senior Software Engineer, Amazon

    3 weeks ago

    Palo Alto, United States Amazon Full time

    Our mission for Search Assistance is to help customers express their intents and navigate them to the right Amazon destinations worldwide (WW). We own three customer-facing features on all devices types WW: Autocomplete, Spelling Correction, and Related Searches. When customers place their cursor on the search bar before typing, we help them pick up from...

  • Senior/Lead Software Engineer

    3 weeks ago

    Palo Alto, United States salesforce Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category: Software EngineeringAbout SalesforceWe’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every...

  • Software Development Engineer, Search, Innovation Pioneer

    1 month ago

    Palo Alto, California, United States Amazon Full time

    We're seeking a pioneering software development engineer to join our team at Amazon, where we're working to improve shopping using conversational capabilities of large language models. As a member of our dynamic team, you'll work with talented scientists, engineers, and technical program managers to innovate on behalf of our customers.Key...

  • Senior/Lead Software Engineer

    3 weeks ago

    Palo Alto, United States Salesforce, Inc. Full time

    Senior/Lead Software Engineer - AI AgentsRemote Type: Office Tech-FlexibleLocations: California - Palo Alto, California - San FranciscoTime Type: Full timePosted On: Posted 7 Days AgoJob Requisition ID: JR270612To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating...

  • Staff AI/ML Engineer, Software Vehicle

    4 weeks ago

    Palo Alto, United States Rivian Full time

    About Rivian Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract. As a company, we constantly challenge what's possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and...

  • Software Engineer

    4 weeks ago

    Palo Alto, United States Gauss Labs Full time

    As a Gaussian Software & Platform Engineer, you will be responsible for leading the architecture, design, development and launch of some of the core software products. You will be working with other passionate and talented Software Engineers and Applied Scientists and have opportunities to learn various machine learning algorithms and gain insights around...

  • Principal Cloud Reliability Engineer with Luma AI

    1 month ago

    Palo Alto, California, United States lever - ATS Full time

    Job SummaryWe are seeking a highly skilled Principal Cloud Reliability Engineer to join our team at Luma AI. As a key member of our Infrastructure and Research teams, you will be responsible for ensuring the health and scalability of our GPU clusters.Key ResponsibilitiesCollaborate with researchers and engineers to specify the availability, performance,...