Software Engineering Architect

3 weeks ago

San Francisco, United States salesforce.com, inc. Full time

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category: Software Engineering

About Salesforce:

We're Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good - you've come to the right place.

We are seeking an experienced Salesforce Software Quality Architect with a strong background in SaaS platforms and expertise in evaluating Large Language Models (LLMs). This role requires a deep understanding of Salesforce architecture, software quality assurance, and the ability to assess and optimize LLMs for delivering accurate, safe, and high-quality responses.

As a Quality Architect, you will play a key role in defining, implementing, and maintaining the quality strategy for Salesforce products, with a focus on integrating cutting-edge AI technologies. You will collaborate with cross-functional teams, including product development, data science, and AI teams, to ensure that Salesforce's AI-driven solutions meet the highest quality standards for enterprise applications.

Key Responsibilities:
  • Define Quality Strategies: Develop and implement robust quality strategies for Salesforce's SaaS products, focusing on AI and LLM integrations.
  • Evaluate LLM Performance: Assess and optimize Large Language Models (LLMs) for quality, accuracy, relevance, and safety in various use cases.
  • Testing and Automation: Design test plans and automation frameworks for both traditional software components and LLM-based features, ensuring seamless integration and high performance.
  • Quality Metrics: Establish and track quality metrics, including accuracy, relevance, engagement, and safety of LLM-generated responses.
  • Collaborate on AI Model Improvements: Work closely with data scientists and machine learning engineers to provide feedback on LLM performance and recommend improvements based on quality testing results.
  • SaaS Expertise: Apply your knowledge of Salesforce architecture and SaaS platforms to guarantee high availability, scalability, and user satisfaction in AI-powered applications.
  • Human Evaluation: Oversee human evaluation processes for subjective quality dimensions, such as response engagement, user safety, and contextual accuracy.
  • Drive Innovation & Adoption: Bring structure to the engineering decision-making process by communicating and evaluating solution options, and facilitating agreement among key stakeholders that helps prioritize high-value solutions, driving business impact.
  • Multiplier - Connect the 'Art of the Possible': Provide technical leadership for critical areas that significantly impact customer success, ensuring that best practices are being used.
  • Cross-Platform Collaboration: Use your understanding of customers' needs across industries and multiple technology landscapes to develop solutions across Salesforce's technology stack.
  • Technical Leadership on Proof of Concepts: Influence the direction of R&D through your technical, process, or product knowledge leadership.
  • Mentor and Organization Builder: Engage with senior engineers to develop their expertise and leadership contributions.
Required Skills and Qualifications:
  • Experience in Salesforce: Understanding of Salesforce's architecture, platform features, and integration with AI/ML components.
  • SaaS Expertise: Extensive experience with SaaS platforms, cloud architecture, and enterprise-level software quality assurance.
  • LLM Expertise: Hands-on experience evaluating Large Language Models (LLMs) for quality response, including familiarity with GPT-like models and AI evaluation frameworks.
  • Quality Assurance Leadership: Experience leading quality assurance initiatives for complex software systems, including test automation and performance testing.
  • AI & Machine Learning Knowledge: Strong understanding of AI/ML principles, particularly in evaluating and optimizing model performance, response consistency, and safety.
  • Testing Tools & Frameworks: Familiarity with tools like Selenium, TestNG, JUnit, and other automation frameworks, plus experience with AI/ML testing platforms.
  • Collaboration & Communication: Excellent communication skills, with the ability to work cross-functionally with product managers, AI/ML engineers, and data scientists.
  • Problem-Solving & Analytical Skills: Strong analytical and problem-solving abilities with a focus on identifying quality gaps and driving improvement.
Preferred Qualifications:
  • Experience in ethical AI practices and evaluating models for fairness, bias, and user safety.
  • Knowledge of tools for model interpretability and explainability (e.g., LIME, SHAP).
  • Strong understanding of public cloud infrastructure - AWS/Azure/GCP.
  • Certification in Salesforce.
  • Ability to architect, design, implement, test, and deliver test frameworks for highly scalable products.
Accommodations:

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement:

At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more.

Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status.

Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce.

Salesforce welcomes all.

#J-18808-Ljbffr

  • Software Engineering Architect

    3 weeks ago

    San Francisco, United States Salesforce, Inc. Full time

    Software Engineering Architect Job Category: Software Engineering About Salesforce We’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too...

  • Software Engineering Architect

    3 weeks ago

    San Francisco, United States salesforce Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category: Software EngineeringAbout Salesforce: We’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every...

  • Software Engineering Architect

    3 weeks ago

    San Francisco, United States salesforce Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category: Software EngineeringAbout Salesforce: We’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every...

  • Senior Java Software Architect Position

    3 weeks ago

    San Francisco, California, United States Triunity Software Full time

    Job Description:We are seeking a highly skilled Java Software Architect to join our team at Triunity Software Inc. The ideal candidate will be responsible for designing and implementing scalable, secure, and efficient software systems using Java technology.Key Responsibilities:Design and develop large-scale Java software systemsCollaborate with...

  • Software Architect

    22 hours ago

    San Francisco, United States Salesforce.Com Inc Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category: Software Engineering About Salesforce: We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every...

  • Software Architect

    3 hours ago

    San Francisco, United States Salesforce.Com Inc Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category: Software Engineering About Salesforce: We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every...

  • Senior Software Architect

    4 weeks ago

    San Francisco, California, United States twentyAI Full time

    At twentyAI, we're revolutionizing conversational AI and seeking a Senior Software Architect to drive our technical vision.This role offers a unique opportunity to shape the future of our AI platform, collaborating with talented engineers to design and develop innovative solutions.As a Senior Software Architect, you'll be responsible for:Designing and...

  • Senior Software Architect

    4 weeks ago

    San Francisco, California, United States OneCrew Full time

    We are seeking a highly skilled Senior Software Architect to lead the development of our platform and drive innovation at OneCrew.The ideal candidate will have a strong background in software engineering and experience with cloud-based technologies.Key Responsibilities:Architect and develop scalable and secure software solutionsLead cross-functional teams to...

  • Software Architect

    3 weeks ago

    San Francisco, United States salesforce.com, inc. Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category: Software EngineeringAbout Salesforce:We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry...

  • Software Architect

    3 weeks ago

    San Francisco, United States salesforce Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category: Software EngineeringAbout Salesforce:We’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every...

  • Cloud Software Architect

    56 minutes ago

    San Francisco, California, United States SS & C Advent Full time

    About UsSS&C Advent is a leading provider of investment and financial services, software, and solutions for the global financial services and healthcare industries.We are proud to be named among the top US companies based on revenue, with over 20,000 employees across 35 countries.Job OverviewWe are seeking an experienced Software Engineer to join our team in...

  • Software Architect

    3 days ago

    San Jose, United States TemperaturePro Full time

    TemperaturePro is seeking a highly skilled Software Architect to join our dynamic team. As a Software Architect, you will be responsible for designing and implementing software solutions that meet the needs of our clients and align with our business objectives. You will collaborate with cross-functional teams to ensure that software architecture and design...

  • Senior Software Architect

    4 weeks ago

    San Francisco, California, United States Brightpath Solutions Full time

    Job OverviewBrightpath Solutions is seeking a highly skilled Senior Software Architect to lead the development of AI-driven fintech solutions. This is a unique opportunity to join a dynamic team and contribute to the growth of a innovative company.Key ResponsibilitiesDesign and develop software solutions that leverage AI technology, including Large Language...

  • Enterprise Software Architect

    19 hours ago

    San Francisco, California, United States Rippling Full time

    About RipplingRippling is a cutting-edge technology company that has revolutionized the way businesses manage their workforce by providing a comprehensive platform for HR, IT, and Finance. With its innovative approach, Rippling enables organizations to streamline their operations and make data-driven decisions.Our MissionWe are committed to building a...

  • Software Architect

    1 week ago

    San Diego, United States Programs Management Analytics and Technologies, Inc. Full time

    Software Architect PMAT is seeking a Software Architect to be a key contributor in producing world-class software. This position will support multiple programs, improving existing architectures, developing new capabilities in current systems, and/or developing new external applications that augment overall operational capabilities. You will also be...

  • Software Architect

    5 hours ago

    San Diego, United States Programs Management Analytics and Technologies, Inc. Full time

    Software Architect PMAT is seeking a Software Architect to be a key contributor in producing world-class software. This position will support multiple programs, improving existing architectures, developing new capabilities in current systems, and/or developing new external applications that augment overall operational capabilities. You will also be...

  • Senior Software Engineer

    6 days ago

    San Francisco, United States ZipRecruiter Full time

    About the Company:Our client is a company building the world's highest-performance pure digital AI inference chip. They are seeking a Software Architect to lead their software efforts and advance the software stack that includes ML frameworks, compilers, libraries, and runtime. As a Software Architect, you will be responsible for designing and developing...

  • Principal Software Engineer

    2 weeks ago

    san francisco, United States Understanding Recruitment Full time

    Principal Software EngineerUS Tech start-up - Fully Remote$180k + BenefitsWe're excited to share an opportunity with a fast-growing, heavily-backed live shopping platform based on the West Coast, currently valued at over $100M!They're on the lookout for a Principal Software Engineer with expertise in Full Stack Engineering (React.js/Node.js) and a focus on...

  • Sr. Principal Software Architect

    2 weeks ago

    San Francisco, United States DocuSign, Inc. Full time

    Company OverviewDocusign brings agreements to life. Over 1.5 million customers and more than a billion people in over 180 countries use Docusign solutions to accelerate the process of doing business and simplify people’s lives. With intelligent agreement management, Docusign unleashes business-critical data that is trapped inside of documents. Until now,...

  • Software Engineer

    2 weeks ago

    San Francisco, United States Objective Paradigm Full time

    The mission of the company is to empower businesses to build products and experiences that unlock the full potential of web3 for everyone, eliminating the need for businesses to individually build or piecemeal solutions (such as custody, wallet and user management, on/off-ramp).The solution provided is robust, secure, and compliant infrastructure, aimed at...