GenAI Systems Evaluation Engineer

5 days ago


San Diego, California, United States Qualcomm Full time
Job Summary:

Qualcomm AI Research is seeking a talented machine learning algorithm evaluation engineer to enable embedded deep learning. As a member of our team, you will work with world-class engineers to evaluate ML software tools and algorithms to ensure they meet quality standards. You will collaborate with members of the software teams and plan a comprehensive evaluation approach. You will be responsible for developing a deep understanding of the ML algorithms developed in the project. You will apply tools and algorithms on wide variety of use cases, develop best practices, provide detailed analysis, extend research, and identify areas for further optimization.

Key Responsibilities:

Develop and implement evaluation strategies for ML software tools and algorithms. Collaborate with software teams to plan and execute comprehensive evaluation approaches. Develop and maintain a deep understanding of ML algorithms and their applications. Apply tools and algorithms on a wide variety of use cases. Develop best practices and provide detailed analysis. Extend research and identify areas for further optimization. Work with cross-functional teams to ensure quality standards are met. Stay up-to-date with the latest advancements in ML and related technologies.

Requirements:

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field. Great at software development with excellent analytical, development, and debugging skills. Strong understanding of Machine Learning fundamentals. Understanding of generative AI and its usage in various applications. Knowledge of machine learning libraries such as TensorFlow, PyTorch is essential. Excellent interpersonal, written, and oral communications skills.

Preferred Skills:

MS or PhD in Computer Science/Engineering with 1+ years of professional experience or equivalent experience. 2+ years of proven experience in software development for machine learning or high-performance computing with strong programming skills in Python and software design. Proficiency in designing, implementing and training DL/RL algorithms in high-level languages/frameworks (PyTorch and TensorFlow). Strong background in at least one of the following fields: Large Language models; Diffusion models; Model compression / quantization / optimization for embedded devices; Computer vision; Audio and speech / NLP; Deep Generative. Experience with improving efficiency of AI algorithms for deployment, including familiarity with open source solutions such as Qualcomm Innovation Center's AI Model Efficiency Toolkit (

). LLM or Diffusion model training, finetuning.

What We Offer:

Competitive annual discretionary bonus program. Opportunity for annual RSU grants. Highly competitive benefits package.

How to Apply:

Apply through Qualcomm Careers website.

Equal Opportunity Employer:

Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.

  • San Diego, California, United States Qualcomm Full time

    Job Title: GenAI Systems Evaluation Engineer Job Summary: Qualcomm AI Research is seeking a talented GenAI Systems Evaluation Engineer to join our team. As a key member of our team, you will be responsible for evaluating machine learning software tools and algorithms to ensure they meet quality standards. You will work with world-class engineers to develop...


  • San Francisco, California, United States Genai Works Full time

    About the TeamAt Genai Works, our Applied team is dedicated to safely bringing cutting-edge technology to the world. We've released groundbreaking products like ChatGPT, Plugins, DALL·E, and APIs for GPT-4, GPT-3, embeddings, and fine-tuning. Our team also manages large-scale inference infrastructure, with a focus on responsible use and safe deployment.Our...


  • San Francisco, California, United States Swiss Education Company GmbH Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our GenAI Safety and Evaluation product team at Scale AI. As a key member of our team, you will be responsible for building a customer-facing model evaluation platform using AI technologies.Key ResponsibilitiesDesign and develop scalable and efficient backend and frontend code...

  • Research Engineer

    4 weeks ago


    San Francisco, California, United States Genai Works Full time

    Job Description**About Genai Works**Genai Works is a leading innovator in AI-powered search solutions. We are seeking an experienced Research Engineer to join our team and contribute to the development of cutting-edge large-scale language models.Key Responsibilities**Lead Model Development**: Design and implement state-of-the-art tradeoffs between model...


  • San Francisco, California, United States Genai Works Full time

    About the Team**Mission-Driven Team**The Genai Works Safety Systems team is responsible for developing and implementing cutting-edge safety solutions to ensure our AI models are deployed safely and responsibly. We are at the forefront of Genai Works' mission to build and deploy safe artificial general intelligence (AGI), driving our commitment to AI safety...


  • San Francisco, California, United States Genai Works Full time

    About the RoleWe are seeking an experienced Machine Learning Engineer to join our team at Genai Works. As a key member of our engineering team, you will be responsible for designing and implementing cutting-edge machine learning algorithms and methodologies for search and retrieval applications.Key Responsibilities:Develop and deploy production-ready machine...

  • Product AI Engineer

    2 weeks ago


    San Francisco, California, United States Genai Works Full time

    About Genai WorksGenai Works is a cutting-edge technology company that aims to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.Job DescriptionWe are seeking a highly skilled Product AI Engineer to join our team. As a Product AI Engineer, you will be responsible for leveraging our models and...


  • San Francisco, California, United States Genai Works Full time

    Job DescriptionRelyance AI is seeking a highly skilled Senior Software Engineer, ML to join our team. As a key member of our engineering team, you will play a critical role in designing, building, and executing cutting-edge machine learning and natural language processing solutions.Key Responsibilities:Strategy Development: Develop data-driven insights to...


  • San Francisco, California, United States Genai Works Full time

    Genai Works is on the lookout for a skilled Research Engineer to influence the evolution of large-scale language models (LLMs) that drive our innovative solutions. If you are passionate about advancing AI technologies and making a substantial contribution, this position is tailored for you.Key Responsibilities:Oversee initiatives that balance cutting-edge...


  • San Francisco, California, United States Genai Works Full time

    About the RoleWe are seeking a highly experienced and skilled Director, ML Pre-Sales Engineering to join our team at Genai Works. As a key member of our organization, you will be responsible for leading a team of machine learning solution engineers and driving the development of our pre-sales strategy.Key ResponsibilitiesTeam Leadership: Lead a team of...


  • San Francisco, California, United States Genai Works Full time

    About the RoleAt Genai Works, we're seeking an experienced Senior Software Engineer to join our Financial Engineering team. As a key member of our team, you will be responsible for architecting and refining our billing systems to meet the demands of our complex and expansive product offerings.Key ResponsibilitiesDesign and develop the next generation of...


  • San Francisco, California, United States Genai Works Full time

    Company OverviewGenai Works is a pioneering AI organization dedicated to revolutionizing human-machine communication through natural language processing. We empower developers with access to an advanced voice AI platform, offering models for speech recognition, speech synthesis, and language comprehension through a simple API integration. From voice...


  • San Francisco, California, United States Genai Works Full time

    About the TeamThe Genai Works Safety Systems team is responsible for ensuring the safe deployment of our AI models to benefit society.We are at the forefront of our mission to build and deploy safe Artificial General Intelligence (AGI), driving our commitment to AI safety and fostering a culture of trust and transparency.As we deploy cutting-edge AI models...


  • San Jose, California, United States Adobe Full time

    About the RoleWe are seeking an exceptional Senior Engineering Manager, Creative and GenAI Enterprise to lead the development, planning, and delivery of products that span genAI features and products, creative workflows, APIs, and shims, customization of GenAI Firefly models, etc.Key ResponsibilitiesLead engineering strategy, management, and...


  • San Francisco, California, United States Genai Works Full time

    Company OverviewGenai Works is at the forefront of AI innovation, dedicated to enhancing human-machine communication through advanced natural language processing. We empower developers with access to a cutting-edge voice AI platform, offering powerful models for speech recognition, voice synthesis, and language understanding through a simple API interface....


  • San Francisco, California, United States Genai Works Full time

    Company OverviewGenai Works is an innovative AI organization dedicated to revolutionizing human-machine communication through natural language processing. We empower developers with access to a cutting-edge voice AI platform, providing tools for speech recognition, voice synthesis, and language understanding through simple API integrations. Our solutions...


  • San Francisco, California, United States Genai Works Full time

    Company OverviewGenai Works is a pioneering AI organization dedicated to revolutionizing human-machine communication through natural language processing. We empower developers with access to an advanced voice AI platform, providing tools for speech recognition, voice synthesis, and language understanding via a simple API integration. From transcription...


  • San Francisco, California, United States Genai Works Full time

    Company OverviewGenai Works is a pioneering AI organization dedicated to revolutionizing human-machine communication through natural language processing. We empower developers with access to an advanced voice AI platform, offering capabilities such as speech recognition, voice synthesis, and language understanding through a simple API interface. From...

  • AI Research Scientist

    1 month ago


    San Francisco, California, United States Genai Works Full time

    Company OverviewGenai Works is an innovative AI organization dedicated to revolutionizing human-machine communication through natural language processing. We empower developers with access to a cutting-edge voice AI platform, enabling seamless integration of models for speech recognition, voice synthesis, and language understanding via simple API calls. Our...

  • Principal Engineer

    2 weeks ago


    San Mateo, California, United States Currency Cloud Full time

    About the RoleWe are seeking a highly skilled Principal Engineer to join our GenAI Knowledge Assets team. As a key member of our team, you will play a critical role in driving the technical vision and direction of our GenAI solutions.You will work closely with cross-functional teams, including Cybersecurity, AI as a Service, and Business teams, to design and...