Software Engineer, ML Product Evaluation Engineering

2 days ago


Cupertino CA United States Apple Inc. Full time
Software Engineer, ML Product Evaluation Engineering

Machine Learning and AI

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. Here, you’ll do more than join something — you’ll add something

As part of Apple Intelligence, this team is at the forefront of the next revolution in machine learning and Generative AI. We are dedicated to creating groundbreaking conversational assistant technologies for both large-scale systems and new client devices, building upon our legacy of intelligent assistant solutions that already assist millions of users worldwide. Does the opportunity to play a part in building groundbreaking technology for large-scale systems, natural language and artificial intelligence excite you? Do you want to expand the experience of Siri and other AIML products to new products that will help millions get things done, across the globe? Join the ML Systems Evaluation Engineering (MLSEE) team at Apple and contribute to a highly accomplished team that evaluates AIML products, that will delight and inspire millions of people

Description

We are seeking a talented and motivated software developer to join our Machine Learning Systems Evaluation Engineering team. In this role, you will be responsible for building and maintaining simulation environments that allow us to evaluate our AI assistant products at scale. Your primary focus will be on developing tools and frameworks to simulate user interactions and personal context, enabling us to test and refine our AI models and product integration in realistic scenarios. This position is ideal for developers who are passionate about quality, enjoy creating scalable simulation systems, and are eager to contribute to the success of cutting-edge AI products. While this role involves aspects of testing, it is not a traditional SDET position; instead, it emphasizes software development with a focus on creating robust simulation environments that push the boundaries of AI performance and reliability. If you have a strong background in software development and a keen interest in simulation and quality, we would love to hear from you.

Minimum Qualifications

  • 5+ years of professional experience in software development, with a strong emphasis on designing, implementing, and optimizing large-scale data and compute-intensive Frameworks / APIs, and tools.
  • Strong software engineering skills, including system design, development, testing, debugging, release and maintenance.
  • Proven expertise in Swift or Obj-C (required). Python (desired) and at least one other object-oriented programming language (e.g., C++, C#, Java).
  • Deep understanding of automated software testing methodologies and lifecycle, including integration testing, component mocking, and dependency injection.
  • Ability to collaborate in a fast-paced, cross-functional environment.
  • Strong organizational skills and experience working with multiple stakeholders.
  • Excellent communication and documentation skills.

Preferred Qualifications

  • Knowledge of statistics based evaluation approaches, ML training pipelines and accuracy improvements of ML systems.
  • Experience on delivering APIs/Frameworks that have been used with production environments and customers.
  • Exposure to model development lifecycle, including data preprocessing, model training, evaluation, deployment, and monitoring.
  • BS/MS in Computer Science or related field.

Additional Requirements

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,800 and $312,200, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.

#J-18808-Ljbffr

  • Cupertino, CA, United States Apple Inc. Full time

    AIML - Senior Manager, ML Product Evaluation Engineering Machine Learning and AI Would you like to play a part in shipping groundbreaking technology for large-scale systems, natural language, and artificial intelligence? Join the Siri ML Systems Evaluation Engineering (MLSEE) team at Apple! We interact with various engineering teams to identify issues and...


  • Cupertino, United States Apple Inc. Full time

    AIML - Software Development Automation Engineering Lead, ML Systems Evaluation EngineeringDoes the opportunity to play a part in building groundbreaking technology for large-scale systems, natural language and artificial intelligence excite you? Do you want to expand the experience of Siri and other AIML products to new products that will help millions get...


  • Cupertino, CA, United States Apple Full time

    AIML - Senior Front End Platform Engineer - Full Stack, ML Systems and Evaluation Engineering Cupertino, California, United States Machine Learning and AI Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result...


  • Cupertino, California, United States Apple Full time

    Job DescriptionAs a Performance Framework Software Engineer at Apple, you will be responsible for designing and implementing automation and performance frameworks for evaluating scalable performance measurements of machine learning-based products. Your expertise in Swift, Python, and XC test will be utilized to develop tools, APIs, and infrastructure for...


  • Cupertino, CA, United States Apple Inc. Full time

    Do you want to play a part in building groundbreaking technology for large-scale systems, natural language, big data, and artificial intelligence? Join the AIML team at Apple and help us improve the user experience of Siri and other AIML products, helping millions of people get things done across the globe! Description In this senior leadership role, you...


  • Cupertino, CA, United States Apple Full time

    AIML - Senior ML Engineering Manager, Evaluation & Analytics Cupertino, California, United States Machine Learning and AI We are seeking a Senior Machine Learning Manager with a proven track record of leading projects in cross-functional and interdisciplinary settings, along with strong technical expertise. Your highly skilled team will be responsible for...


  • Cupertino, California, United States Apple Full time

    Craft Revolutionary ML Experiences for Apple WatchAbout UsAt Apple, innovation is the driving force behind everything we do. Our team of talented engineers and innovators work together to create products that change the world. As a senior software engineer on our watchOS team, you will be part of a small group working to prototype and ship ML-powered...


  • Cupertino, CA, United States Apple Inc. Full time

    Do you want to play a part in building groundbreaking technology for large-scale systems, natural language, big data, and artificial intelligence? Join the AIML team at Apple, and help us as we improve the user experience of Siri and AIML products, helping millions of people get things done across the globe! Description In this senior technical leadership...

  • Software Engineer

    4 days ago


    Cupertino, United States Meta Inc Full time

    Software Engineer - ML Systems (Technical Leadership) Apply to this job Location pin icon Sunnyvale, CA Bellevue, WA Menlo Park, CA Seattle, WA Burlingame, CA New York, NY 5 more - Hide Apply to this job Meta is seeking an AI Software Engineer to join our Research & Development teams. The ideal candidate will have industry experience working on AI...


  • Cupertino, CA, United States Apple Full time

    Machine Learning Engineer, Developer Productivity Cupertino, California, United States Software and Services Our team of applied ML scientists and engineers works to enhance the experience and productivity of software developers at Apple and in the Apple developer ecosystem. Our team trains state-of-the-art ML models and applies them in products to solve...


  • Cupertino, California, United States Apple Inc. Full time

    Job Title: ML Engineer for Scalable AI SystemsWe are seeking a talented Machine Learning Engineer to design, develop, and maintain scalable systems for evaluation and continuous optimization in support of Apple Intelligence products.Company Overview:At Apple Inc., we are committed to innovation and excellence. Our team is dedicated to shaping the future with...

  • Software Engineer

    21 hours ago


    Sunnyvale, CA, United States Apple Inc. Full time

    Software Engineer (AI/ML), Ai & Data Platforms The people here at Apple don’t just build products — we craft the kind of wonder that’s revolutionized entire industries. It’s the diversity of those people and their ideas that supports the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts....


  • Cupertino, CA, United States Apple Inc. Full time

    Machine Learning Engineer, Developer Productivity Our team of applied ML scientists and engineers works to enhance the experience and productivity of software developers at Apple and in the Apple developer ecosystem. Our team trains state-of-the-art ML models and applies them in products to solve real-world problems. We’re looking for talented and...


  • Cupertino, CA, United States Apple Inc. Full time

    Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the...


  • Cupertino, California, United States Apple Inc. Full time

    AIML-Sr. Machine Learning Engineer, MeasurementAre you ready to shape the future with cutting-edge technology? As a Senior Machine Learning Software Engineer, you'll have the opportunity to design, develop, and deploy intelligent systems that solve real-world problems and redefine possibilities. In this role, you'll harness the power of data to build...

  • Software Engineer

    20 hours ago


    Sunnyvale, CA, United States Apple Full time

    Software Engineer (AI/ML), Ai & Data Platforms Sunnyvale, California, United States Software and Services The people here at Apple don’t just build products — we craft the kind of wonder that’s revolutionized entire industries. It’s the diversity of those people and their ideas that supports the innovation that runs through everything we do, from...


  • San Francisco, CA, United States The Product Folks Full time

    Adobe is the global leader in digital media and digital marketing solutions. Our creative, marketing and document solutions empower everyone – from emerging artists to global brands – to bring digital creations to life and deliver immersive, compelling experiences to the right person at the right moment for the best results. In short, Adobe is...


  • Cupertino, CA, United States Amazon Full time

    Sr. Software Engineer- AI/ML, AWS Neuron Apps Job ID: 2705924 | Amazon.com Services LLC - A57 AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for...


  • McLean, VA, United States JPMorganChase Full time

    JOB DESCRIPTION Bring your Senior Lead Software Engineering - AI/ML skills to the next level where you will achieve state-of-the-art throughput for critical models using advanced techniques like model parallelism and distributed training. You will reduce inference time for new model architectures using optimizations like quantization and pruning. You will...

  • Sr. ML Ops Engineer

    2 days ago


    Los Angeles, CA, United States iLink Digital Full time

    Los Angeles, United States | Posted on 08/13/2024 iLink is a Global Software Solution Provider and Systems Integrator, delivering next-generation technology solutions to help clients solve complex business challenges, improve organizational effectiveness, increase business productivity, realize sustainable enterprise value, and transform their business...