Software Engineer, Perception

12 hours ago


San Francisco CA United States Agtonomy Full time

About Us

Agtonomy is pioneering advanced automation and AI solutions to transform agriculture and beyond. Initially focused on specialty crops, our TeleFarmer platform addresses labor-intensive needs with automation, turning conventional equipment into autonomous machines. By partnering with leading manufacturers like Doosan Bobcat, we integrate smart technology into tractors and other machinery, enhancing safety and efficiency. As we expand into ground maintenance and other industrial applications, our expert team continues to address key challenges with labor shortages, sustainability and profitability across various industries.

About the Role

As a Perception / Machine Learning Engineer on the Autonomy Team, you will play a key role in solving challenging perception problems in outdoor vehicle automation. Leveraging your experience, you will implement state-of-the-art ML perception techniques to improve how Agtonomy’s tractors perceive and understand the environments where they operate. You will work closely with embedded, localization, and planning engineers on the team to design and evolve the upstream and downstream interfaces of the perception system. This role is perfect for someone who loves implementing ML to tackle real world problems and is excited about applying their experience to make robots perceive in rugged, agricultural environments.

What You'll Do

  • Applying machine learning to solve challenging perception problems for autonomous systems (e.g. object detection, semantic segmentation, instance segmentation, dense depth, optical flow, tracking, etc.).
  • Driving the architecture, deployment, and performance characterization of our deep learning models.
  • Refining and optimizing models for low-latency inference on embedded hardware.
  • Designing and building cloud-based training and labeling pipelines.
  • Collaborating with the hardware and embedded teams on sensor selection and vehicle packaging given safety requirements.
  • Writing performant, well-tested software, and improving code quality of the entire Autonomy team through code and design reviews.

What You'll Bring

  • 5+ years of experience in software development for problems involving computer vision, machine learning, and robotic perception techniques.
  • Foundational understanding of deep learning: model layer design, loss function intuition, training best practices.
  • Experience handling large datasets efficiently and organizing them for training and evaluation.
  • Experience curating synthetic and real-world image datasets for training.
  • Strong proficiency in modern C++ and Python and experience writing efficient algorithms for resource-constrained embedded systems.
  • Ability to thrive in a fast-moving, collaborative, small team environment with lots of ownership.
  • Excellent analytical, communication, and documentation skills with demonstrated ability to collaborate with interdisciplinary stakeholders outside of Autonomy.
  • An eagerness to get your hands dirty by testing your code on real robots at real customer farms (gives “field testing” a whole new meaning).

What Makes You a Strong Fit

  • Experience architecting multi-sensor ML systems from scratch.
  • Experience with compute-constrained pipelines: optimizing models to balance the accuracy vs. performance tradeoff, leveraging TensorRT, model quantization, etc.
  • Experience implementing custom operations in CUDA.
  • MS or PhD in Robotics, Computer Science, Computer Engineering, or a related field.
  • Publications at top-tier perception/robotics conferences (e.g. CVPR, ICRA, etc.).
  • Passion for sustainable agriculture and electric vehicles.

Salary and Benefits

The US base salary range for this full-time position is $160,000 to $220,000 + equity + benefits + unlimited PTO.

Benefits:

  • 100% covered medical, dental, and vision for the employee (cost plus partner, children, or family is additional)
  • Commuter Benefits
  • Flexible Spending Account (FSA)
  • Life Insurance
  • Short- and Long-Term Disability
  • 401k Plan
  • Stock Options
  • Collaborative work environment working alongside passionate mission-driven folks

Our interview process is generally conducted in five (5) phases:

  1. Phone Screen with People Operations (30 minutes)
  2. Video Interview with the Hiring Manager (45 minutes)
  3. Coding Challenge and Technical Challenge (1 hour with an Autonomy Engineer)
  4. Panel Interview (Video interviews scheduled with key stakeholders, each interview will be 30 to 45 minutes)
  5. Final Interviews (CEO, CFO, VP of Engineering, 30 minutes each)
#J-18808-Ljbffr

  • San Francisco, United States Agtonomy Full time

    About Us Agtonomy is pioneering advanced automation and AI solutions to transform agriculture and beyond. Initially focused on specialty crops, our TeleFarmer platform addresses labor-intensive needs with automation, turning conventional equipment into autonomous machines. By partnering with leading manufacturers like Doosan Bobcat, we integrate smart...


  • San Francisco, United States Sauron Home Full time

    Who We Are Sauron is the home security company of the future. Homeowners today lack compelling options when it comes to peace of mind against vulnerabilities, and total command and control of their home; there is no definitive, protective brand in the space. Leveraging cutting-edge AI, sensor technology, and nonlethal deterrence, Sauron brings...


  • San Francisco, United States Sauron Home Full time

    Who We Are Sauron is the home security company of the future. Homeowners today lack compelling options when it comes to peace of mind against vulnerabilities, and total command and control of their home; there is no definitive, protective brand in the space. Leveraging cutting-edge AI, sensor technology, and nonlethal deterrence, Sauron brings...


  • San Francisco, United States Sauron Home Full time

    Who We Are Sauron is the home security company of the future. Homeowners today lack compelling options when it comes to peace of mind against vulnerabilities, and total command and control of their home; there is no definitive, protective brand in the space. Leveraging cutting-edge AI, sensor technology, and nonlethal deterrence, Sauron brings...


  • San Francisco, United States Bright Machines, Inc. Full time

    RETHINK MANUFACTURINGThe only way to ignite change is to build the best team. At Bright Machines, we’re innovators and experts in our craft who have joined together to create a new category of manufacturing that will help transform the industry. We believe software and data are the answer, thoughtfully applied to solve our customers’ unique challenges....

  • Software Engineer

    14 hours ago


    Boston, MA, United States Zoox Full time

    Zoox is looking for a software engineer to join our Perception team and help us build novel architectures for classifying and understanding the complex and dynamic environments in our cities. In this role, you will have access to the best sensor data in the world and an incredible infrastructure for testing and validating your algorithms. We are creating new...


  • Foster City, CA, United States Zoox Full time

    Zoox is looking for a software engineer to join our Perception team and help us build novel architectures for classifying and understanding the complex and dynamic environments in our cities. In this role, you will have access to the best sensor data in the world and an incredible infrastructure for testing and validating your algorithms. We are creating new...


  • San Francisco, United States Hayden AI Full time

    About UsAt Hayden AI, we are on a mission to harness the power of artificial intelligence and machine learning to transform the way governments and businesses address real-world challenges.From optimizing bus lane and bus stop enforcement to pioneering digital twin modeling and beyond, our innovative mobile perception system empowers our clients to...

  • Perception Engineer

    2 days ago


    San Francisco, United States Unreal Gigs Full time

    Are you passionate about giving machines the ability to see, interpret, and interact with their environments? Do you excel at developing perception algorithms that enable robots and autonomous systems to understand and navigate complex surroundings? If you're ready to design the "eyes and brain" of intelligent systems, our client has the perfect role for...

  • Perception Engineer

    1 week ago


    San Francisco, United States Unreal Gigs Full time

    Are you passionate about giving machines the ability to see, interpret, and interact with their environments? Do you excel at developing perception algorithms that enable robots and autonomous systems to understand and navigate complex surroundings? If you're ready to design the "eyes and brain" of intelligent systems, our client has the perfect role for...


  • San Francisco, California, United States Sauron Home Full time

    About Sauron HomeSauron Home is a pioneering home security company that combines cutting-edge AI, sensor technology, and nonlethal deterrence to provide homeowners with peace of mind and total command and control of their homes.With an $18M seed round from leading venture capital firms and angel investors, we're building the new perception system for the...


  • San Mateo, United States Zoox Full time

    Zoox is looking for a software engineer to join our Perception teamand help us build novel architectures for classifying and understanding the complex and dynamic environments in our cities. In this role, you will have access to the best sensor data in the world and an incredible infrastructure for testing and validating your algorithms. We are creating new...

  • Perception Engineer

    4 weeks ago


    Tucson, AZ, United States Insight Recruitment Full time

    Machine Learning / Perception EngineerWe are looking for a Perception/ML Engineer to develop advanced off-road navigation systems for autonomous ground vehicles capable of navigating complex terrains.Following successful Seed-stage investment and contract wins, the company are scaling production and looking to double their team size over the next 12...


  • Ann Arbor, MI, United States May Mobility Full time

    Job SummaryMay Mobility is entering an exciting phase of growth as we expand our first-of-its-kind autonomous shuttle and mobility services across the nation. Launched in 2017 with a strong team of experienced roboticists, perception, behavior, AI, and software engineers with decades of experience fielding robotic systems in the wild, May Mobility is looking...

  • Perception Engineer

    6 days ago


    South San Francisco, United States AeroVect Full time

    Who We Are AeroVect is transforming ground handling with autonomy, redefining how airlines and ground service providers around the globe run day-to-day operations. We are a Series A company backed by top-tier venture capital investors in aviation and autonomous driving. Our customers include some of the world's largest airlines and ground handling providers....

  • Perception Engineer

    6 days ago


    South San Francisco, United States AeroVect Full time

    Who We Are AeroVect is transforming ground handling with autonomy, redefining how airlines and ground service providers around the globe run day-to-day operations. We are a Series A company backed by top-tier venture capital investors in aviation and autonomous driving. Our customers include some of the world's largest airlines and ground handling providers....

  • Software Developer

    2 days ago


    San Mateo, United States Zoox Full time

    Zoox is looking for a software developer engineer in test with a strong verification and validation background to lead the development of sensor-degradation analysis pipelines to support fault-tolerance and platform stability. As an engineer on the System Design and Mission Assurance (SDMA) team, you will collaborate closely with perception, software,...


  • San Francisco, United States OpenAI Full time

    About the Team The Perception team is responsible for the "perception" capabilities in all flagship models like GPT-4o, enabling them to understand the world beyond text inputs and to predict or act with human-level accuracy. Our goal is to advance the frontier of perception through rigorous scientific research and high-performance engineering, accelerating...


  • San Mateo, United States Zoox Full time

    We are seeking a highly skilled software engineer to design and develop tools that support and facilitate AI model development for the Perception component of our autonomous driving stack. In this role, you will work closely with Machine Learning engineers, data scientists, and software engineers to build scalable and high-performance applications that...

  • Software Engineer

    2 days ago


    Los Angeles, CA, United States Software Resources Full time

    We are looking for Software Engineer for our client located in West Los Angeles/Century City area.This position is mostly REMOTE but you will be required to come into the West Los Angeles office 1 to 4 times a month. We could consider a completely remote candidate in another state if they meet our requirements. Duration : 6 to 12 months with the potential to...