Machine Learning Optimization Specialist

3 weeks ago


New York, New York, United States Jane Street Full time

About Us

">

Jane Street is a global financial services company that relies heavily on machine learning to drive its business. Our trading environment is a unique platform for rapid experimentation and innovation, allowing us to incorporate new ideas quickly.

">

The Role

">

We are seeking an experienced engineer to join our growing ML team. As a Machine Learning Performance Engineer, you will be responsible for optimizing the performance of our models, both during training and inference.

">

Your Focus

">

Your primary focus will be on improving the efficiency of large-scale training, reducing latency in real-time systems, and increasing throughput in research environments. You will need to consider all aspects of the system, from storage and networking to host- and GPU-level considerations.

">

Technical Requirements

">
  • A strong understanding of modern ML techniques and toolsets is essential.
  • You should have experience debugging training runs end-to-end, as well as low-level knowledge of PTX, SASS, warps, cooperative groups, Tensor Cores, and the memory hierarchy.
  • Familiarity with libraries like Triton, CUTLASS, CUB, Thrust, cuDNN, and cuBLAS is also necessary.
  • An intuitive understanding of latency and throughput characteristics, particularly in CUDA graph launch, tensor core arithmetic, warp-level synchronization, and asynchronous memory loads, is crucial.
  • Background in Infiniband, RoCE, GPUDirect, PXN, rail optimization, and NVLink is highly desirable.
  • Experience with distributed GPU training using NCCL or MPI is also important.
  • A willingness to ask questions about our approaches and tools is essential.
  • Fluency in English is required.
">

Compensation

">

We offer a competitive salary of $**$120,000-$180,000 per annum**, commensurate with experience, plus additional benefits and incentives.

">

Benefits

">

We strive to provide a supportive work environment that allows our employees to grow professionally and personally. Some benefits include health insurance, retirement plans, flexible working hours, and opportunities for professional development.

">

Estimated Salary Range: $120,000 - $180,000/year

">

We aim to create a diverse and inclusive workplace where everyone feels valued and supported. We welcome applications from qualified individuals regardless of their background or circumstances.



  • New York, New York, United States Tik Tok Full time

    Job OverviewTikTok is a leading short-form mobile video platform, committed to inspiring creativity and bringing joy to its global audience. As an AI expert in targeted advertising, you will play a key role in developing state-of-the-art machine learning projects to help advertisers reach their desired audience effectively.About the RoleThis position...


  • New York, New York, United States NYU McSilver Institute for Poverty Policy and Research Full time

    We are seeking a talented Machine Learning Specialist to join our research team at the NYU McSilver Institute for Poverty Policy and Research. The successful candidate will be responsible for developing and deploying machine learning models that address poverty and related challenges.This is an excellent opportunity to contribute to cutting-edge research and...


  • New York, New York, United States Figma Full time

    Figma is a leader in the design software industry, and we are seeking an experienced Machine Learning Specialist to join our team. As a Machine Learning Specialist, you will play a key role in developing and deploying AI models that enhance our product offerings.Job Description:We are looking for a skilled Machine Learning Specialist with expertise in...


  • New York, New York, United States Georgia IT Inc Full time

    Job Summary: We are seeking a highly skilled Data Engineer and Machine Learning Specialist to join our team at Georgia IT Inc. in NYC. As a Data Engineer, you will design and implement data warehousing and data lake solutions using ETL and data ingestion techniques. You will also develop and maintain large-scale data processing systems using PySpark and...


  • New York, New York, United States Hugging Face Full time

    Company Overview: Hugging Face is a leading platform for AI builders, with over 5 million users and 100k organizations who share models, datasets, and apps. Our open-source libraries have gained popularity on GitHub.About the Role: As a Machine Learning Optimization Strategist, you will educate the community on accelerating training and inference workloads,...


  • New York, New York, United States Persona Full time

    Pursue a challenging opportunity as an AI Engineer at Persona, where you will design and develop innovative machine learning solutions for identity verification and fraud prevention.About the JobAs an AI Engineer, you will be responsible for creating and deploying machine learning models that can handle complex tasks such as image recognition, natural...


  • New York, New York, United States Hugging Face Full time

    Hiring for this position is ongoing, and we're seeking a talented Machine Learning Specialist to join our team. As a key member of our engineering team, you will play a critical role in improving the open-source machine learning ecosystem.Job DescriptionYou will mainly work with existing open-source libraries, such as Transformers, Datasets, or Accelerate,...


  • New York, New York, United States Firsthand Full time

    About FirsthandFirsthand is the driving force behind the next generation of AI-powered conversations. Our cutting-edge AI platform is designed to empower publishers and brands to protect, control, and deploy their data effectively, ensuring seamless integration with direct conversational campaigns. Founded by industry pioneers and backed by visionary...


  • New York, New York, United States Output Services Full time

    Machine Learning EngineerWe are seeking an experienced Machine Learning Engineer to join our team at Output Services. This is a challenging and rewarding role that requires strong technical skills and a passion for developing innovative solutions.Our CultureAt Output Services, we foster a culture of ownership and excellence. We believe in making a tangible...


  • New York, New York, United States Enigma Full time

    **Job Description:** Machine Learning Infrastructure SpecialistEnigma is seeking a highly skilled Machine Learning Infrastructure Specialist to join our growing team. As a Machine Learning Infrastructure Specialist, you will be responsible for building reusable frameworks and tooling that accelerate innovation.The ideal candidate will have 4+ years of...


  • New York, New York, United States American Express Full time

    About the CompanyAmerican Express is a global service company that provides its customers with a range of products and services designed to make their lives easier and more rewarding.Job SummaryWe are seeking a Senior Machine Learning Engineer to join our team in New York. This role will be responsible for building and deploying machine learning models in...


  • New York, New York, United States A Place For Mom Full time

    About the RoleWe are looking for a highly motivated Data Driven Engineer to join our team at A Place for Mom. The successful candidate will have a strong background in machine learning, with experience working with large datasets and developing efficient models.The role involves designing and developing machine learning systems, solving complex problems with...


  • New York, New York, United States Output Services Full time

    About the RoleWe are looking for a Senior Machine Learning Specialist to join our team at Output Services. As a key member of our AI team, you will be responsible for developing and implementing cutting-edge machine learning models for biological applications.Key ResponsibilitiesDesign and develop novel machine learning algorithms for biological...


  • New York, New York, United States Harnham Full time

    About the CompanyHarnham is partnering with a company that is leading the charge in transforming industries by using sensor technology to connect AI agents with everyday objects. Their product has broad applications across many product-based industries.The company is looking for an experienced Machine Learning Engineer who is eager to work on the latest...


  • New York, New York, United States Recroot Full time

    What You'll Do:\You will be responsible for developing and integrating scalable machine learning models into production systems, collaborating with cross-functional teams to identify AI integration opportunities, optimizing and deploying machine learning models, and staying updated on the latest AI/ML trends, tools, and technologies.\Your Key...


  • New York, New York, United States Fireworks AI Full time

    Job DescriptionAs a Backend Software Engineer at Fireworks AI, you will be responsible for building, scaling, and optimizing enterprise-grade Machine Learning systems using PyTorch and Vertex AI. You will work on developing innovative research projects, such as function calling and multi-modal models, and contribute to our goal of becoming the fastest LLM...


  • New York, New York, United States Tekfortune Inc Full time

    Job Summary:We are seeking an experienced Machine Learning Engineer Specialist to join our team in New York, NY - 10055 (Remote Work from Home) on a 12+ Months Contract basis. The ideal candidate will have a deep understanding of machine learning algorithms, including supervised and unsupervised techniques.About the Job:The successful candidate will work...


  • New York, New York, United States Disability Solutions Full time

    Company OverviewPeloton is a pioneering force in the fitness industry, revolutionizing the way people experience exercise and wellness. With a focus on innovation and customer satisfaction, we are dedicated to helping individuals and communities achieve their goals and unlock their full potential.As a leader in the industry, we are constantly pushing the...


  • New York, New York, United States Genentech Full time

    Job DescriptionThe OpportunityAt Genentech Computational Sciences (gCS) Prescient Design, we are revolutionizing drug discovery with cutting-edge machine learning techniques. As an Advanced Machine Learning Specialist, you will be part of a dynamic team that develops large-scale, distributed machine learning algorithms and systems to transform the drug...


  • New York, New York, United States Current Full time

    About the RoleWe're seeking an experienced Data Scientist Lead to join our team at Current. As a key member of our data science team, you'll be responsible for designing, developing, and deploying machine learning models and algorithms using VertexAI. You'll work closely with our engineering teams to integrate machine learning models into production systems...