Current jobs related to Software Engineer, Inference - Seattle - Tik Tok


  • Seattle, Washington, United States Apple, Inc. Full time

    About the RoleWe are seeking a highly skilled Machine Learning Engineer to join our team at Apple, Inc. as a Co-Design Engineer. As a key member of our Machine Learning and Platforms Technology (MLPT) team, you will be responsible for designing and developing the inference stack that runs all Machine Learning networks on Apple Silicon.Key...


  • Seattle, Washington, United States Amazon Web Services (AWS) Full time

    About the RoleWe are seeking a highly skilled Machine Learning Applications Software Engineer to join our team at Amazon Web Services (AWS). As a key member of our team, you will be responsible for developing, enabling, and performance tuning of a wide variety of machine learning model families.Key ResponsibilitiesDevelop and Optimize Distributed Inference...


  • Seattle, Washington, United States Oracle Full time

    Job OverviewJoin our Artificial Intelligence (AI) Frameworks & Customer Readiness team, where we focus on identifying and alleviating developer and operational challenges associated with Oracle Cloud Infrastructure's (OCI) GPU utilization. Our mission is to incubate and create AI software that simplifies the onboarding, execution, monitoring, and management...


  • Seattle, Washington, United States Intelliswift Software Full time

    Compensation: Pay rate range - $55/hr. to $58/hr. on W2Essential Qualifications:Proficient experience in software development with technologies such as Java, JavaScript, JavaBean, and React Native.A minimum of 2 years of professional experience is required.Core Leadership Principles:Focus on delivering results, taking ownership, demonstrating a bias for...

  • Software Dev Engineer

    1 month ago


    Seattle, United States Intelliswift Software Full time

    Pay rate range - $55/hr. to $58/hr. on W2Must Have Required software exp: Java, JavaScript, JavaBean, and React NativeMinimum of 2 years expLeadership Principles:deliver results, ownership, bias for action, customer obsessionTeam Software engineer role covering the lifecycle of software development. Support credit card and payment teams. Requirement...

  • Software Dev Engineer

    1 month ago


    Seattle, United States Intelliswift Software Full time

    Pay rate range - $55/hr. to $58/hr. on W2Must Have Required software exp: Java, JavaScript, JavaBean, and React NativeMinimum of 2 years expLeadership Principles:deliver results, ownership, bias for action, customer obsessionTeam Software engineer role covering the lifecycle of software development. Support credit card and payment teams. Requirement...

  • Software Engineer

    3 weeks ago


    Seattle, United States Gradial Full time

    Software Engineer at GradialLocation: Seattle, WACompany Overview:At Gradial, we’re removing the barriers between human creativity and execution. Our mission is to empower marketers and creatives to implement their ideas directly, with fundamentally mutable software that adapts to execute users’ intentions. Our primary focus is arbitrary updates to...


  • Seattle, United States Intelliswift Software Inc Full time

    Customer Job Software Dev Engineer IV Job ID: 24-02440 Pay rate range - $80/hr. to $84/hr. on W2 Job Description Design, develop, implement, test, document, and deliver large-scale, multi-tiered, distributed software applications, tools, systems, and services using multi-threaded programming, distributed programming in Java and C++,...

  • Software Engineer

    3 months ago


    Seattle, United States Intelliswift Software Full time

    Role: Software Engineer - Computer Vision and Image ProcessingLocation: Seattle, WA - OnsiteJob Term: Long-term Contract – Only W2Job Description:Do you have a deep C++ skillset and a passion for exploring and solving challenging computer vision and image processing problems? You love solving novel problems from first principles? You're always on the...

  • Software Engineer

    3 months ago


    Seattle, United States Intelliswift Software Full time

    Role: Software Engineer - Computer Vision and Image ProcessingLocation: Seattle, WA - OnsiteJob Term: Long-term Contract – Only W2Job Description:Do you have a deep C++ skillset and a passion for exploring and solving challenging computer vision and image processing problems? You love solving novel problems from first principles? You're always on the...


  • Seattle, Washington, United States Amazon Full time

    Join Our Innovative AGI TeamThe Artificial General Intelligence (AGI) team at Amazon is seeking a dedicated and skilled Senior Software Engineer (SDEII) with a robust background in machine learning. This role involves leading the creation of cutting-edge technology that integrates multimodal systems.Your ImpactAs a Senior Software Engineer on the AGI team,...


  • Seattle, United States DoorDash Full time

    About the RoleWe’re looking for a passionate Applied Machine Learning expert to join our team. In this role, you will utilize our robust data and machine learning infrastructure to build recommendation system, and implementing new AI solutions to expand restaurants selection and drive their growth. You’ll be conceptualizing, designing, and evaluating...


  • Seattle, United States Amazon Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. This role is for a software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron.This role is responsible for development, enablement and performance tuning of a wide...


  • Seattle, United States Amazon Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. This role is for a software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a wide...


  • Seattle, Washington, United States Amazon Full time

    DescriptionAmazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and...


  • Seattle, United States Amazon Full time

    Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and millions of...


  • Seattle, United States Amazon Full time

    DescriptionAmazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and...


  • Seattle, United States Amazon Full time

    Description Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and...


  • Seattle, United States Amazon Full time

    Description Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and...


  • Seattle, United States Software Defined Automation GmbH Full time

    Company Description It all started with an idea at Block in 2013. Initially built to take the pain out of peer-to-peer payments, Cash App has gone from a simple product with a single purpose to a dynamic ecosystem, developing unique financial products, including Afterpay/Clearpay, to provide a better way to send, spend, invest, borrow and save to our 47...

Software Engineer, Inference

1 month ago


Seattle, United States Tik Tok Full time
Responsibilities

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

Our team was established to help realize our company vision, building a global platform for creation and communication. We are doing world-class work in machine learning, computer vision, natural language processing, speech and audio, and knowledge, and transferring our work into products, which hundreds of millions of users worldwide use. As a vital AI infrastructure for the company, our machine learning system integrates our most up-to-date R&D results in AI algorithms and systems. Come and join us, you will get the chance of building large-scale machine learning systems and working with the best AI system and algorithm researchers and engineers.

What You'll Be Doing
1. Responsible for developing and optimizing LLM inference framework.
2. Responsible for GPU and CUDA Performance optimization to create an industry-leading high-performance LLM inference engine.

Qualifications

1. Bachelor's degree or above, major in computer/electronics/automation/software, etc., with experience in ML engineering optimization preferred
2. Proficient in C/C++, proficient in algorithms and data structures, familiar with Python
3. Proficient in GPU high-performance computing optimization technology on CUDA, in-depth understanding of computer architecture, familiar with parallel computing optimization, memory access optimization, low-bit computing, etc.
4. Understand the basic principles of deep learning algorithms, be familiar with the basic architecture of neural networks and understand deep learning training frameworks such as Pytorch and TensorFlow
5. Familiar with TensorRT-LLM, ORCA, VLLM, etc.
6. Knowledge of LLM models, experience in accelerating LLM model optimization is preferred

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at rd.accommodations@tiktok.com.