Principal Software Engineer, Experimentation

7 days ago


San Mateo, California, United States Roblox Full time $289,460 - $338,270 per year

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.

At Roblox, we're building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We're on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.

A career at Roblox means you'll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

About The Role
On the experimentation platform team, we are building an industry-leading platform and tools that allow other teams and our developers to run and automatically analyze experiments at scale. As the Principal Engineer on the team, you will lead the evolution and scaling of the experimentation platform. With over ~98 million daily users (and growing) and hundreds of experiments every day, the platform already serves millions in QPS.

We are looking for an experienced engineer that's passionate about designing and building scalable systems for both online serving and offline analysis which empower our creators and users alike with the benefits of experimentation. Our team's product will act as the interface between those defining experiments, calculating and tracking metrics, and finally, visualizing the results of experiments to ship a successful variant to our creators and users alike. Scale and ease-of-use is of the utmost importance as Roblox continues its development of our world class experimentation data platform.

You Will

  • Help scale our online experiment serving flow to scale 10x.
  • Design and simplify the experiment creation and analysis flows for the next generation of internal and external customers leveraging AI when necessary.
  • Design a scalable serving model to support novel experimentation strategies (like crossovers, multi-armed bandits) and support our Data Science partners.
  • Partner with our Data Engineering and Data Platform teams to build our experimentation data processing workflows.
  • Partner with our customers all across Roblox and enable targeting experiments to audiences beyond our users - e.g. creators.
  • Help build a reliable serving flow and a scalable data to support experimental analysis, gradual feature rollouts and human-centric reporting.
  • Report into the Foundation AI Organization.

You Have

  • Backend engineering experience with 10+ years of work experience.
  • Solid programming skills in compiled languages such as C#, Go, C++, or others and knowledge of SQL.
  • Designed and built backend platform systems that can handle over 1M QPS.
  • Experience with big-data processing technologies such as Spark, Apache Druid, Flink etc. and exhibit a data-driven focus for quality metrics and monitoring.
  • Knowledge with REST, API design patterns, and scalable containerized systems and micro-services.
  • B.Sc. equivalent in CS or sufficient experience.
  • Experience in building experimentation platforms serving millions of users in preferably multi-sided marketplaces (Bonus)
  • Experience building and tuning Spark workflows at TB+ scale (Bonus)
  • Experience leveraging AI tooling to build simplified, human-centric experiences for internal customers (Bonus)

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on
this page
.

Annual Salary Range

$289,460—$338,270 USD

Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process.



  • San Mateo, California, United States Roblox Full time $289,460 - $338,270

    Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we're building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is...


  • San Mateo, California, United States Roblox Full time $180,000 - $300,000 per year

    The Engine Replication Team pulls the players together by ensuring the communication of the game state to all. As a Principal Replication Engineer you will help the players experience the game as a nearly synchronous world. Just as the nerves in our bodies coordinate our actions, the network system coordinates all the computers involved into a smooth...


  • San Mateo, California, United States Roblox Full time $289,460 - $338,270 per year

    Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.At Roblox, we're building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to...


  • San Mateo, California, United States Roblox Full time $1,000,000 - $1,600,000 per year

    As a Senior Software Engineer with the Matchmaking team, you'll have the opportunity to build and own end-to-end mission-critical services within the Roblox ecosystem. You'll impact Roblox's matchmaking decisions by helping to select the best game server possible for every play request is a o(n²) problem. The system supports several millions of concurrent...


  • San Francisco, California, United States griddable Full time $120,000 - $250,000 per year

    DescriptionPrincipal Software EngineerOffice hybrid in San Francisco, Seattle, or IndianapolisWhy ITWe build teams that are smart, creative and fun. We work hard and play hard and believe that each individual can make a difference. Continuous personal and professional development of each individual is core to a high performing organization.TeamCustomer...


  • San Mateo, California, United States Guidewire Software Full time $124,000 - $186,000 per year

    SummaryGuidewire is widely recognized as the leading provider of software solutions for the property and casualty insurance industry. Our software empowers insurance companies to support their customers during their critical times – whether in response to natural disaster, an accident or emerging risks.At Guidewire, we offer a dynamic work...


  • San Mateo, California, United States Guidewire Software Full time $128,000 - $192,000

    SummaryGuidewire is widely recognized as the leading provider of software solutions for the property and casualty insurance industry. Our software empowers insurance companies to support their customers during their critical times – whether in response to natural disaster, an accident or emerging risks.At Guidewire, we offer a dynamic work...


  • San Mateo, California, United States Guidewire Software, Inc. Full time $128,000 - $192,000 per year

    United States - San Mateo, CAProduct Strategy/Full time/HybridGuidewire is widely recognized as the leading provider of software solutions for the property and casualty insurance industry. Our software empowers insurance companies to support their customers during their critical times – whether in response to natural disaster, an accident or emerging...


  • San Mateo, California, United States Roblox Full time

    WHY DATA SCIENCE & ANALYTICS?The Data Science & Analytics organization's mission is to increase our speed, frequency and acumen of making decisions at scale by instilling a data-influenced approach to building products. We cover a wide area of the data spectrum including analytical data engineering, product analytics, experimentation, causal inference,...


  • San Mateo, California, United States Guidewire Software Full time $124,000 - $186,000

    SummaryGuidewire is transforming the P&C insurance industry through cutting-edge technology. The Policy Solutions team is driving innovation by creating new cloud-native solutions for insurance companies to accelerate their products to market, improve pricing and risk selection, gain insights into business performance, and deliver the best policy...