Senior Data Scientist - Generative AI
Role summary
Roblox is seeking a Senior Data Scientist specializing in Generative AI to join their Data Science & Analytics organization. This role focuses on enabling Creators with GenAI capabilities and empowering engineers with AI-backed tools, with a strong emphasis on safety, responsibility, and quality. The Senior Data Scientist will develop evaluation frameworks for GenAI features and internal AI agents, run rigorous experiments (A/B tests, causal inference), define success metrics, build automated evaluation tooling, and drive strategy through data-driven insights and recommendations for leadership. The ideal candidate has an advanced degree in a quantitative field, 5+ years of experience, strong SQL and Python skills, and a solid understanding of experimentation and causal inference. Familiarity with GenAI models and evaluation methods is required, with expertise in model training lifecycle and engineering development workflows being a plus.
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.
At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.
A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.
WHY DATA SCIENCE & ANALYTICS?
The Data Science & Analytics organization's mission is to increase our speed, frequency, and acumen in making decisions at scale by instilling a data-influenced approach to building products. We cover a wide area of the data spectrum, including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling, and machine learning. Aligned and partnered with product verticals, we use this extensive tool belt to discover new opportunities and unmet use cases, influence and craft the product roadmap, and prioritize, build data products, and measure impact on our community of players and developers.
WHY GENERATIVE AI?
Our team’s mission is twofold: to enable Roblox Creators to bring GenAI capabilities to millions of users, and to empower Roblox Creators and our own engineers with AI-backed tools to deliver value faster. We drive this innovation with a core commitment to safety, responsibility, and quality.
As a Senior Data Scientist, you will play a critical role in a key area within our Foundation AI team:
Whether you are focused on the end-user experience or the developer ecosystem, you will define how we measure safety, responsibility, quality, and efficiency. You will combine annotation analysis, design of experiments, causal inference, model-based evaluation methods (such as LLM-as-a-judge), optimization algorithm, and AI models to drive product decisions and model improvements.
You Will:
You Have:
For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.
Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).
Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process.
For US based roles only, please note the Company may not be able to employ candidates for this role who have United States work authorization related to certain U.S. visa categories, or support future H-1B sponsorship at this time.