Vendor Operations Manager – Safety Labeling
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.
At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device.We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.
A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.
At Roblox, we are looking for a Senior Vendor Operations Manager for Safety Labeling to bridge the gap between human intuition and machine learning. You will manage the vendor ecosystem responsible for generating the high-quality ground truth data that powers our safety models. Reporting to the Senior Manager of Vendor Operations, you’ll ensure our BPO partners translate complex safety policies into precise, scalable labels that keep our community safe.
You Will:
- Lead Labeling Operations: Manage day-to-day vendor execution for safety labeling (RLHF and Ground Truth), ensuring accuracy, policy alignment, and clinical precision.
- Optimize Data Quality: Implement rigorous quality frameworks—including Inter-Rater Reliability (IRR) and "Gold Standard" audits—to eliminate labeling bias.
- Scale the Pipeline: Partner with AI/ML Engineering and Policy to transform abstract guidelines into executable labeling handbooks and efficient workflows.
- Drive Vendor Performance: Own the operational roadmap, unit costs, and capacity planning for specialized labeling workforces globally.
- Ensure Resilience: Maintain business continuity and site redundancy plans to protect our data labeling pipelines from disruption.
You Have:
- Expertise in Data Labeling: 6+ years in Ops/Trust & Safety, with a proven track record managing large-scale vendor teams focused on data annotation or RLHF.
- Analytical Engine: Experience using data (SQL, Looker, or similar) to identify quality drift and operational bottlenecks.
- Cross-Functional Fluency: The ability to move seamlessly between technical ML requirements and nuanced Policy discussions.
- Operational Grit: A high tolerance for the complexity and emotional intensity of managing teams exposed to sensitive or high-risk content.
For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.
Annual Salary Range
$174,100-$207,480 USD
Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).
Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process.