Technical Director - AI Roblox Studio
Job description
About the role
You will define and own the technical vision for agentic AI systems embedded directly into Roblox Studio, shaping how intelligent tools plan, execute, and validate creative work alongside developers and creators. You will operate at the intersection of platform engineering, AI systems, and developer experience, balancing ambitious product goals with production-grade reliability. In this hands-on individual-contributor role, you will write the architecture and the code while setting the quality and evaluation standards for the AI-Native IDE. You will bring reusable patterns and best practices that raise applied-AI fluency across Studio engineering teams, ensuring these systems integrate cleanly into the broader creator workflow. You will optimize these systems for latency, throughput, and cost, making intelligent tradeoffs between caching, routing, distillation, and quantization. You will stand up quantitative and qualitative eval pipelines, including human-in-the-loop processes, so we can ship agentic features with confidence. Your work will directly support millions of creators as they explore, build, play, learn, and connect in 3D immersive digital experiences.
Key facts
What you'll do
Design and build the agentic AI systems at the core of the AI-Native IDE, including planning, execution, validation, and evaluation, so they are production-grade and reliable for Studio creators.
Decide how Studio uses coding models, agents, retrieval, tool calling, and context management across the Assistant and the broader creator workflow, balancing capability with performance and safety.
Own the quality bar and evaluation strategy, standing up quantitative and qualitative eval pipelines, including human-in-the-loop, so we ship agentic features with confidence.
Optimize these systems for latency, throughput, and cost using techniques such as caching, routing, distillation, and quantization to meet real-world usage patterns.
Bring reusable patterns and best practices to teams across Studio, raising the applied-AI fluency of Studio engineering and improving consistency in how AI is integrated.
Collaborate closely with platform, tooling, and experience teams to ensure agentic AI capabilities align with the evolving Roblox Studio product roadmap.
Implement robust monitoring and debugging tooling for AI workflows, enabling fast diagnosis of issues and clear insights into system behavior.
Define and drive key performance indicators for AI features, balancing creator productivity, system reliability, and resource efficiency.
Partner with product and design to prototype new AI-powered authoring experiences and validate their impact through structured experiments and user feedback.
Maintain and evolve the technical stack for AI workloads, including model serving infrastructure, data pipelines, and evaluation frameworks.
Champion best practices for security, privacy, and responsible AI usage as these systems touch creator content and workflows.
Continuously learn from production telemetry and user feedback to iterate on both the systems and the developer experience.
Requirements
You have 12+ years of engineering experience, including ownership of large-scale, long-lived platforms that serve many users.
You have deep, hands-on experience building LLM-powered and agentic systems in production, beyond chat-based interfaces, with a track record of deploying and operating them at scale.
You possess strong systems and software engineering skills, with the ability to design architecture and write high-quality, maintainable code.
You have a proven ability to define evaluation frameworks for AI product quality, combining automated metrics with human review and optimizing inference for latency, throughput, and cost.
You bring a strong background in developer tools or IDE-like platforms, with experience setting technical direction and raising quality across multiple teams as an individual contributor.
You are comfortable operating at the deepest technical levels while still communicating clearly and productively with partners across the organization.
You demonstrate adaptability and curiosity, with good judgment about when to build new capabilities, when to reuse existing solutions, and when to push needs back to model or platform teams.
You are passionate about enabling creators and developers, understanding how AI can amplify creative output in complex, real-world production environments.
Nice to have
Background in coding models or code-generation systems, and/or research experience in reinforcement learning (RLHF, RLAIF, preference modeling) or related model-training techniques.
Practical notes
This is a full-time position based in San Mateo, California, United States.