Staff Frontier Agents Engineer

About the role

Scale AI provides the data foundation for organizations to build and deploy production-ready AI. As a Staff Frontier Agents Engineer, you will translate research into functional systems by designing and deploying intelligent agents for enterprise clients across diverse industries.

Key facts

What you'll do

• Architect and deploy production AI agents that utilize LLMs, reasoning, retrieval, memory, and tool execution.
• Build multi-agent systems capable of planning, coordination, and human-in-the-loop oversight.
• Design evaluation frameworks including LLM-as-a-Judge, offline benchmarks, A/B testing, and regression suites.
• Establish guardrails, observability, and monitoring to ensure reliability and safety in high-stakes environments.
• Partner with enterprise customers to translate complex business needs into technical AI architectures.
• Conduct ablation studies and experiments to optimize model performance, latency, and cost.

Requirements

• 8+ years of experience in software engineering, machine learning, or applied AI.
• Proficiency in Python.
• Proven track record of building production AI systems using LLMs.
• Experience with modern AI tooling such as OpenAI, Claude, MCP, agent frameworks, vector databases, or retrieval pipelines.
• Strong grasp of machine learning fundamentals and modern language models.
• Ability to design and evaluate systems using quantitative metrics.
• Strong communication skills for direct collaboration with enterprise customers.

Nice to have

• Experience with RAG, semantic search, knowledge graphs, or structured knowledge representations.
• Background in fine-tuning, distillation, reinforcement learning, small language models, or model optimization.
• Familiarity with multimodal AI systems and frontier foundation models.
• Experience with distributed systems, cloud platforms (AWS, Azure, GCP), Docker, Kubernetes, and CI/CD.
• Ability to lead technical workshops and customer design sessions.

Skills & tools

• Python, LLMs, OpenAI, Claude, MCP, Agent Frameworks, Vector Databases, RAG, AWS, Azure, GCP, Docker, Kubernetes, CI/CD.

Practical notes

• Compensation includes base salary, equity, and benefits.
• Benefits include health, dental, vision, retirement plans, learning stipends, and PTO.
• A 90-day waiting period applies before candidates can be reconsidered for the same role.
• For disability-related accommodations during the application process, contact accommodations@scale.com.