Staff AI Operations Architect

About the role

This role focuses on integrating human expertise with AI-driven decisions to ensure accurate background checks at scale. You will lead the operational programs for a major strategic shift in 2026, building scalable frameworks and refining the system through continuous feedback. This position is crucial for advancing how AI and human intelligence collaborate within the company.

Key facts

What you'll do

• Guide the transition from individual issue resolution to systemic solutions, determining how risk influences routing and where human judgment is applied.
• Define accuracy benchmarks and make decisions regarding speed and cost trade-offs, while establishing compliance and operational controls.
• Develop and manage the human-in-the-loop system that connects expert reviews to AI model enhancements, designing the feedback mechanism to improve automated detection.
• Represent the operational perspective in cross-functional development efforts with Analytics, ML/AI, and Product teams.
• Create repeatable structures to convert unique solutions into consistent capabilities.

Requirements

• 8 or more years of experience in operations or business operations, with a history of designing and implementing scalable systems.
• Proven ability to execute roadmaps while simultaneously establishing the underlying operational infrastructure.
• Experience with human-in-the-loop or AI-assisted operations, preferably in a regulated field such as background screening, fintech, healthtech, or compliance.
• Strong analytical capabilities to use data for architectural decisions, including quality thresholds, routing logic, and capacity trade-offs, beyond just optimizing existing processes.
• Cross-functional understanding, demonstrated by close collaboration with technical teams and the ability to bridge operational realities with system design.
• A proactive approach, raising standards, acting with urgency, maintaining resilience through uncertainty, and taking ownership to deliver significant results.

Practical notes

Relocation assistance may be available for those willing to move to a Checkr hub location. Benefits include 100% medical, dental, and vision coverage, up to $25K reimbursement for fertility, adoption, and parental planning services, flexible PTO, and a monthly wellness stipend.