Senior Product Manager, Multilingual AI and Evals

About the role

OKX is seeking a Senior Product Manager to guide the development of AI-driven quality assurance and evaluation systems for multilingual content. This role focuses on building the infrastructure that ensures the accuracy and reliability of AI-generated translations and localized product experiences. You will transform subjective quality challenges into automated, measurable solutions.

Key facts

What you'll do

• Improve the AI agent responsible for assessing translation quality and deciding if content is ready for automatic publication.
• Analyze systematic errors in AI output, identify root causes, and implement solutions to enhance agent performance.
• Create an AI-powered tool to automatically find localization issues in mobile and web applications, such as text truncation, layout problems, and incorrect formatting.
• Launch an initial version of the scanning tool and then integrate localization tests into the standard product testing pipeline for automated pre-release checks.
• Establish the core systems for measuring and improving quality, including creating golden datasets, annotation tools with error categorization, automated evaluations, and performance dashboards.
• Integrate annotation workflows to standardize how linguists provide real-time feedback for agent fine-tuning.

Requirements

• Bachelor's degree or higher with at least 3 years of product management experience. Direct involvement in building or evaluating AI agent systems can partially fulfill the PM tenure requirement.
• Experience building platforms, such as content platforms, testing platforms, or SaaS products, and turning internal processes into reliable systems.
• Hands-on experience with AI agents, agent harnesses, and evaluation methods, particularly for subjective quality issues.
• Ability to design evaluation harnesses and golden datasets, and diagnose AI failure modes like hallucinations or prompt drift.
• Experience launching products in multiple markets or languages, understanding the complexities of global user bases and working with diverse, distributed teams.
• Strong leadership skills for collaborating across engineering, AI teams, linguists, design, and external partners.

Nice to have

• Background in localization or translation, including knowledge of terminology management, TMS tools (e.g., Phrase, Smartling), and internationalization (e.g., ICU/CLDR).
• Bilingual or multilingual, especially in Chinese or European languages.
• Experience in crypto, fintech, or other highly regulated industries.

Practical notes

• OKX prioritizes applicants who already possess the right to work in Singapore and do not require visa sponsorship.
• Benefits include a competitive compensation package, learning and development programs, education subsidies, team building events, wellness and meal allowances, and comprehensive healthcare for employees and their dependents.