Product Manager, AI Agent & Harness

About the role

We are seeking a Product Manager to guide the development of core AI Agent capabilities and the associated Skill ecosystem for Binance Agentic. This role owns the end-to-end vision and execution for Agent-related features, ensuring they meet user and business needs within the Binance ecosystem. You will define the strategic direction for task flows, user interactions, capability boundaries, and feedback mechanisms to optimize real-world performance. A core responsibility involves building and refining the Harness evaluation system to standardize how Agent skills are measured and validated. You will ensure robust end-to-end task validation is in place to support continuous improvement and reliability. This role requires close collaboration with engineering and design to translate complex requirements into clear product specifications. You will proactively monitor AI advancements and user behavior to identify opportunities for new Agent capabilities and enhancements.

Key facts

What you'll do

• Define the design for Agent-related features within Binance Agentic, covering task flows, user interactions, capability limits, error handling, and feedback mechanisms.
• Develop and maintain the Harness framework, including designing test cases, setting evaluation standards, preparing task examples, analyzing performance, and recommending product enhancements.
• Collaborate with technical leads, frontend engineers, and Skill design teams to translate business needs into detailed product specifications that are ready for development and testing.
• Identify and prioritize high-impact Agent use cases across various Binance business areas such as Web3 Wallet, Account Management, Payments, and Trading.
• Monitor advancements in AI Agents, multi-agent systems, tool usage, prompt engineering, and automated assessment to inform product initiatives.
• Establish and monitor key performance indicators for Agents, such as task completion rates, user satisfaction, error frequency, response quality, and tool usage accuracy.
• Proactively address issues observed in live Agent usage and drive improvements across product, engineering, and operational functions.
• Conduct market and competitive analysis to benchmark Binance Agentic against similar AI Agent platforms in the industry.
• Translate user research and feedback into actionable product insights that enhance the Agent experience and adoption.
• Partner with data teams to define experiments, analyze results, and validate the impact of product changes on Agent performance.
• Own the product roadmap for AI Agent features, balancing short-term delivery with long-term strategic goals.
• Facilitate cross-functional workshops to align stakeholders on priorities, constraints, and success metrics for Agent initiatives.
• Create and maintain documentation such as product briefs, user stories, and acceptance criteria to ensure clarity for all teams.
• Evaluate third-party tools and technologies that could enhance the Agent ecosystem or improve the Harness framework.

Requirements

• Prior experience with AI products, Agent technologies, generative AI applications, automation tools, or developer tools.
• A background in Web3, cryptocurrency exchanges, digital wallets, payment systems, on-chain transactions, decentralized finance, or digital assets.
• Practical understanding of how AI Agents function, including their ability to use tools, plan tasks, manage context, and undergo evaluation.
• Demonstrated ability to take ownership, adapt quickly, define problems, break down complex work, and drive results in uncertain environments.
• Solid product management foundation, including the ability to create clear product requirement documents, flow diagrams, test plans, and acceptance criteria.
• Strong skills in collaborating with and communicating effectively across engineering, design, operations, and business teams.

Nice to have

• Experience with cryptocurrency exchanges, Web3 wallets, on-chain trading, payment platforms, or fintech products.
• Experience with AI Agent evaluation frameworks, benchmarking, automated testing platforms, or prompt assessment tools.
• Familiarity with multi-agent systems, function calling, Retrieval Augmented Generation (RAG), multi-agent orchestration, or workflow automation.
• Knowledge of the Binance platform or common Web3 user scenarios.
• Proficiency in English for reading and understanding global AI and Web3 product and technical content.

Skills & tools

• AI Agent Design
• Product Strategy
• Web3 Ecosystem
• Cross-functional Collaboration
• Performance Metrics Definition
• Evaluation Frameworks

Practical notes

• Visa sponsorship may be available.
• Travel requirements are minimal.
• Competitive compensation and benefits package offered.
• Please review our Candidate Privacy Notice before applying.