Product Manager, AI Agent & Harness
BinanceAsiaFull-time Onsite or Remote2w ago
AIWeb3BlockchainSecurityFinanceOperationsEngineeringremotecurated-jd
Job description
Product Manager, AI Agent & Harness at Binance
About the role
We are seeking a Product Manager to guide the development of core AI Agent capabilities and the associated Skill ecosystem for Binance Agentic. This role involves defining Agent product strategy, building the Harness evaluation system, and ensuring end-to-end task validation for continuous improvement.
Key facts
What you'll do
- Define the design for Agent-related features within Binance Agentic, covering task flows, user interactions, capability limits, error handling, and feedback mechanisms.
- Develop and maintain the Harness framework, including designing test cases, setting evaluation standards, preparing task examples, analyzing performance, and recommending product enhancements.
- Collaborate with technical leads, frontend engineers, and Skill design teams to translate business needs into detailed product specifications that are ready for development and testing.
- Identify and prioritize high-impact Agent use cases across various Binance business areas such as Web3 Wallet, Account Management, Payments, and Trading.
- Monitor advancements in AI Agents, multi-agent systems, tool usage, prompt engineering, and automated assessment to inform product initiatives.
- Establish and monitor key performance indicators for Agents, such as task completion rates, user satisfaction, error frequency, response quality, and tool usage accuracy.
- Proactively address issues observed in live Agent usage and drive improvements across product, engineering, and operational functions.
Requirements
- Prior experience with AI products, Agent technologies, generative AI applications, automation tools, or developer tools.
- A background in Web3, cryptocurrency exchanges, digital wallets, payment systems, on-chain transactions, decentralized finance, or digital assets.
- Practical understanding of how AI Agents function, including their ability to use tools, plan tasks, manage context, and undergo evaluation.
- Demonstrated ability to take ownership, adapt quickly, define problems, break down complex work, and drive results in uncertain environments.
- Solid product management foundation, including the ability to create clear product requirement documents, flow diagrams, test plans, and acceptance criteria.
- Strong skills in collaborating with and communicating effectively across engineering, design, operations, and business teams.
Nice to have
- Experience with cryptocurrency exchanges, Web3 wallets, on-chain trading, payment platforms, or fintech products.
- Experience with AI Agent evaluation frameworks, benchmarking, automated testing platforms, or prompt assessment tools.
- Familiarity with multi-agent systems, function calling, Retrieval Augmented Generation (RAG), multi-agent orchestration, or workflow automation.
- Knowledge of the Binance platform or common Web3 user scenarios.
- Proficiency in English for reading and understanding global AI and Web3 product and technical content.
Skills & tools
- AI Agent Design
- Product Strategy
- Web3 Ecosystem
- Cross-functional Collaboration
- Performance Metrics Definition
- Evaluation Frameworks
Practical notes
- Visa sponsorship may be available.
- Travel requirements are minimal.
- Competitive compensation and benefits package offered.
- Please review our Candidate Privacy Notice before applying.