Technical Product Manager, LLM/ML Domain

About the role

Agoda is on a mission to enhance its artificial intelligence capabilities and is in search of a technical product manager to oversee its machine learning (ML) and large language model (LLM) operations platforms. This position is pivotal in creating robust infrastructure that empowers internal teams to efficiently deploy, monitor, and automate applications related to machine learning and large language models.

Key facts

What you'll do

• Formulate and articulate the product roadmap and strategic vision for internal ML and LLM operations platforms, ensuring alignment with overall business objectives.
• Collaborate closely with engineering teams to enhance deployment speed, ensure model reliability, and improve scalability across various applications.
• Convert technical requirements provided by data scientists and backend engineers into well-defined product specifications that guide development efforts.
• Construct infrastructure that facilitates AI-native workflows and seamlessly integrates with autonomous coding agents to optimize productivity.
• Oversee the entire product lifecycle, from the initial concept phase through to post-launch performance evaluation and iterative improvements.
• Set up safety measures, cost management protocols, and governance frameworks to ensure responsible AI development practices are adhered to.
• Engage with stakeholders across different departments to gather feedback and ensure that the product meets user needs and expectations.
• Conduct market research and competitive analysis to inform product decisions and identify opportunities for innovation within the ML and LLM space.
• Mentor and guide junior team members in best practices related to product management and technical development.
• Regularly report on product performance metrics and adjust strategies as necessary to meet evolving business goals.
• Foster a culture of continuous improvement by implementing feedback loops and agile methodologies within the product team.

Requirements

• A minimum of 5 years of experience in fields such as data science, machine learning engineering, or platform engineering, demonstrating a strong technical foundation.
• At least 2 years of experience in technical product management or program management, particularly in high-scale environments that require robust operational strategies.
• Deep understanding of ML Ops and LLM Ops principles, including aspects like model versioning, evaluation processes, and deployment pipelines.
• Strong technical expertise in system architecture, API design, and understanding the trade-offs involved in infrastructure decisions.
• Excellent communication skills, with the ability to convey complex technical ideas to diverse stakeholders, ensuring clarity and alignment.
• Proven track record of managing cross-functional teams and driving projects to successful completion within set timelines.

Nice to have

• Experience with machine learning lifecycle management tools and platforms, enhancing the efficiency of product development processes.
• Familiarity with LLM application patterns such as Retrieval-Augmented Generation (RAG), fine-tuning techniques, and prompt management strategies.
• Knowledge of observability and monitoring frameworks specifically designed for AI models, ensuring performance and reliability.
• Previous experience in a fast-paced tech environment, particularly within the travel or e-commerce sectors, is a plus.
• Understanding of data privacy regulations and ethical considerations in AI development.

Skills & tools

• Proficient in managing the machine learning lifecycle, from data collection and preprocessing to model training and deployment.
• Familiar with various LLM application patterns, including but not limited to fine-tuning and prompt management techniques.
• Experienced in utilizing observability and monitoring frameworks tailored for AI models to ensure optimal performance.
• Strong grasp of technical product strategy, prioritization methodologies, and agile project management practices.

Practical notes

Candidates interested in this role should be prepared to relocate to Bangkok, Thailand, as relocation assistance will be provided to the successful applicant. It is advisable to review Agoda's official hiring process guidelines available on the company's careers website before submitting an application. This role offers a unique opportunity to be at the forefront of AI innovation in a dynamic and rapidly evolving industry.