AI Product Manager

About the role

We are looking for an AI Product Manager to join our team in New York, New York. This role requires on-site presence five days a week, and candidates can choose to work from either our New York City or Dallas office. In this position, you will shape the strategy and execution of Generative AI solutions, focusing on minimizing risks and costs in complex production settings.

Key facts

What you'll do

• Develop the vision, strategy, and roadmap for agentic AI products.
• Convert user challenges into actionable product requirements and success metrics.
• Oversee the complete lifecycle of LLM-based products from initial discovery to ongoing iterations.
• Set up evaluation frameworks for LLMs while prioritizing RAG pipelines and validation processes.
• Facilitate integrations with observability, incident management, and deployment systems.
• Conduct user research to inform roadmap priorities based on production challenges.
• Ensure AI safety, governance, reliability, and fallback strategies are in place.
• Define and track key performance indicators such as cost, latency, and user satisfaction.
• Manage data and knowledge strategies, including RAG pipeline and data validation.
• Lead product design reviews and encourage data-driven experimentation.
• Mentor teams on best practices in AI product management.

Requirements

• A Bachelor's degree in Engineering, Computer Science, or a related field.
• 10 to 15 years of experience in product management.
• At least 5 years of experience leading large-scale AI/ML or cloud product initiatives.
• A minimum of 5 years of expertise in LLMs, agentic systems, RAG pipelines, and MLOps.
• At least 5 years of experience collaborating closely with engineering teams on technical subjects.
• Strong communication skills for both technical and non-technical audiences.
• Experience in dynamic, cross-functional work environments.
• Excellent analytical skills and a data-driven approach to decision-making.
• Proven ability to influence stakeholders without direct authority.

Nice to have

• Experience in enterprise-scale production environments.
• Familiarity with observability and incident management tools.
• Background in prompt engineering and LLM evaluation frameworks.
• Knowledge of AI safety, governance, and compliance standards.
• Experience mentoring product managers or leading product communities.
• Understanding of cloud platforms like AWS or Google Cloud in AI applications.

Skills & tools

• Expertise in AI product management, LLMs, MLOps, and data validation techniques.
• Proficient in project management and collaboration tools.
• Strong analytical and problem-solving skills.

Practical notes

The salary range for this position is between $78,948 and $131,700, reflecting the minimum and maximum target compensation across all U.S. locations. Actual compensation will vary based on factors such as work location, experience, and skills. This role may also qualify for performance-based incentive compensation.

Benefits include medical, dental, and vision insurance with employer contributions, flexible spending accounts, life insurance, short and long-term disability coverage, paid time off, employee assistance programs, a 401k plan with company matching, and additional legally-required benefits.

About NTT DATA

NTT DATA is a leader in business and technology services with a revenue of $30 billion, serving 75% of the Fortune Global 100. We focus on driving client success and making a positive societal impact through innovation. As a prominent provider of AI and digital infrastructure, we excel in enterprise-scale AI, cloud services, security, connectivity, data centers, and application services. We are recognized as a Global Top Employer, with a presence in over 50 countries. NTT DATA is part of the NTT Group, which invests more than $3 billion annually in research and development.

We prioritize local hiring to ensure effective support tailored to client needs. While many roles offer remote or hybrid options, these arrangements may change based on client requirements. In-person attendance may be necessary for meetings or events for employees near an NTT DATA office or client site. NTT DATA is committed to flexibility in meeting the evolving needs of clients and employees.

NTT DATA recruiters will never request payment or banking information and will only use official email domains for communication. If you receive requests for payment or banking details, please contact us through our official channels.

NTT DATA is an equal opportunity employer, and all qualified applicants will be considered for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.