Applied AI Specialist, Commercial Customer Success

About the role

This position focuses on developing and maintaining AI-powered agents to enhance customer success operations. You will be responsible for the entire lifecycle of these agents, from initial design to ongoing improvements, ensuring they deliver tangible value to our commercial clients.

Key facts

What you'll do

• Design and construct AI agent architectures, including crafting effective prompts and integrating with essential business systems like Salesforce and the Samsara platform.
• Develop automated testing frameworks to validate agent performance against defined success metrics and real-world scenarios.
• Manage the deployment, version control, and rollback strategies for all AI agents in production environments.
• Monitor agent accuracy, response times, and overall effectiveness in production, proactively identifying and addressing performance degradation.
• Continuously update and refine agents based on product advancements, evolving customer success strategies, and performance data.

Requirements

• Demonstrated experience in building and supporting production-ready LLM-based agents or automation solutions.
• Proficiency in Python, with a proven ability to connect AI models to external systems such as CRMs, APIs, and operational tools.
• A systematic approach to defining success criteria and establishing evaluation frameworks before development begins.
• Genuine interest in understanding customer success workflows and addressing customer challenges.
• A realistic understanding of AI capabilities and limitations, with the ability to implement appropriate safeguards and fallback mechanisms.
• A minimum of 3 years in software engineering or a related technical field, including at least 1 year of hands-on experience with LLMs or AI agents in a production setting.
• Prior experience in a B2B SaaS industry.

Nice to have

• Experience working with Anthropic Claude or comparable LLM APIs.
• Previous experience collaborating with or working within Customer Success or Revenue Operations teams.
• Familiarity with building regression test suites or evaluation frameworks for AI systems with variable outputs.
• Knowledge of CRM and Customer Success platforms like Salesforce or Gainsight.

Skills & tools

• Python
• LLM APIs
• CRM integration
• API integration
• Salesforce
• Gainsight
• Anthropic Claude

Practical notes

• The annual base salary range for this role is $105,910 to $160,200 USD.
• This position is open to candidates residing in the US, excluding the San Francisco Bay Metro Area, NYC Metro Area, and Washington, D.C. Metro Area.
• Samsara offers a comprehensive total rewards package including base salary, performance-based bonuses, and equity for eligible roles.
• Benefits include a professional development stipend and extensive health and parental leave plans.
• The company supports a flexible working model, with this role being fully remote.