Machine Learning Engineer, Agentic Application

About the role

Join the Conversation Engine team to scale and optimize a Generative AI product that provides immediate assistance to enterprise users. This role focuses on applying abstraction, scalability, and optimization to dynamic, probabilistic, and generative conversational systems. You will contribute to the core of Moveworks' Generative AI product, enhancing its capabilities for a broad enterprise audience.

Key facts

What you'll do

• Build extensive product infrastructure with user-friendly interfaces for customizing and optimizing generative AI models. This includes data collection, feedback integration, and adapting to various enterprise contexts.
• Design scalable API abstractions for the conversation platform, supporting major chat clients like MSTeams, Slack, and Web, and providing a neutral API for other engineering systems.
• Optimize the dialog engine for diverse conversational features, utilizing private domain knowledge for each enterprise customer in the cloud, and enabling real-time multilingual translation with minimal memory, low latency, and streamlined development.
• Advocate for best practices in coding patterns, API design, scalability, and optimization, fostering a culture of continuous improvement among engineers.
• Provide comprehensive insights into conversational AI product performance by implementing logging, tracing, debugging tools, and automated metrics for monitoring and analysis.
• Collaborate with ML engineers, application engineers, product teams, and customer support to advance new features and scalability initiatives.

Requirements

• Strong background in computer science and software engineering, with experience in building scalable systems.
• Deep understanding of clean, modular, and scalable API design, with the ability to champion high coding standards.
• Experience optimizing systems and improving performance, including familiarity with tracing, logging, and metrics frameworks to resolve latency, race conditions, and throughput issues.
• Ability to independently research new requirements and develop innovative solutions, thriving in a fast-paced, iterative development environment.
• Strong communication skills to articulate rationales and design approaches, with cross-functional awareness for team collaboration.
• Bachelor's degree or higher in computer science or a related field.
• 2+ years of professional development experience building systems at scale.

Practical notes

ServiceNow offers health plans, flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan, and family leave programs. Compensation varies based on location, qualifications, skill level, and competencies. ServiceNow supports flexible work arrangements, with work personas (flexible, remote, or required in office) assigned based on job nature and location. For positions requiring access to controlled technology, employment is contingent upon obtaining necessary export control approvals.