Senior AI/ML Ops Engineer

About the role

Smartsheet is building a new generation of AI agents to automate complex tasks and improve decision-making. We are looking for an experienced engineer to join our India Global Capability Center to design and maintain the infrastructure that powers these intelligent systems. The role focuses on enabling scalable and secure operations for advanced machine learning workflows. You will own the architecture that supports production-grade AI deployments across the organization. This position requires a strong background in both enterprise software environments and modern data infrastructure. You will work closely with cross-functional teams to ensure reliability and performance of AI services. The work involves balancing innovation with the practical demands of cost optimization and system stability.

Key facts

What you'll do

• Architect and oversee scalable platforms for AI and machine learning operations, ensuring alignment with enterprise standards.
• Package and deploy models to production environments with a focus on reproducibility, traceability, and operational robustness.
• Create automated CI/CD pipelines to speed up model delivery while maintaining strict quality gates.
• Manage infrastructure for training and inference using Docker, Kubernetes, or serverless technologies to meet workload demands.
• Set up observability tools to track model latency, data drift, and performance metrics for continuous improvement.
• Automate retraining cycles and data workflows to keep models accurate and aligned with evolving business needs.
• Deploy foundation models and manage RAG stacks, including Vector DBs and Knowledge Graphs, for advanced use cases.
• Optimize GPU and CPU usage to balance cloud costs with inference speed and system throughput.
• Coordinate with data scientists and software engineers to integrate models into production seamlessly and efficiently.
• Maintain version control for code, data, and models to ensure auditability and collaboration across teams.
• Enforce data security and governance standards to protect sensitive information and comply with regulations.
• Troubleshoot platform stability issues and research emerging data technologies to drive innovation.

Requirements

• Proven background in enterprise SaaS software with a focus on high availability, ensuring systems meet rigorous uptime demands.
• Experience managing large-scale structured and unstructured data from diverse sources and formats.
• Expertise in building AI/ML Ops systems that prioritize security, efficiency, and scalability in production environments.
• Ability to collaborate with product engineering teams to influence design decisions through data-driven analytics and insights.
• Deep knowledge of system design and AI/ML frameworks capable of handling petabytes of data across distributed architectures.
• Proficiency in Databricks Lakehouse, MLflow, Mosaic AI Agent Framework, Unity Catalog, Vector Search, and Knowledge Graphs for modern AI workloads.
• Familiarity with LangChain and LangGraph for building and integrating complex pipeline workflows.
• Hands-on experience with at least one major cloud provider such as AWS, Azure, or GCP for deploying and managing services.
• Strong programming skills in Python and SQL to develop efficient and maintainable solutions.
• Experience with Kubernetes, CI/CD pipelines, Infrastructure as Code using Terraform, and observability tools for full lifecycle management.
• Must be legally eligible to work in India on an ongoing basis without requiring additional sponsorship.

Nice to have

• Experience with Monte Carlo for monitoring data pipelines and detecting anomalies in operational workflows.
• Experience with AWS Bedrock for integrating and managing large language models securely.
• Experience with AWS-hosted data platforms to leverage managed services for scalability and performance.

Practical notes

• Smartsheet is an equal opportunity employer and provides accommodations for the interview process upon request to ensure fair participation.
• The engagement for this position is Full-time, requiring consistent availability during standard business hours.
• This role is based in Bangalore, India, and does not involve international travel or visa sponsorship considerations.
• Candidates must meet all eligibility criteria as listed, and the selection process will focus on matching the specified qualifications.
• No additional benefits or compensation details are provided beyond standard employment terms outlined by Smartsheet policies.
• The position operates within the framework of the India Global Capability Center, focusing on supporting AI and ML operations at scale.
• Applicants are encouraged to highlight relevant experience with the listed tools and technologies during the application and interview process.