Senior Software Engineer

About the role

This position focuses on building and scaling Mercury's internal AI infrastructure. You will be instrumental in transforming experimental AI initiatives into robust, shared capabilities that enhance productivity across the company.

Key facts

What you'll do

• Develop and enhance core services that integrate internal systems and data for use by AI agents and engineers.
• Manage and expand the LLM gateway, including routing, usage limits, cost tracking, and monitoring.
• Formalize best practices into reusable components like prompt templates, safety measures, and policy definitions.
• Create and maintain structured data for AI models to understand company-specific information.
• Improve systems for discovering and retrieving internal knowledge for both human and AI users.
• Collaborate with different departments to standardize and update critical information sources.
• Build and refine environments for safe and rapid AI experimentation.
• Develop tools that allow non-technical staff to build and deploy AI-powered workflows independently.
• Construct testing frameworks to evaluate AI agents in controlled settings before production deployment.

Requirements

• Possess at least 5 years of experience in backend development for production systems.
• Demonstrate proficiency across multiple programming languages and comfort with platform engineering, infrastructure, and developer tools.
• Have practical experience building AI systems, such as RAG pipelines or agent frameworks, and have successfully launched at least one to production.
• Understand the practical challenges of AI deployment, including cost, monitoring, speed, and security.
• Exhibit strong initiative and the ability to work independently, identifying and completing high-impact tasks.
• Communicate technical concepts effectively to both technical and non-technical audiences.

Nice to have

• Experience with building and operating large-scale AI infrastructure.

Skills & tools

• Backend Development
• Platform Engineering
• Infrastructure
• Developer Tooling
• LLM Systems (RAG, Agents)
• AI Deployment Tradeoffs

Practical notes

• Mercury offers a comprehensive compensation package including salary, equity, and benefits.
• Salary ranges are competitive and adjusted based on industry data.
• Offers are determined by candidate experience, expertise, location, and internal pay equity.
• Mercury is an Equal Employment Opportunity employer and values diversity.
• Reasonable accommodations are available for applicants with disabilities.