Senior Engineering Manager, AI Gateway

About the role

In this pivotal position, you will spearhead a dynamic engineering team dedicated to creating a cohesive inference layer at the network edge. This role demands a proactive leader who not only guides the team but also actively engages in coding, crafting design documentation, and shaping product strategies. Your leadership will cultivate an environment centered on agent-focused development, ensuring that the team thrives in a fast-paced setting.

Key facts

What you'll do

• Direct the technical and product strategy for the AI Gateway, collaborating closely with engineers and product managers to align on goals.
• Actively participate in coding and developing internal tools, harnesses, and workflows that streamline the software delivery process.
• Uphold a rapid delivery cycle to adapt swiftly to the frequent updates in model releases and provider APIs.
• Enhance the developer experience by improving SDKs, dashboard interfaces, error messaging, and comprehensive documentation.
• Recruit and nurture a high-performing engineering team, providing mentorship and guidance to foster professional growth.
• Work in tandem with the Workers AI and Developer Platform teams to ensure a unified inference experience for users.
• Lead initiatives to refine the architecture and design of systems, ensuring they meet the evolving needs of the business.
• Facilitate regular team meetings to track progress, address challenges, and celebrate successes, maintaining team morale and focus.

Requirements

• At least 8 years of experience in the tech industry, demonstrating a strong foundation in software engineering.
• A minimum of 4 years in a managerial role overseeing software engineering teams, showcasing your leadership capabilities.
• Proven experience in delivering and maintaining complex, large-scale systems, particularly in areas like developer platforms, edge/proxy systems, AI infrastructure, or high-scale APIs.
• Strong technical acumen to evaluate designs, influence architectural choices, and assist team members in overcoming obstacles.
• A track record of mentoring senior engineers and fostering an inclusive, high-performance team culture.
• A hands-on leadership approach that emphasizes engagement with code, customer requirements, and product performance metrics.

Nice to have

• Experience in developing AI/ML infrastructure, model gateways, or applications integrated with large language models (LLMs).
• A background in creating developer-facing APIs or SDKs that operate at scale.
• Practical knowledge of proxy, edge, or gateway technologies, enhancing your ability to contribute to the team.
• Experience in building or customizing agentic development environments to optimize workflows.
• Familiarity with the current landscape of AI, including model capabilities, providers, and frameworks for agents.
• A portfolio showcasing public writing on systems or developer tools you have developed, demonstrating your expertise.
• Previous experience with Cloudflare AI Gateway or Workers AI, along with actionable insights for product enhancements.

Skills & tools

• Proficiency in AI Gateway
• Experience with Workers AI
• Familiarity with the Cloudflare agent stack
• Knowledge of proxy and edge systems
• Expertise in developing developer-facing APIs and SDKs

Practical notes

• This position may require access to information governed by U.S. export control laws; job offers may depend on the ability to receive such technology without the need for sponsorship for an export license.
• Candidates who reach the offer stage may be asked to participate in an in-person interview at a Cloudflare office or hub.
• Cloudflare is committed to being an equal opportunity employer and offers reasonable accommodations for applicants with disabilities. For assistance, please contact hr@cloudflare.com.

Join us at Cloudflare and play a crucial role in shaping the future of AI at the network edge. Your expertise will not only drive our product forward but also inspire a team dedicated to innovation and excellence.

About the company

Cloudflare operates one of the largest networks in the world, providing security, performance, and reliability services to websites and internet applications. Founded by Matthew Prince, Lee Holloway, and Michelle Zatlyn in 2009, Cloudflare went public on the NYSE in September 2019.