Staff Software Engineer

About the role

Grafana Labs is seeking a Staff Software Engineer to join our Site Reliability Engineering team. You will focus on the reliability of our cloud-based database products, including Mimir, Loki, Tempo, and Pyroscope, ensuring high-quality service for our most demanding customers.

Key facts

What you'll do

• Embed within product engineering squads to oversee production reliability for complex, high-SLA environments.
• Design and implement automation to improve scalability and eliminate manual tasks.
• Define and evolve reliability models and per-tenant Service Level Objectives.
• Lead incident response, conduct post-incident reviews, and serve as a primary escalation point.
• Influence feature design to ensure operability and scalability from the start.
• Provide code reviews and contribute to technical design documentation.
• Mentor team members and act as a technical force-multiplier.
• Proactively investigate and mitigate SLO burn through improved monitoring and self-healing systems.

Requirements

• 8+ years of total engineering experience, including at least 4 years in SRE, CRE, or production engineering.
• Proven experience operating multi-tenant systems in a production environment.
• Strong technical leadership skills with a history of mentoring and guiding projects.
• Proficiency in Kubernetes within AWS, GCP, or Azure environments.
• Experience with infrastructure-as-code tools such as Terraform, Helm, or Jsonnet.
• Proficiency in at least one programming language like Go, Python, or Java.
• Deep understanding of Linux internals, cloud storage, networking, and scaling.
• Demonstrated ability to design and implement effective SLOs.
• Strong troubleshooting skills and experience with blame-free incident management.

Skills & tools

• Kubernetes, AWS, GCP, Azure
• Terraform, Helm, Jsonnet
• Go, Python, Java
• Linux internals
• AI coding assistants (optional usage)

Practical notes

Base compensation for Ireland is €117,600 to €141,120, with actual pay determined by experience and skill level. Benefits include equity, bonus eligibility, and 30 days of annual leave (inclusive of company shutdown days). We support the use of AI coding assistants with a company-funded budget.