Chaos Engineer
Job description
About the role
As a , you will play a critical role in enhancing the resilience and reliability of our systems. Your primary responsibility will be to design and implement chaos experiments that simulate failures, allowing us to identify weaknesses and improve our infrastructure. This position requires a deep understanding of distributed systems and a passion for testing the limits of our applications. You will collaborate closely with cross-functional teams to ensure our services remain and performant under various conditions.
Key facts
What you'll do
- Develop and execute chaos engineering experiments to assess the resilience of our systems and applications.
- Collaborate with software engineers and operations teams to identify potential failure points and design appropriate tests.
- Analyze the results of chaos experiments to provide actionable insights and recommendations for system improvements.
- Create and maintain documentation for chaos engineering practices, including experiment design, execution, and outcomes.
- Monitor system performance and reliability metrics before, during, and after chaos experiments to gauge the impact of failures.
- Advocate for a culture of reliability and resilience within the organization by educating teams on chaos engineering principles.
- Participate in post-mortem analyses of incidents to identify root causes and prevent future occurrences.
- Stay current with industry trends and best practices in chaos engineering and distributed systems to continuously enhance our approach.
- Collaborate with DevOps teams to integrate chaos engineering practices into CI/CD pipelines for continuous testing.
- Assist in the development of automated tools and frameworks to facilitate chaos experiments across multiple environments.
- Provide mentorship and guidance to junior engineers in chaos engineering methodologies and practices.
- Engage with the broader chaos engineering community to share knowledge and learn from industry leaders.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- A minimum of 3 years of experience in software engineering, site reliability engineering, or a related discipline.
- Strong understanding of distributed systems, microservices architecture, and cloud computing environments.
- Proficiency in programming languages such as Python, Go, or Java, with experience in writing automated tests.
- Familiarity with chaos engineering tools and frameworks, such as Gremlin, Chaos Monkey, or similar.
- Experience with monitoring and observability tools, such as Prometheus, Grafana, or Datadog.
- Solid understanding of networking concepts and protocols, as well as system performance tuning.
- Excellent problem-solving skills and the ability to think critically under pressure.
- Strong communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
- Proven ability to work collaboratively in a fast-paced, agile environment.
Nice to have
- Experience with container orchestration platforms like Kubernetes or Docker Swarm.
- Familiarity with infrastructure as code (IaC) tools such as Terraform or Ansible.
- Knowledge of security best practices in cloud environments and how they relate to chaos engineering.
- Previous experience in a chaos engineering role or with large-scale production systems.
- Contributions to open-source projects related to chaos engineering or distributed systems.
Skills & tools
- Programming Languages: Python, Go, Java
- Chaos Engineering Tools: Gremlin, Chaos Monkey
- Monitoring Tools: Prometheus, Grafana, Datadog
- Cloud Platforms: AWS, Azure, Google Cloud
- Containerization: Docker, Kubernetes
- Infrastructure as Code: Terraform, Ansible
Practical notes
This position is based in Ottawa, Ontario, and is a full-time role. Solace is committed to fostering a diverse and inclusive workplace, and we encourage applications from individuals of all backgrounds. If you are about improving system reliability and thrive in a collaborative environment, we would love to hear from you.
To apply for this position, please visit our careers page at [Solace Careers](https://solace.bamboohr.com/careers/759). We look forward to your application and the possibility of you joining our team as we push the boundaries of chaos engineering and system resilience.