Software Engineer, Backend

About the role

Braintrust provides an observability platform for AI agents, helping organizations monitor and refine their production models. We are seeking a backend engineer to develop the infrastructure that supports our real-time data platform across SaaS and self-hosted deployments.

Key facts

What you'll do

• Architect and deploy features that provide visibility into LLM performance and usage.
• Create a centralized layer to normalize, cache, and proxy requests across providers like Anthropic, OpenAI, and Gemini.
• Maintain and improve open source SDKs used for tracing and evaluating LLM interactions.
• Engineer high-availability pipelines for processing, storing, and querying large datasets of AI usage.
• Partner with product teams to implement features such as multimodal attachment storage, role-based access control, and on-demand function execution for LLM workflows.

Requirements

• 5+ years of professional backend engineering experience.
• Demonstrated ability to design systems focused on scale, data integrity, and uptime.
• Proficiency in modern backend stacks including Node.js, Go, Python, Rust, Postgres, Redis, Terraform, Docker, and AWS.
• Experience with observability tools such as Datadog, Prometheus, or Grafana.
• Ability to navigate ambiguous technical challenges and collaborate effectively across teams.
• Strong communication skills with a focus on documentation and knowledge sharing.

Skills & tools

• Node.js, Go, Python, Rust
• Postgres, Redis
• AWS, Terraform, Docker
• Grafana, Prometheus, Datadog

Practical notes

• Benefits include medical, dental, and vision insurance, flexible time off, and stipends for wifi and cellphone usage.
• Daily lunch, snacks, and beverages are provided at the office.
• Compensation includes a competitive salary and equity.
• Braintrust is an equal opportunity employer and considers all applicants regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, veteran, or disability status.