Head of Experimentation

About the role

LaunchDarkly is seeking a Head of Experimentation to lead the company's experimentation strategy and drive data-informed product decisions across the organization. This role owns the end-to-end experimentation program, including A/B testing, feature flagging, and statistical analysis frameworks that help teams ship with confidence. The Head of Experimentation partners closely with engineering, product, and design leaders to define success metrics, design experiments, and translate results into actionable roadmaps. This is a senior leadership position responsible for building and scaling a high-performing experimentation function within a remote-first organization.

Key facts

What you'll do

Own the company-wide experimentation roadmap and prioritize experiments that deliver the highest business impact across all product lines. Design and implement statistical methodologies for A/B testing, multivariate tests, and quasi-experimental approaches to ensure valid and reliable results. Partner with product managers and engineers to define clear hypotheses, select appropriate metrics, and establish experiment guardrails before launch. Build and maintain the experimentation infrastructure, including integration with LaunchDarkly feature flags and analytics pipelines. Hire, mentor, and develop a team of experimentation analysts and data scientists to grow the function over time. Create standardized documentation and best practices for experiment design, execution, and reporting that teams across the company can follow. Present experiment findings and strategic recommendations to senior leadership and cross-functional stakeholders in clear, compelling formats. Collaborate with the data engineering team to ensure data quality, pipeline reliability, and timely access to experiment results. Establish governance policies for experiment review, ethical considerations, and user privacy within all testing programs. Drive a culture of experimentation by running workshops, training sessions, and office hours to educate teams on statistical rigor and experimentation literacy.

Requirements

Proven track record of leading an experimentation or growth team within a technology company for at least five years. Deep expertise in experimental design, statistical inference, and causal inference methods including Bayesian and frequentist approaches. Experience managing feature flag systems and understanding how experimentation integrates with continuous delivery workflows. Strong communication skills with the ability to present complex statistical concepts to non-technical audiences clearly. Demonstrated success in building and scaling data-driven teams from the ground up or through significant organizational growth. Bachelor's degree in a quantitative field such as statistics, mathematics, computer science, or a related discipline. Experience working in a remote or distributed team environment with strong self-management and asynchronous communication habits. Familiarity with product analytics platforms and SQL-based data exploration is essential for this role.

Nice to have

Experience with LaunchDarkly or similar feature management platforms is a strong plus for understanding the product ecosystem. Background in B2B SaaS companies where experimentation directly influences product-led growth and customer retention metrics. Knowledge of ML-based experimentation and reinforcement learning approaches for dynamic personalization and optimization. Prior experience working with product-led growth companies that serve developer or technical audiences.

Skills & tools

Statistical programming in Python or R for designing experiments and analyzing results. SQL for querying experiment data and validating metrics across large datasets. Feature flagging platforms such as LaunchDarkly or similar tools for managing experiment rollouts. Product analytics tools including Amplitude, Mixpanel, or Heap for tracking user behavior and experiment outcomes. A/B testing frameworks and libraries for server-side and client-side experiment execution. Data visualization tools such as Tableau, Looker, or Sigma for communicating results to stakeholders.

Practical notes

This role operates fully remotely with no required office presence, allowing candidates to work from anywhere within the United States. As a full-time position, the expected commitment is standard business hours with flexibility to accommodate different time zones across US regions. LaunchDarkly values asynchronous communication, so candidates should be comfortable documenting work thoroughly and collaborating through written channels. The hiring process includes multiple rounds of interviews focusing on technical experimentation knowledge, leadership experience, and cultural alignment with the company's values.

About the company

Modern software delivery was supposed to be the foundation for a thriving digital business but reality has proven otherwise. Slow, inefficient development cycles, costly outages, and fragmented customer experiences are preventing developers from building their best software.