Member of Technical Staff

About the role

Perplexity is building advanced search technologies and is seeking a Member of Technical Staff to join their growing team in Belgrade. In this role, you will work directly with user behavior data to uncover meaningful patterns that guide important product decisions across the organization. You will design and run carefully structured experiments to test new ideas, then translate the results into clear and actionable recommendations for the product team. The position focuses on creating reliable data pipelines and measurement frameworks that improve search ranking quality and overall user experience for millions of people.

Key facts

What you'll do

• Extract meaningful signals from user behavior data to shape the product direction and drive wider adoption across the platform
• Build and maintain interactive dashboards that track key performance indicators with clear and informative visualizations for stakeholders
• Design and execute A/B tests to validate product hypotheses and measure their real impact on user engagement metrics
• Write production-quality Python code to process large datasets and generate actionable insights that inform product strategy decisions
• Construct data labeling pipelines that combine human review with large language model feedback for efficient annotation workflows
• Develop new ranking quality metrics that reflect how well search results actually meet the needs of users
• Collaborate with engineering teams to build scalable data pipelines that support rigorous experiment analysis and reporting
• Identify gaps in current measurement approaches and propose new methods to fill those gaps with greater precision
• Analyze experiment results using rigorous statistical techniques to determine which product changes are truly significant and meaningful
• Create thorough documentation and reusable code templates that help team members reproduce analyses and share findings easily
• Partner with product managers to define success criteria and translate business questions into measurable analytical frameworks
• Monitor ongoing experiments to ensure data quality and flag any anomalies that could affect interpretation of results

Requirements

• Four or more years of hands-on experience working as a data analyst or in a closely related analytical role
• Demonstrated track record of work on search-related products, with particular emphasis on designing online metrics and analyzing A/B experiments
• Strong Python programming skills with the ability to write clean, production-grade code that can be deployed in live environments
• Proficiency in SQL for querying, joining, and manipulating large databases efficiently and accurately at scale
• Familiarity with Business Intelligence tools and platforms for building reports, dashboards, and data visualizations that support decision-making
• Deep knowledge of statistical methods including hypothesis testing, confidence intervals, and experimental design principles
• Excellent written and verbal communication skills for presenting complex analytical findings to both technical and non-technical audiences
• Experience working with large-scale user behavior datasets and a solid understanding of how such data is structured and stored

Nice to have

• Experience with Apache Spark for distributed data processing at scale across large and complex datasets
• Familiarity with Databricks as a platform for data engineering workflows and interactive analytics sessions
• Knowledge of LLM-as-a-judge systems and understanding of how to integrate them into product evaluation pipelines
• Background in developing automated labeling systems that reduce manual annotation effort and improve consistency
• Prior experience with large language model feedback loops to iteratively improve data quality and coverage

Skills & tools

• Python for data analysis, statistical modeling, and production-grade software development in team environments
• SQL for database querying, data manipulation, and joining multiple tables across large-scale data warehouses
• Statistical analysis methods including hypothesis testing, regression modeling, and rigorous experimental design frameworks
• Business Intelligence platforms for creating interactive dashboards, reports, and visual data presentations for stakeholders
• Data pipeline design and implementation for processing user behavior logs and experiment event streams efficiently
• Large language model feedback systems for building automated data labeling and quality assurance workflows

Practical notes

• This is a full-time position based in Perplexity's Belgrade office, requiring regular in-person collaboration with the local team
• Candidates should expect to work closely with product managers, engineers, and researchers across multiple cross-functional teams on a daily basis
• The role involves regular interaction with experiment results and requires consistent attention to statistical rigor and methodological soundness
• Applicants should be prepared to discuss past projects involving search technology, user behavior analysis, or online experimentation during the interview process

About the company

Perplexity is seeking an experienced Staff Full Stack Engineer to help revolutionize the way people search and interact online. In this role, you'll translate cutting-edge AI advances into products that are both useful and engaging. Our tech stack includes Python, Go, Rust, TypeScript, React FastAPI, PostgreSQL, Redis, Docker, vLLM, and AWS.