Principal Measurement Scientist

Tracksuit LimitedAustraliaFull-time1w ago

Continue with your CV

PDF, Word, or image. Under 10MB.

Upload CV

Apply now

Job description

About the role

The is responsible for creating and leading the company's comprehensive measurement science programme, establishing a robust scientific foundation for all data and insights. In this role, you will define critical questions, methods, evidentiary standards, and a clear sequencing strategy that spans a multi-year horizon to ensure long-term scientific integrity. You will audit and challenge existing methodologies with rigorous scientific independence, ensuring that all processes adhere to the highest standards of objectivity and evidence-based practice. You will design and run academic-level validation studies that test core assumptions and strengthen the reliability of measurement frameworks. A core part of this position involves partnering with Survey Operations on Mode 3 test design and execution to optimize data collection approaches. You will also partner with Data Science on statistical validation to ensure that analytical outputs are scientifically sound and reproducible. Another key responsibility is owning the science of respondent psychology, including attention, cognitive load, satisficing, recognition effects, order effects, and panel fatigue, to understand how these factors influence data quality. Based on this understanding, you will build evidence-based mitigation strategies for respondent psychology to minimize bias and improve measurement accuracy. Ultimately, you will define and maintain Tracksuit's metric and methodology frameworks, including conceptual definitions, incidence rules, measurement standards, and survey design constraints, ensuring consistency across all projects.

Key facts

Location: Australia

Engagement: Full-time

What you'll do

You will create and lead Tracksuit's measurement science programme, establishing a cohesive vision and roadmap for measurement excellence.
You will define questions, methods, evidentiary standards, and sequencing across a multi-year horizon, ensuring strategic alignment with business and scientific objectives.
You will audit and challenge existing methodology with scientific independence, identifying gaps and opportunities for rigorous improvement.
You will design and run academic-level validation studies that test core measurement assumptions under controlled conditions.
You will partner with Survey Operations on Mode 3 test design and execution, optimizing survey modes for accuracy and reliability.
You will partner with Data Science on statistical validation, working closely to ensure that models and metrics are scientifically robust.
You will own the science of respondent psychology, studying attention, cognitive load, satisficing, recognition effects, order effects, and panel fatigue in depth.
You will build evidence-based mitigation strategies for respondent psychology, implementing solutions that reduce bias and enhance data quality.
You will define and maintain Tracksuit's metric and methodology frameworks, including conceptual definitions, incidence rules, measurement standards, and survey design constraints.
You will document frameworks with academic rigor, ensuring that all methodologies are transparent, replicable, and defensible.
You will build the Methodology Knowledge base, capturing rationale, standards, validation evidence, and decisions for future reference and learning.
You will assess external data sources with scientific independence, critically evaluating their suitability and credibility for Tracksuit's needs.
You will evaluate synthetic modelling inputs and multi-source data for scientific credibility, ensuring that integrated datasets meet high evidentiary standards.
You will engage with the academic community, staying current with latest research and methodologies in measurement science and related fields.
You will build a scientific advisory network, collaborating with experts who can provide guidance and challenge your approaches.
You will maintain relationships with external academics, fostering ongoing dialogue that enriches Tracksuit's scientific practice.
You will represent Tracksuit at conferences where relevant, sharing insights and learning from peers in the measurement and research community.

Requirements

Deep academic training ideally PhD or Master's in psychology, statistics, behavioural science, or a closely related field.
Multiple years of experience in quantitative research or measurement science, ideally within a rigorous empirical environment such as Ehrenberg-Bass or equivalent, is strongly preferred.
Expert-level knowledge in survey methodology, measurement theory, psychometrics, and respondent psychology is essential for success in this role.
You need to be comfortable challenging assumptions and defending evidence-based positions, even when they conflict with prevailing opinions or business pressures.
You must be able to produce scientific documentation that could withstand peer review, with clarity, precision, and methodological rigor.
You should be collaborative across Survey Operations, Data Science, Product, and Marketing Science, while never compromising scientific standards for expediency.
You must be commercially aware enough to understand business constraints, yet scientifically independent enough to resist pressure to bend evidence or conclusions.
You should have a proven track record of working with complex measurement frameworks and translating them into practical, scalable methodologies.
You must be meticulous in record-keeping and documentation, ensuring that every decision and adjustment is traceable and justified.
You should be comfortable working in an agile environment where measurement questions evolve alongside business and data capabilities.
You must be proactive in identifying risks related to measurement validity, and take responsibility for addressing them before they impact insights.
You should demonstrate strong written and verbal communication skills, able to explain sophisticated concepts to both technical and non-technical audiences.
You must be willing to continuously update your expertise as new methodologies, tools, and evidence emerge in the field of measurement science.

Nice to have

Only if the SOURCE document lists preferred items, include them here. No additions are made beyond what is stated in SOURCE.

Practical notes

Note: For , create and lead Tracksuit's measurement science programme.

Define questions, methods, evidentiary standards, and sequencing across a multi-year horizon.

For , audit and challenge existing methodology with scientific independence.

For , design and run academic-level validation studies.

Partner with Survey Operations on Mode 3 test design and execution.

For , partner with Data Science on statistical validation.

Own the science of respondent psychology including attention, cognitive load, satisficing, recognition effects, order effects, and panel fatigue.

For , build evidence-based mitigation strategies for respondent psychology.

Define and maintain Tracksuit's metric and methodology frameworks including conceptual definitions, incidence rules, measurement standards, and survey design constraints.

For , document frameworks with academic rigor.

Build the Methodology Knowledge base including rationale, standards, validation evidence, and decisions.

For , assess external data sources with scientific independence.

Evaluate synthetic modelling inputs and multi-source data for scientific credibility.

For , engage with the academic community.

For , build a scientific advisory network.

You will use survey methodology. You will use measurement theory. You will use psychometrics. You will use respondent psychology. You will use statistical validation.