Data Annotation Reviewer
WorkstreamPhilippinesToday
QAremotecurated-jd
Job description
Data Annotation Reviewer at Workstream
About the role
Workstream partners with a major AI and robotics client to produce training data from large-scale egocentric (first-person) video. Your job is to evaluate auto-generated annotations that have been flagged for potential errors, apply detailed client guidelines, and correct or reject segments so only accurate data ships. This is precision QA work where audited batches must hit strict accuracy thresholds or face outright rejection.
Key facts
What you'll do
- Assess language annotations to confirm written descriptions and action labels match video content with clarity and consistency
- Verify action segmentation and timing to ensure clips are divided into properly bounded, non-overlapping segments
- Spot-check machine-generated hand-pose and motion tracking, flagging implausible or incorrect outputs
- Identify privacy violations such as visible faces or personal information, and flag content that fails collection or quality standards
- Stay aligned with other reviewers through shared calibration sets
- Meet throughput targets while maintaining high, continuously audited accuracy
Requirements
- Minimum 1 year of experience as a Data Annotation Reviewer
- Strong written and reading English comprehension (this is the most critical requirement for applying nuanced guidelines)
- High attention to detail and ability to sustain focus during cognitively demanding review sessions
- Sound, consistent judgment when handling ambiguous or edge-case segments
- Reliable high-speed internet connection
- Device capable of smooth video playback
- Comfortable working remotely with regular calibration checks and performance targets
Nice to have
- Background in data labeling, QA, or content review
- Experience with video annotation or labeling platforms
- Familiarity with computer vision, robotics, or hand and gesture tracking concepts
Skills & tools
- Video annotation and labeling tools
- First-person video review
- Hand-pose and motion tracking evaluation
- Privacy and compliance screening
Practical notes
- Workstream is a Series B company backed by Founders Fund, BOND, and Coatue
- Customers include Burger King, Carl's Jr., Hardee's, IHOP, KFC, and Culvers
- Equal opportunity employer committed to full inclusion of all qualified individuals