Software Engineer, Perception

About the role

You will architect and ship the core perception algorithms that let our hardware understand its position and surroundings in real time. This position owns the development of sensor fusion pipelines that merge inertial and visual data to maintain reliable tracking when it matters most. You will translate research in SLAM and VIO into deterministic software that operates under strict latency and power constraints. Your work will directly shape how field teams interact with complex indoor and GPS-denied environments where failure is not an option. You are expected to question assumptions, validate results with empirical data, and iterate on designs that balance accuracy with compute budget. Collaboration across hardware, robotics, and platform teams will define how cleanly your modules integrate into the broader system. Ultimately, you will be responsible for ensuring that our spatial intelligence stack is robust, measurable, and ready for the world's toughest missions.

Key facts

What you'll do

• Develop and optimize sensor fusion algorithms combining IMU and camera data for SLAM and VIO (Simultaneous Localization and Mapping & Visual Inertial Odometry).
• Implement state of the art structure-from-motion techniques using different sensor modalities to generate consistent 3D reconstructions.
• Build Calibration and sync pipelines across multiple sensor types to ensure temporal and spatial alignment.
• Evaluate algos against public benchmarks and real-world datasets to quantify accuracy, drift, and failure modes.
• Integrate outputs into higher-level autonomy or collaborative mapping systems (i.e. shared mapping systems) that rely on consistent pose estimates.
• Collaborate with HW, robotics and platform teams to ensure end-to-end performance from drivers to decision layers.
• Define metrics, testing frameworks and deployment strategies for production-ready perception systems that meet operational standards.
• Profile and optimize compute kernels to meet real-time constraints on embedded or edge hardware without sacrificing robustness.
• Document interfaces, assumptions, and uncertainty characteristics so that downstream consumers can rely on your components.
• Drive experiments from idea through analysis, ensuring that each iteration improves measurable outcomes in noise, latency, or precision.
• Partner with data and simulation teams to expand test coverage across environments, motion profiles, and sensor configurations.
• Support validation activities that prove system behavior under adverse conditions such as motion blur, low light, or aggressive maneuvers.
• Contribute to internal tools that let non-experts configure, test, and monitor perception modules in the field.
• Advance the state of practice by incorporating lessons learned into reusable libraries and reference implementations.

Requirements

• BS with 10+ years of academic or industry experience in inertial sensing, computer vision, robotics or related fields with shipped or published work (or MS with 8+ yrs of the above).
• Demonstrated ability to design, test, and deploy algorithms that run in real time on resource-constrained platforms.
• Strong background in linear algebra, SLAM, VIO and structure-from-motion with an intuitive grasp of error propagation and observability.
• Proficient in C++/Python with experience in real-time optimization and numerical computing under constraints.
• Familiar with libraries such as OpenCV, Ceres etc. used for vision and optimization tasks in production contexts.
• Knowledge of sensor modelling, calibration and noise characteristics for cameras, IMUs, and related peripherals.
• Experience with real-time processing pipelines on embedded or edge hardware including memory, bandwidth, and thermal constraints.
• Familiarity with probabilistic estimation, filtering (e.g. EKF/ factor-graph optimization), and uncertainty representation in spatial systems.
• Must be a U.S. Person as defined by federal regulations and able to provide appropriate documentation upon hire.
• Must maintain eligibility for U.S. Person status throughout employment and comply with export control and security requirements.
• Must provide documentation verifying U.S. Citizenship, lawful permanent residency, or protected status under 8 U.S.C. 1324b(a)(3) when required.
• Must be capable of passing applicable background checks and security reviews if the role requires them.
• Must commit to working full-time during agreed schedule and location in San Jose, CA, with adherence to company policies.
• Must reliably meet project milestones and quality gates for perception components in a regulated development environment.

Nice to have

• Preferred track record of applied research in robotics or AR/VR with publications or demonstrable prototypes.
• Experience deploying perception stacks on heterogeneous compute that includes GPUs or accelerators.
• Familiarity with datasets, evaluation protocols, and tooling used in academic benchmarks for SLAM/VIO.
• Contributions to open source projects related to vision, geometry, or real-time systems.
• Understanding of safety-critical systems and practices such as fault detection, redundancy, and failure analysis.
• Experience coordinating with field operators to incorporate feedback into software improvements.

Practical notes

Work Authorization Requirement: Due to the nature of our business and compliance with federal regulations, all candidates must be a "U.S. Person". Upon hire, you will be required to provide documentation verifying your status as a U.S. Citizen, a lawful permanent resident, or a protected individual under 8 U.S.C. 1324b(a)(3).

Location: 2550 N First Street Suite 250, San Jose, California 95131

Engagement: Full-time

Equity and benefits: Eligible employees may receive equity and other forms of compensation, including unlimited PTO.

EEO statement: Rivet is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to any characteristic protected by applicable law. Certain roles may require U.S. Person status, security clearance eligibility, or other requirements imposed by law or government contract.