Evaluation and ML Systems Engineer, AI Safety and Security Engineering
Job description
Evaluation and ML Systems Engineer, AI Safety and Security Engineering at NVIDIA AI
About the role
NVIDIA AI is seeking an Evaluation and ML Systems Engineer to join our AI Safety and Security Engineering team. This role focuses on developing and assessing AI-driven tools that identify, validate, and rectify software vulnerabilities. You will be instrumental in ensuring that our metrics and benchmarks accurately reflect our program's capabilities as it evolves.
Key facts
What you'll do
- Develop the infrastructure necessary for benchmarking and reproducibility.
- Establish metrics and protocols for performance evaluation.
- Ensure traceability by linking results to the corresponding code and runs.
- Maintain a rigorous review process for findings and conclusions.
Requirements
- A Bachelor's degree or equivalent experience, with a minimum of 5 years in machine learning engineering or evaluation.
- Proven experience in designing benchmarks, metrics, and conducting statistically valid comparisons for ML systems.
- A methodical and critical approach to metrics, baselines, and claims.
- Proficient in Python programming for shared infrastructure, including experiment tracking and data pipelines.
Nice to have
- Familiarity with evaluating security tools or processes.
- Experience in measuring behaviors of agent-based systems or large language models.
- Contributions to public benchmarks or evaluation frameworks.
Skills & tools
- Python
- Machine Learning frameworks
- Data pipeline technologies
Practical notes
The base salary for this position ranges from 152,000 USD to 241,500 USD, depending on your location, experience, and the compensation of peers in similar roles. In addition to salary, you will be eligible for equity and a comprehensive benefits package.
Applications will be accepted until at least July 30, 2026.
NVIDIA employs AI tools in its recruitment processes and is dedicated to creating an inclusive workplace. We celebrate diversity and are an equal opportunity employer, ensuring that all hiring practices are free from discrimination based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other legally protected characteristic.