Principal Test Engineer - Agentic AI

About the role

The Principal Test Engineer at Businessolver owns the end to end quality strategy for our SaaS platform and ensures that agentic testing practices are embedded across the product lifecycle. This role focuses on leveraging AI to automate and enhance testing while reducing reliance on manual effort across engineering teams. The hire will define enterprise testing standards and evolve the UI automation framework to support scalable and reliable validation. They will partner closely with product, architecture, and engineering teams to align testing priorities with system design and business risk. A key responsibility is developing and guiding the adoption of agent-driven test solutions that accelerate delivery without compromising quality. The role requires mentoring quality focused team members and influencing testing culture across the organization. The Principal Test Engineer will also evaluate tooling and methodologies to improve test signal, productivity, and long term maintainability. All other duties as required to support the mission of complete client delight.

Key facts

What you'll do

Develop AI Agents that perform manual and automated testing to support rapid delivery of code changes.

Drive the development and adoption of agent-driven manual and automated testing practices to improve test creation, execution efficiency, coverage, and defect detection.

Define and maintain the overall testing strategy across unit, integration, API, UI, regression, exploratory, performance, and risk based testing.

Own the direction, maintenance, and continuous improvement of the UI automation framework, with emphasis on reliability, scalability, reuse, speed, and long term maintainability.

Lead the technical approach for performance and load testing, including test design, tooling direction, coverage priorities, result analysis, and recommendations for system improvement.

Build a strong understanding of system architecture, application workflows, integrations, and technical dependencies, and align testing strategy to the areas of highest business and technical risk.

Establish, document, and refine testing standards, engineering best practices, and quality guardrails that improve consistency and reduce defect escape.

Provide hands on technical leadership in test design, framework enhancement, troubleshooting, and resolution of complex quality and automation challenges.

Mentor members of the quality team in sound testing practices, including stronger use of unit and integration testing.

Partner with software engineers, architects, product teams, and other stakeholders to influence quality strategy early in solution design and throughout delivery.

Evaluate and recommend testing tools, frameworks, and methodologies that improve productivity, test signal quality, and long term supportability.

Review test coverage, quality risks, and validation approaches for new features and platform changes, and communicate clear recommendations to technical and non technical stakeholders.

Promote continuous improvement across testing processes, tools, and practices.

Comply with all standards and policies established by the organization.

Execute exploratory testing to uncover issues that may not be evident through scripted approaches.

Support test planning activities that consider system complexity, release schedules, and business criticality.

Champion the use of traceability between requirements, tests, and defects to improve transparency.

Assist in the design of test data strategies and environment configurations to support reliable test execution.

Contribute to the definition of quality metrics and dashboards for engineering and product leadership.

Ensure testing activities adhere to security, privacy, and compliance requirements as applicable.

Collaborate with distributed engineering teams to maintain testing standards across time zones.

Document test artifacts, including strategies, cases, and results, to ensure clarity and repeatability.

Support the integration of testing into CI/CD pipelines to provide rapid feedback on code quality.

Identify opportunities for test optimization and cost effective risk mitigation.

Act as a subject matter expert for testing practices within the organization.

Lead root cause analysis for complex quality issues and drive corrective actions.

Encourage knowledge sharing and continuous learning within the testing community.

Requirements

Bachelor degree in computer science, engineering or a related field or equivalent practical experience.

8+ years of experience in quality assurance, software engineering, or a related field, with a strong focus on automated and manual testing strategies in high volume environments.

Proven success using AI assisted and agent driven testing to improve coverage, efficiency, and quality outcomes.

Experience developing and executing enterprise test strategies across unit, integration, API, UI, regression, exploratory, and performance testing.

Strong proficiency with modern test automation frameworks, tools, and languages commonly used in enterprise environments.

Solid understanding of software development practices, including CI/CD, version control, and agile methodologies.

Demonstrated ability to design, implement, and maintain scalable and reliable test automation solutions.

Experience with performance and load testing tools and practices, including result analysis and actionable recommendations.

Excellent analytical and problem solving skills, with attention to detail and a methodical approach to testing.

Strong written and verbal communication skills for collaborating with technical and non technical stakeholders.

Ability to work independently and make sound decisions in a fast paced, dynamic environment.

Commitment to continuous learning and adapting to new technologies, testing techniques, and quality practices.

Willingness to mentor and guide team members on testing best practices and quality standards.

Understanding of security and compliance considerations relevant to enterprise software testing.

Ability to manage multiple priorities and deliverables in a deadline driven environment.

Demonstrated experience influencing stakeholders and driving quality initiatives across cross functional teams.

Consistent adherence to policies, standards, and governance within a regulated or enterprise context.

A passion for quality and customer delight that aligns with Businessolver's service oriented culture.