Sr. QA Automation Engineer

Description

Amplifire is seeking a Senior QA Automation Engineer to help redefine how quality assurance is performed through AI driven testing and automation. This role blends LLMs, AI agents, automation frameworks, and performance testing to improve test coverage, system reliability, and release confidence.

You will play a key role in designing and building AI powered QA capabilities—developing workflows that generate, maintain, and evaluate test cases; creating agents that simulate real user behavior; and defining how AI driven features are tested for quality and reliability.

This role also requires strong QA fundamentals. You will build and maintain automated regression suites, perform manual and exploratory testing for complex workflows, and ensure consistent quality across the system.

While AI driven QA is still emerging within Amplifire, this role will be hands-on from day one—building practical capabilities incrementally while supporting ongoing release quality.

Amplifire operates in a regulated environment (e.g., FedRAMP, SOC 2), where auditability, correctness, and reliability matter as much as development speed.

What
You’ll
Do

AI Assisted Testing & Quality Engineering

• Use LLMs and AI agents as a core part of test design, analysis, and automation workflows.

• Design and build AI-driven testing systems that simulate user behavior and surface regressions.

• Define evaluation approaches for AI-driven features to assess quality, reliability, and consistency.

• Establish guardrails for AI usage in QA and validate outputs.

• Evaluate emerging AI tools and help define how AI is applied across QA.

Automation, Manual Testing & Quality Fundamentals

• Build and maintain automated regression suites using Cypress or similar frameworks.

• Partner with engineering and product to embed quality early.

• Perform manual and exploratory testing for complex workflows.

• Maintain high-quality test cases and documentation.

• Track defects in Jira and contribute to quality metrics.

• Conduct root cause analysis on production issues.

Requirements

Qualifications

We care less about titles and more about demonstrated capability. The right person brings a strong foundation in QA along with hands-on experience applying modern AI tools to real testing challenges.

Required Experience

• 4+ years of experience in Quality Assurance, including designing and maintaining automated test frameworks in production environments.
• 3+ years of experience with Cypress or similar modern E2E testing frameworks.
• Strong QA fundamentals, including test coverage strategy, risk assessment, defect writing, and regression planning / execution.

AI & Modern Tooling

• Hands-on experience applying AI/LLMs to testing workflows, such as generating test cases, analyzing results, and improving coverage with a practical understanding of limitations.
• Experience testing AI/LLM-driven features, including evaluating output quality, relevance, and reliability.
• Familiarity with modern AI development tools and workflows (e.g., Copilot, Claude Code, or similar), applied pragmatically.

Technical
& Collaboration skills

• Comfortable working across a modern web stack (e.g., React, TypeScript, Java, Python) and combining automation, manual, and exploratory testing for full system coverage.
• Strong debugging and problem-solving skills, with the ability to influence technical direction without formal authority through clear thinking, execution, and collaboration.

What Success Looks Like

Within your first year, success in this role looks like:

• AI-driven testing meaningfully reduces manual regression effort without reducing confidence.
• Clear, repeatable evaluation methods exist for AI-generated outputs and AI-driven features.
• Automated test coverage is more stable, more targeted, and easier to maintain.
• AI-first workflows are adopted and usable by other QA engineers.

Compensation

• Base salary range: $130,000 – $150,000

About
Amplifire

Amplifire, headquartered in Boulder, CO, is the leading AI Learning Platform built on brain science that delivers the proven results of 1:1 expert instruction at enterprise scale. We deliver one-on-one AI instruction at scale, detect where people are confidently wrong, and fix it before it becomes a mistake—reducing training time by 50–80% while driving measurable performance outcomes.

Trusted by leading organizations in healthcare, accounting, life sciences and other high-stakes industries, Amplifire enables teams to achieve verified competency faster, reduce risk, and perform at the highest level when it matters most.

Salary Description

130,000 - 150,000