Lead QA Engineer
Role summary
FINNY is seeking a Lead QA Engineer to ensure the reliability and scalability of its AI-powered financial advisor growth platform. This role involves owning and evolving test infrastructure using tools like Playwright and pytest, integrating tests into CI/CD pipelines, and designing comprehensive test coverage across functional, API, and end-to-end testing. A key responsibility will be contributing to LLM evaluation efforts by building eval frameworks, designing test datasets, and establishing regression suites for AI outputs. The Lead QA Engineer will also scale testing practices, guide engineers on quality, and collaborate across engineering teams to advocate for quality throughout the development cycle. The ideal candidate possesses strong automation skills, experience with Python and TypeScript codebases, and a passion for enabling speed with confidence.
# About FINNY
FINNY is a growth platform for financial advisors. We are on a mission to make great financial advice easier to find. Today, access to quality financial guidance is limited, not because advisors don’t exist, but because the right connections are hard to make when it matters. We’re fixing that with AI-powered tools that help advisors find, engage, and retain the clients they can genuinely help.
We’ve raised a 4.3 million pre-seed from Y-Combinator in S24 and now $17M Series A led by Venrock. We work with firms across the wealth management ecosystem, and have been recognized as a leader in fintech innovation—winning #1 at the Morningstar Fintech Showcase and being featured across the industry.
We’re based in Chelsea, NYC, building fast and ambitious systems at the intersection of data, AI, and real-world wealth services.
# About the Team
The QA Engineering team at FINNY ensures that everything we ship is reliable, scalable, and delivers a seamless experience for financial advisors and their clients. They work across the full product lifecycle, partnering closely with engineering, product, and design to define test strategies, build automated testing frameworks, and proactively identify issues before they reach production. In a fast-moving, AI-driven environment, QA at FINNY isn’t just about catching bugs—it’s about enabling speed with confidence, safeguarding product quality as we rapidly iterate, and making sure every release meets a high bar for performance, accuracy, and user trust.
# What You’ll Do
- Own and evolve test infrastructure: Improve and extend our existing testing frameworks using Playwright, pytest, and Vitest. Strengthen CI/CD integration and build the systems to support continuous quality assurance
- Own end-to-end quality: Design and implement comprehensive test coverage across functional testing, API testing, smoke testing, and end-to-end workflows. Ensure our platform works reliably for financial advisors
- Contribute to LLM evaluation efforts: Work with the engineering team to build eval frameworks for our AI-powered content generation and research features. Design test datasets, create automated scoring systems, and establish regression suites for AI outputs
- Scale testing practices: Establish testing standards, guide engineers on quality practices, and build reusable test utilities as the team grows
- Collaborate across the stack: Partner with backend, fullstack, and ML engineers to catch issues early, improve testability, and advocate for quality throughout the development cycle
- Contribute to the codebase: Write bug fixes, build test utilities, and improve developer tooling across our Python backend and TypeScript frontend
# What We’re Looking For
Must-haves:
- Strong automation skills with Playwright, pytest, and modern JavaScript testing frameworks (Vitest/Jest)
- Experience building test infrastructure and integrating tests into CI/CD pipelines (GitHub Actions, GitLab, or similar)
- Ability to read and navigate codebases in Python and TypeScript
- Understanding of multiple testing approaches: functional, API, smoke, end-to-end testing
- Experience with or strong interest in LLM testing: understanding non-deterministic outputs, designing eval datasets
- Excellent communication skills: you explain quality issues clearly and work collaboratively with product and engineering
Nice-to-haves:
- Experience with AI-assisted testing tools (Rainforest QA or equivalents)
- Background at AI-first or data-intensive companies
- Familiarity with LLM eval frameworks
- Knowledge of performance, load, or security testing
- Experience with our stack: FastAPI, AWS, Postgres, MongoDB
Your working style:
- You view QA as an enabler, not a gatekeeper. You help the team ship faster with confidence
- You tackle ambiguity head-on and iterate quickly with minimal oversight
- You thrive when priorities shift and adapt quickly without losing momentum
- You have strong opinions on test coverage trade-offs and can articulate your testing philosophy
# Compensation & Benefits
FINNY offers a competitive compensation package including:
- Competitive salary and equity
- Medical, dental, and vision insurance
- Flexible paid time off
- 401(k)
- Food and meals provided in our NYC office
- Team offsites and events
# Equal Opportunity Employer
FINNY is an equal opportunity employer. We are committed to diversity and inclusion in our company. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Compensation Range: $160K - $190K
Similar roles
QA EngineerFetchJobs.co · United States · Remote
Junior QA EngineerCrosstie · United States · Remote
Sr. QA EngineerRenesas Electronics · Los Angeles, California, United States · Hybrid
QA EngineerSHL Medical · North Charleston, South Carolina, United States · Onsite
Senior QA EngineerRocketParts · United States · Remote