Role summary
Comfrt, a fast-growing DTC brand focused on mental wellness and comfort, seeks a CRO Specialist to drive their testing roadmap. This role involves designing and launching end-to-end A/B and multivariate tests across web and mobile, analyzing results, and ensuring roadmap health. Responsibilities include defining metrics, monitoring tests, reporting findings, maintaining the roadmap, generating testing ideas, collaborating with vendors and internal teams (tech, retention, paid), and supporting reporting dashboards. The ideal candidate has 2-3+ years of ecommerce CRO experience, expertise in testing platforms, strong metrics literacy, analytics comfort, CMS experience, front-end technical fluency (HTML/CSS/JS), project management skills, and familiarity with the Shopify ecosystem and workflow tools like Asana, Jira, or Clickup. This is a fully remote, full-time position with a salary range of $80,000-$100,000 annually.
About Us:Comfrt is one of the fastest-growing direct-to-consumer brands, dedicated to blending mental wellness, inclusivity, and elevated comfort into every piece we create. Our mission goes beyond clothing — we strive to build a community where everyone feels supported and seen.
About the Job: The CRO Specialist is the execution driver for Comfrt’s testing roadmap. You’ll design and launch experiments end-to-end, keep the roadmap moving, and flag risks before they derail strategy. You are fluent in reading and analyzing test results and knowing what metrics actually matter for different test types. This role requires both technical fluency and analytical depth, with comfort navigating testing platforms and designing what you actually measure. You’re proactive, eager to learn from data and scale with the business. This role reports to the CRO Manager.
Responsibilities:
1. Experimentation Execution
Build and launch A/B and multivariate tests across web and mobile within our testing platform and CMS
Define what you’re measuring for each test before launch, understanding what metrics matter for that specific hypothesis.
Set up audience targeting and segmentation for each test based on test design requirements
Own test monitoring: ensure tests run cleanly, flag obvious data issues, validate test is hitting your sample size targets
Report test results to the CRO Manager with clear findings and action plan (raw data, what won/lost/was inconclusive) 2. Roadmap Execution & Health
Maintain the testing roadmap: keep it updated, track progress, and flag delays or blockers
Ensure tests launch on schedule and meet quality standards
Identify risks to the roadmap early (vendor delays, technical blockers, launch issues) and surface them immediately
Collaborate with design and development to keep test implementations on track 3. Experimentation Ideation
Generate testing ideas based on data findings from the data team, UX insights, and business priorities
Build post-mortems on all tests: document learnings so patterns and insights compound over time
Own the hypothesis repository: track what we’ve tested and what we’ve learned 4. Vendor Partnership Execution
Execute experiments within vendor platforms (PrettyDamnQuick, Algolia, Fuego mobile app, and more)
Manage day-to-day coordination with vendor teams on test status, blockers, and deliverables
Ensure mobile app testing aligns with web business and retention priorities 5. Front-End QA Lead & Cross-Department Collaboration
Collaborate seamlessly with tech, retention, and paid teams to develop testing ideas that drive revenue across channels and customer lifecycles
Own visual QA for all front-end implementations before they go live
Ensure that new features match the requirements and intent outlined in the original brief
Catch bugs, broken flows, and edge cases before production
Partner with developers to validate implementation quality 6. Reporting & Dashboard Support
Help maintain and refresh ecommerce reporting dashboards with data team (Looker Studio) — ensuring they’re accurate and up-to-date
Monitor daily site health metrics: core KPIs, add-to-cart rates, checkout abandonment, and more
Flag anomalies or risks you detect in dashboards (e.g., unexpected CVR drops, traffic changes) and assess severity
Provide the CRO Manager with weekly testing KPI snapshots to feed into leadership recaps Requirements:
2-3+ years in ecommerce CRO (agency, in-house, or DTC brand)
Testing platform expertise: you’ve owned, designed, and launched A/B tests, understand how to structure experiments
Metrics literacy: you know what metrics matter for different test types (CVR for conversion tests, AOV for pricing tests, etc.) and can read test results
Analytics comfort: you can read dashboards, spot obvious anomalies, ask clarifying questions about data
CMS platform experience: you can navigate and build tests in a modern CMS or testing tool
Front-end technical fluency: you can read HTML/CSS/JavaScript, communicate clearly with developers, spot implementation issues
Project management chops: you keep roadmaps tight, flag blockers early, coordinate across teams
Strong familiarity with Shopify ecosystem: You have a deep understanding of which vendor provides and it’s impact on an eCommerce business
Familiarity within key workflow tools such as Asana, Jira, & Clickup
Proactive and self-directed in fast-paced environments; eager to learn and grow the eCommerce function as the business scales
You see blockers early: Problem-solve autonomously, and view every experience as a learning opportunity What Success Looks Like:
Tests launch on schedule with clear hypotheses and defined success metrics
You’re flagging roadmap risks 2-3 weeks before they become problems
Post-test documentation is thorough: every test has a clear learnings summary
You can read a test result and explain what won/lost and why it matters
Dashboard anomalies are caught and escalated within 2 hours
You’re generating high-quality test ideas based on data patterns and UX insights
You gain a deep understanding of customer behavior and how our eCommerce efforts impact this behavior Why Join Comfrt?:
Be part of a purpose-driven company that’s shaping the future of comfort and mental wellness.
Work in a supportive, creative environment where your ideas and growth are valued.
Enjoy Comfrt benefits such as generous paid time off, company-covered health insurance, 5% 401k match, and discounts on all Comfrt products!
Join a passionate team making an impact on exciting projects, all while enjoying the flexibility and collaborative support of a fully remote environment.
The salary range for this role is $80,000–$100,000 annually. Actual compensation will be determined based on experience, skills, qualifications, and geographic location, where applicable. This range represents the anticipated base salary and does not include bonus, benefits, or other forms of compensation. Comfrt is an equal opportunity employer. We are committed to building a team that represents a variety of backgrounds, perspectives, and skills.