RiseMe
Roadie logo
Roadie Verified
Logistics, On-demand Delivery, Transportation, E-commerce

Software Engineer in Test

RemoteRemoteFull TimePosted 2 months ago

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

  • data science testing
  • automation capabilities
  • software delivery pipeline
  • data products
  • data models
  • test infrastructure
  • automated regression testing
  • data science microservices
  • automation issues
  • automated test suites

Nice to have

  • performance testing
  • Data Science concepts
  • ML models
  • groundcover
  • Sentry
  • MLFlow

Role summary

Roadie is looking for a Software Engineer in Test to enhance their data science testing and automation. This role involves building test infrastructure for data science microservices, troubleshooting automation issues, and improving test suite performance. The engineer will develop test strategies, execute test cases, review requirements, and collaborate with other engineers on system testing and defect resolution. The ideal candidate has 3+ years of experience in a QA automation role, with preferred Python coding experience and familiarity with APIs, databases, testing frameworks (Pytest), monitoring tools (Grafana, New Relic), CI/CD tools (CircleCI, GitHub Actions), SQL, and cloud solutions (AWS).

Roadie, a UPS company, is a leading logistics and delivery platform that helps businesses tackle the complexities of modern retail with unmatched delivery coverage, flexibility and visibility. Reaching 97% of U.S. households across more than 30,000 zip codes — from urban hubs to rural communities — Roadie provides seamless, scalable solutions that meet a variety of delivery needs.

With a network of more than 310,000 independent drivers nationwide, Roadie offers flexible delivery solutions that make complex logistics challenges easy, including solutions for local same-day delivery, delivery of big and bulky items, ship-from-store and DC-to-door. For more information, visit www.roadie.com.

Roadie is seeking a Software Engineer in Test to join our talented team of developers. In this role, you’ll advance our data science testing and automation capabilities, tackle complex challenges across the software delivery pipeline, and help ensure our data products, models, and insights are accurate, reliable, and ready to scale.

What You’ll Do

  • Build robust test infrastructure that powers automated regression testing for data science microservices
  • Troubleshoot and resolve automation issues across multiple environments
  • Improve the performance, reliability, and stability of automated test suites
  • Develop and execute comprehensive test strategies and high-impact test cases
  • Review product requirements to ensure alignment with established design and quality guidelines
  • Partner with software engineers and fellow test engineers to conduct end-to-end system testing and post-deployment validation
  • Identify, isolate, and clearly document product defects, then verify fixes through resolution
  • Champion quality at every stage of the software development lifecycle

    • What You Bring

  • 3+ years experience in a developer, SDET or QA automation role
  • 3+ years coding experience in Python preferred; coding/scripting in other languages such as Ruby, Bash or Javascript, a plus!
  • Experience with testing APIs and DBs
  • Experience in testing frameworks - Pytest preferred
  • Experience with monitoring tools like grafana, NewRelic or similar
  • Experience in CI/CD tools such as CircleCI, github action or similar
  • Be able to write and analyze SQL queries
  • Experience with cloud solutions such as AWS
  • Experience with tools such as github, JIRA, postman
  • Demonstrated background of writing clean, stable, maintainable code
  • Strong understanding of testing methodologies and automated testing approaches
  • Excellent troubleshooting and communication skills
  • Thrives in fast-paced environment, with ability to operate within short release-cycles

    • Bonus

  • Familiarity with performance testing and related tools
  • Familiarity with Data Science concepts
  • Experience with testing ML models
  • Experience with Kafka, groundcover, Sentry, MLFlow
  • Understanding of the full application development lifecycle

    • Why Roadie?

  • Competitive total rewards package
  • 100% company-paid health insurance for yourself
  • 401(k) with company match
  • Tuition & student loan repayment assistance- yes, we’ll contribute directly to your student loans!
  • Remote-first environment
  • Unlimited PTO
  • Inclusive family leave policy that supports all new parents
  • Paid Wellness Days in addition to Company holidays
  • Monthly WFH stipend
  • Paid sabbatical leave- tenured Roadies are given extra time to unplug, rest, and explore
  • The technology you need to get the job done

    • This role is not eligible for visa sponsorship. Applicants must be authorized to work for any employer in the U.S.

    Ready to apply?
    You'll be redirected to Roadie's application page.

    Similar roles

    See how RiseMe works

    Match, tailor, and prep so you send fewer applications and land more interviews.