Registered Nurse - AI ChatBot Reviewer (US, Remote)
Required skills
- RN license
- clinical nursing practice
- clinical guidelines
- patient safety
- scope-of-practice boundaries
- structured review tools
- digital platforms
- written English
Nice to have
- AI evaluation
- model fine-tuning
Role summary
Seeking experienced US registered nurses for a remote, short-term project to review and assess AI-generated health coaching responses. Responsibilities include evaluating safety, regulatory compliance, and clinical accuracy using structured tools, providing written feedback, and helping to train AI models. Requires an active RN license, minimum 2 years of clinical practice, strong knowledge of clinical guidelines and patient safety, attention to detail, technical proficiency with review platforms, and native/near-native English. This is a flexible, asynchronous, contract role.
We are seeking experienced US registered nurses to review and assess AI-generated responses from a health coaching agent, with a focus on safety, regulatory compliance, and clinical content accuracy.
You will work asynchronously on a dedicated review platform, performing short, structured evaluations to help train and refine AI models for patient-facing health guidance.
This is a remote, flexible and short-term project.
Key Responsibilities
- Structured Grading — Score AI agent responses against a pre-defined rubric, applying the highest-priority criteria consistently across a large volume of items.
- Safety Review — Identify responses that could cause patient harm missed red flags, unsafe advice, failure to escalate or signpost to care.
- Clinical Accuracy — Assess factual correctness, completeness and guideline alignment of clinical content.
- Written Feedback — Provide brief, specific rationale for each failed response and general guidance on how it could be improved.
Qualifications
- Licensure — Active RN license for US
- Experience — Minimum 2 years of clinical nursing practice.
- Knowledge — Strong grounding in clinical guidelines, patient safety and scope-of-practice boundaries.
- Attention to detail: Proven accuracy and consistency in clinical documentation or review work.
- Technical proficiency: Comfortable using structured review tools and digital platforms.
- Language — Native or near-native written English.
- Legal Status — You will have the right to work in your country of residence.
- You will work as an independent contractor.
- Why Join Us?
- Flexible Work Arrangements: Part-time, remote and fully asynchronous.
- Competitive Compensation — Hourly rate
- Professional Development — Hands-on experience in AI evaluation and model fine-tuning, shaping how AI is deployed in patient care.
Similar roles
- Private Equity AI Research ContributorAptura · Remote · Remote
- Legal AI Research ContributorAptura · Remote · Remote
- Registered NurseSono Bello · Jacksonville, FL · Onsite
Transition Services Coordinator (Registered Nurse) - NursingVancouver Coastal Health · Vancouver, BC · Onsite
Care Manager - Registered NurseMonogram Health · Macon, GA · Onsite- Registered Nurse (RN) Delegating Nurse – Assisted Living | PRNNational Lutheran Communities & Services · 9701 Veirs Dr · Onsite
