Registered Nurse - AI ChatBot Reviewer (US, Remote)
Required skills
- RN license
- clinical nursing practice
- clinical guidelines
- patient safety
- scope-of-practice
- structured review tools
- digital platforms
- written English
Nice to have
- AI evaluation
- model fine-tuning
- health coaching agent
- patient-facing health guidance
Role summary
Seeking experienced US registered nurses for a remote, short-term contract role to review and assess AI-generated health coaching responses. Responsibilities include structured grading, safety review, clinical accuracy assessment, and providing written feedback to train and refine AI models. Requires an active RN license, minimum 2 years of clinical nursing practice, strong knowledge of clinical guidelines, patient safety, and scope-of-practice boundaries, attention to detail, technical proficiency with review tools, and native/near-native written English. This flexible, asynchronous role offers hands-on experience in AI evaluation for patient care.
We are seeking experienced US registered nurses to review and assess AI-generated responses from a health coaching agent, with a focus on safety, regulatory compliance, and clinical content accuracy.
You will work asynchronously on a dedicated review platform, performing short, structured evaluations to help train and refine AI models for patient-facing health guidance.
This is a remote, flexible and short-term project.
Key Responsibilities:
Structured Grading: Score AI agent responses against a pre-defined rubric, applying the highest-priority criteria consistently across a large volume of items.
Safety Review: Identify responses that could cause patient harm missed red flags, unsafe advice, failure to escalate or signpost to care.
Clinical Accuracy: Assess factual correctness, completeness and guideline alignment of clinical content.
Written Feedback: Provide brief, specific rationale for each failed response and general guidance on how it could be improved.
Qualifications
Licensure: Active RN license for US
Experience: Minimum 2 years of clinical nursing practice.
Knowledge: Strong grounding in clinical guidelines, patient safety and scope-of-practice boundaries.
Attention to detail: Proven accuracy and consistency in clinical documentation or review work.
Technical proficiency: Comfortable using structured review tools and digital platforms.
Language: Native or near-native written English.
Legal Status
You will have the right to work in your country of residence.
You will work as an independent contractor.
Why Join Us?
Flexible Work Arrangements: Part-time, remote and fully asynchronous.
Competitive Compensation: Hourly rate
Professional Development: Hands-on experience in AI evaluation and model fine-tuning, shaping how AI is deployed in patient care.
Similar roles
- Venture Capital AI Research ContributorAptura · Remote · Remote
- Private Equity AI Research ContributorAptura · Remote · Remote
- CRegistered NurseCaring Hand Home Health Solutions · Remote · Remote
- Registered NurseSono Bello · Jacksonville, FL · Onsite
Transition Services Coordinator (Registered Nurse) - NursingVancouver Coastal Health · Vancouver, BC · Onsite
Care Manager - Registered NurseMonogram Health · Macon, GA · Onsite
