Psychometrician / Student Assessment Development Specialist

Position Title: Psychometrician / Student Assessment Developer
Location: Quantico, VA (Russell Knox Building)
Work Modality: 100% On-Site (SCIF Environment)
Security Clearance: Active Top Secret / Sensitive Compartmented Information (TS/SCI)
 

About Team Carney

Carney specializes in empirical learning validation, human capital analytics, and instructional system rigor. We ensure defense education initiatives deliver measurable competency outcomes and institutional accreditation excellence across all operational domains.

Position Overview

Carney is seeking a highly analytical Psychometrician / Student Assessment Development Specialist to lead training needs assessments, test construction, validation, and empirical measurement across JCITA’s training enterprise at Quantico, VA. The Psychometrician develops statistically sound assessment instruments, oversees exam integrity within secure facilities, and conducts comprehensive test item and trend analyses to validate student achievement and brief executive stakeholders.

Essential Duties & Responsibilities

• Design, build, and validate objective student assessment instruments—including criterion-referenced written exams, performance rubrics, and practical exercise evaluation scorecards.

• Conduct and participate in training needs analyses, practice analyses, and task analyses (CDRL A014) to define observable, measurable student performance requirements.

• Perform classical and modern test item analyses (item difficulty, discrimination indices, reliability coefficients) to optimize exam item banks and identify testing anomalies.

• Aggregate and analyze end-of-course (EOC) student evaluations and curriculum survey data; draft high-impact analytical summaries within two (2) days of survey receipt (CDRL A011).

• Author executive-level metric and evaluation briefings, including the Annual EOC Metrics Report (CDRL A013) and the Annual Board of Governors Report (CDRL A012).

• Advise JCITA leadership, academic deans, and course chairs on best practices in testing policy, remediation pathways, test security, and psychometric standards.

• Ensure testing architectures uphold strict Council on Occupational Education (COE) accreditation criteria and defense counterintelligence academic policies.

Required Minimum Qualifications (Hard Contractual Baselines)

• Security Clearance: Must hold an active, verified Top Secret / SCI (TS/SCI) clearance at the time of proposal and award.

• Education (Mandatory – No Degree Waiver): Master’s degree in Psychology with a designated specialization in:

  • Industrial/Organizational (I/O) Psychology,

  • Organizational Behavior,

  • Personality Research,

  • Quantitative Methods, or

  • An equivalent graduate degree in educational measurement/psychometrics.

• Experience: Minimum of three (3) years of dedicated experience developing student assessment instruments, constructing valid test rubrics, or conducting formal training needs analysis.

• Technical & Analytical Proficiency: Demonstrated hands-on proficiency using Microsoft Excel for complex statistical analyses, trend reporting, data structuring, and visualization.

• Communication Skills: Demonstrated excellent written communication skills with proven ability to distill complex empirical findings into clear executive reports.

Preferred Qualifications

• Prior experience conducting psychometric validation for federal law enforcement, military, or intelligence training programs.

• Working knowledge of specialized statistical analysis software (e.g., SPSS, R, Python) alongside advanced Excel modeling.

• Experience presenting empirical findings to senior military flag officers and Defense Senior Executive Service (SES) leaders.