Subject Matter Expert (SME) in Technology Ventures
We are looking for US based SMEs with experience working on Assessment items for one of our clients. The task is to review the AI-generated assessment items for quality and accuracy.
Key Responsibilities:
● Review and revise AI-generated assessment questions for clarity, accuracy, and adherence to assessment standards.
● Ensure all questions comply with formatting and quality requirements, including:
○ Distractors must be plausible and not easily eliminated.
○ Answer options must follow grammatical and formatting conventions (e.g.,
capitalization, punctuation, and parallel structure).
○ Alternatives must be uniform in length and structure to avoid visual clues.
● Verify that multiple-choice questions (MCQs) have only one definitively correct answer.
● Check that multi-select questions:
○ Do not combine multiple concepts into a single question.
○ Include clear instructions indicating that more than one correct answer is expected.
○ Use grammatically correct and natural phrasing in stems.
● Ensure fill-in-the-blank questions:
○ Use only key terms as blanks.
○ Contain only one blank per question and expect only one word as the correct response.
● For SmartBook-only items, confirm that correct answers can be found in or inferred from the associated text highlight.
● For GO-only items, ignore irrelevant questions, such as those derived from chapter introductions or summaries.
● Apply provided assessment review checklists and best practices consistently.
● Clearly document and justify any revisions made to the assessment items.
Qualifications:
- Strong subject matter expertise in the field.
- Demonstrated experience in reviewing or evaluating educational assessments or academic content.
- Excellent grammar, editing, and proofreading skills.
- Ability to follow detailed review rubrics and editorial standards.
- Strong attention to detail and consistency.
- Ability to work independently and meet deadlines.
Preferred Skills:
- Familiarity with AI-generated content or adaptive learning platforms (e.g., SmartBook, Connect).
- Experience in academic quality assurance or assessment validation.
Timelines and Payout:
- Expected time availability: 15-20 hours per week
- Expected project start date – Immediate
Job Types: Full-time, Contract
Pay: $35.00 per hour
Work Location: Remote