Technical Skills Assessments: Human-Powered Scoring > Automated Assessments
Woven is the pioneer and the leader in Human-Powered technical skills assessments. Every submission from a candidate is reviewed by two Certified Engineers, is scored to an obsessively detailed rubric, and proctored for AI assistance detection.
This allows the platform to generate recommendations for candidates beyond a simple score or percentage. Candidate results come with a detailed work analysis, comparable if not better than, interview notes your current team would provide.
Additionally, each candidate receives feedback on their work.
Overview of Wovens Human-Powered Scoring For Technical Skills Assessments
Scorer Background and Selection:
Woven scorers for technical skills assessments have backgrounds in software development or software engineering. They undergo a thorough and deliberate selection process, including a work simulation where they score anonymized sample assessments. Approximately 20% of candidates pass this initial evaluation. The successful candidates then go proceed to complete an onboarding process, complete training modules and shadowing scorers during live scoring sessions.
Scorers that meet the bar for low error rates become certified as scorers of Woven’s technical skills assessment in production. Each day scorers receive a detailed feedback report to with improvement notes from the Woven QA team. Woven leadership will also complete a monthly review of scorer performance to ensure KPIs and SLAs are met.
Ongoing coaching for new scenarios, languages or changes to rubrics is done consistently.
Reliability and Consistency:
Each technical skills assessment submission from a customer’s candidate goes through a double-blind scoring process, graded to a specific rubric (looking for true/false items in each answer). Although rare, less than 1% of the time, when a scoring discrepancy occurs on any individual rubric item the scores are reconciled by a Senior Certified Scorer.
Ensuring the highest standards of scorer reliability and consistency is integral to our commitment to delivering accurate and fair technical assessments.