We are excited to release new coding score system across all CodeSignal Skills Evaluation Frameworks! You may be requested to complete any of these evaluations on behalf of various companies, and with this new coding score system, you can look forward to companies’ being able to better gauge your core skills and level of expertise.
If you have completed a skills evaluation in the past, CodeSignal will automatically convert your historical coding scores to Assessment Score. Thus, your existing coding reports will remain shareable with companies that request them in the future!
Read on to learn how to interpret the results of Assessment Score, and how it is calculated.
About Assessment Score
The new range for our coding score was recalibrated by our team of IO Psychologists after reviewing data from tens of thousands of assessment completions. Previously, the General Coding Framework used a 600-850 score range, and other Frameworks produced a raw score out 1,000. Now, when you complete a skills evaluation that is framework-based, your coding score will range from 200-600 and your coding report will give visibility into the mastery of individual skills being evaluated.
- Overall Coding Score: Each Skills Evaluation Framework you complete will result in a single Coding Score that quantifies your core skills. This number will range from 200-600, with higher scores indicating that you successfully completed more questions in the assessment.
- Skill area proficiency: Assessment Score also gives you insight into your level of proficiency across the various skills that each Skills Evaluation Framework measures. This data is meant to inform you of areas where you may need more development.
The score interpretation is very straightforward, higher scores indicate that candidates successfully completed more of the assessment, thus demonstrating more of the relevant skills being evaluated by the assessment. Under that lens, candidates should not spend all of their time on a single question, if possible. The more questions a candidate is able to successfully complete within the time frame the higher their score will be. Although speed is not an explicit element of the scoring, it is implicitly part of it such that candidates want to successfully complete as many questions as they can, as previously mentioned.
How Assessment Score is Calculated
The Assessment Score includes a two-tiered scoring system contributing to the overall score and a detailed breakdown of skill proficiencies based on performance. Questions within a Skills Evaluation Framework are organized and grouped into modules. Within the two-tiered system used for calculating the overall score, the first tier (i.e., the base points) treats all modules or question groups equally; the second tier (i.e., the bonus points) is awarded upon full completion of a module.
Assessment Score uses a two-tiered scoring system for each module (a set of 1 or more questions). Note: Bonuses are derived from normative difficulty and discrimination parameters for all questions within the module.
- First tier: The first tier refers to the base points you can earn by successfully completing all questions within a module within the Skills Evaluation Framework. As you successfully completes more questions within a module, you can earn up to the module’s base point value.
- Second tier: The second tier refers to the bonus points you may be awarded based on performance. You can only earn bonus points for a module if you successfully solve 100% of the questions within the module. More bonus points are awarded for completing modules that are higher in difficulty.
- Final Score: Your final score ranges from 200 to 600.
Please note that if you completed an evaluation on CodeSignal in the past, your coding report will reflect the new Assessment Score format going forward. In these cases, the correctness of your solutions has not changed; rather, the original correctness of your code is simply recalculated in a new and improved format.
Skill Proficiency
CodeSignal also offers qualitative feedback on the individual skills each Skills Evaluation Framework measures, separate from the Assessment Score overall score. The feedback system was designed to: 1) provide companies and developers with greater insights into opportunities for your growth and development once hired, and 2) improve your experience by providing individualized feedback on specific skill areas where you currently excel or have the potential to develop their skills further. The feedback system includes qualitative descriptions of skill proficiency levels ranging from “Developing” to “Expert,” and a visualization of candidate skill proficiency levels, for the skills areas measured in each Skills Evaluation Framework. For example, skill areas of the General Coding Framework are Basic Coding, Data Manipulation, Ease of Implementation, and Problem-Solving.
Skill proficiency levels for each Skills Evaluation Framework are determined based on input from subject matter experts. Given that a specific skill may be relevant to multiple modules, candidates have increased opportunities to demonstrate skill proficiency by successfully completing more than one module. The level assigned depends on how successful completion of the modules linked to each skill area. The four possible skill proficiency levels are:
- Developing, candidate displays minimal skill proficiency
- Intermediate, candidate displays an average degree of skill proficiency
- Advanced, candidate displays an above average degree of skill proficiency
- Expert, candidate displays the highest level of skill proficiency
Overall, this new system is designed to maintain scoring consistency across Skills Evaluation Frameworks, increase the precision of measuring candidate skills, and improve fairness of evaluation results. We look forward to your next evaluation!
Questions about this new scoring system? Please contact support@codesignal.com for assistance.