Getting Started With Executive Analytics
Executive Analytics is a robust, data-packed dashboard that connects the performance of your hiring process to bottom-line concerns like cost savings, time reduction, and candidate quality metrics.
Here, we also collate snapshots of your candidate pools, showing you where candidates are coming from, what kinds of experiences they're having, and what their preferences and skill areas are. This can inform strategies to improve candidate response rates, experience metrics, and retention through the process. Whether you're glancing at trends or unpacking deep insights, Executive Analytics will help bring out the information that matters to your business.
As you explore Executive Analytics, you can use this article as a tour guide. Please note that account permissions dictate who has access to certain features within Executive Analytics, so contact your company admin if you don't see what you think you should be seeing.
Where to find Executive Analytics
If Executive Analytics is enabled for your account, this view will become your new CodeSignal home screen. You can also navigate to it from other sections by clicking Analytics in the top navigation bar in CodeSignal, to the left of Pre-Screen.
Use the date picker tabs in the top right of the screen to change the period for which Executive Analytics are measured, such as the past 12 months or the year to date. Selecting Custom in this date picker will give you the option to select any date range between when you first started using CodeSignal and today. All of the metrics in Executive Analytics will automatically update to reflect the time period you choose.
The five main Executive Analytics sections are:
- Estimated Value
- Candidate Performance
- Talent Map
- Popular Languages
- Candidates' Experience Ratings
All of the metrics in these modules are based on your company's Pre-Screens and Tech Screens use.
Estimated Value
The estimated value section provides at-a-glance metrics that help you quantify the time and money you're saving in your hiring process. All four metrics are calculated by comparing your CodeSignal usage now against estimates of your hiring process pre-CodeSignal. Check out this article for a deeper dive into how we calculate each metric.
Some of the variables used in these calculations are based on estimates from industry research. Users with the appropriate permissions will see a "Customize" button along the bottom right of the panel. The customization screen lets you override the default research-based values if you have more specific data.
Estimated Value is how much money we estimate you've saved so far using CodeSignal. Total Engineering Hours Saved shows how much less time your engineers are spending on the dreaded administrative work of screening applicants, time that they now have to do the tasks that directly impact your product or service.
Average Reduction in Cost per Hire zooms in to show you your average savings per offer, when accounting for the cost of screening all of the other candidates in that pool as well. And Average Reduction in Time to Hire estimates your time savings overall for each new hire, and how effectively you're minimizing the "limbo period" for candidates.
Candidate Performance
Candidate Performance is a per-assessment analysis of your candidates' skills. Because scores for Certified Evaluations backed by the same Skills Evaluation Framework are directly comparable, we can compare your candidates' scores with candidate scores across CodeSignal for that Skills Evaluation Framework (the "Benchmark"). We do this both with score distributions, showing how many candidates scored in each range, and with a comparison of the average scores of your candidates versus the benchmark. Each quarter, we update these benchmark averages for the Score Distribution Overview, to show you a timely comparison of your candidates versus the general pool.
In addition to the score distribution, you'll also see a Skill Area Distribution Overview and a Skill Area Analysis for each Certified Evaluation your organization uses. These visuals give you a sense of where your candidates' strengths and areas of improvement lie. Candidates are ranked from Developing to Expert depending on their proficiency. Each Skills Evaluation Framework covers different skill areas, and some cover a larger number of skill areas than others. Click View All below the Skills Area Distribution Overview graph to uncover the full analysis.
Talent Map
The Talent Map shows where your candidates are coming from, along with their invitation response rates. These insights can tell you if candidates from certain regions are interested in the invitations you're sending, or if you might need to reevaluate your sourcing strategy.
We measure response rate by looking at IP addresses and seeing how many candidates from any given country begin a Pre-Screen or Tech Screen after receiving an invite. Both Certified Evaluations and Custom Pre-Screens, as well as Tech Screens, are included in this data. Please note that since reliable IP address data is not always available, there may occasionally be a small discrepancy in total responses.
You can also compare your company's country-level response rates with aggregated response rates across all CodeSignal customers. This can also inform sourcing by showing you countries where there might be untapped potential based on other customers' Pre-Screen and Tech Screen usage. For busier regions where you want a closer look, zoom in using the buttons on the bottom right of the map.
Popular Languages
Popular Languages is a graph that shows the coding languages that your candidates prefer in Pre-Screens and Tech Screens. This information can be useful in aggregate to see if candidates roughly align to your engineering team's preferences. If your engineering team prefers PHP and 60% of your candidates are using Python or Javascript in their Pre-Screens and Tech Screens, you might expect new hires to need some more support in that area as they settle into the team. You can also see a language preference distribution across all candidates running code in Pre-Screens or Tech Screens, giving you a sense of where the broader market is trending.
Each data point in this graph represents one code execution from one candidate, so the languages here represent what candidates are actually using, not just what they say they prefer. However, note that some Certified Evaluations are backed by frameworks that only accept certain languages. For example, if a large part of the invites you're sending are for Certified Evaluations leveraging the General Coding Framework, you'll likely see a wider language distribution than if all of your Certified Evaluations use the Machine Learning Core Framework. Popular Languages are calculated across both custom Pre-Screens and Certified Evaluations, as well as Tech Screens.
My Candidates' Experience Ratings
My Candidates' Experience Ratings tracks how your candidates rate their user experience, plus the fairness and perceived relevance of the Pre-Screen or Tech Screen they've just completed. All candidates completing Pre-Screens and Tech Screens, whether those are custom or Certified Evaluations, are invited to rate their experience. The three questions ask candidates about UX, fairness, and relevance, and we aggregate their responses into this timeline graph, showing how candidate sentiments change over time.
The statement candidates rate for UX is: "The platform provided a good user experience." For fairness: "Given the purpose of this evaluation, the questions seemed fair." And for relevance: "The questions represented what I would expect to do on the job."
These insights on candidate experience can point out places where candidates might be struggling. Monitoring these metrics can also give you a sense of how changes in your hiring practices have affected candidate experiences. Candidates might not be comfortable giving feedback about pain points in person, and anonymized data like My Candidates' Experience Ratings can be more representative of hidden friction.
Questions? Contact your CSM or email support@codesignal.com.