CodeSignal’s product updates were in full Spring bloom this month with our teams releasing a mixed bouquet of product improvements, bug fixes, and feature updates. This month we’re highlighting 3 updates related to some of our most popular features—templates:
- Select and lock interview templates when creating an interview
- Configure custom feedback for interview templates
- Updated UI for template selection when creating a new test
Locking interview templates
Does your company use structured interviews and want to specify a template for interviewers to use in their coding interviews? You can now lock a template to a CodeSignal interview session when you create the interview URL. This means that an interviewer cannot change the template associated with this interview session.
Learn how to lock a template on interview creation from:
Customizable feedback for interview templates
When you edit or create a new interview template, you now have the option to customize how interviewers provide feedback on interview sessions that use a specific template. This allows you to specify categories and attributes for interviewer feedback, as well as choose whether to add fields to mark overall evaluation of a candidate and their recommended level.
To learn how to configure custom feedback for a template, follow the steps in this article:
Improved UI for test template selection
If your company is assessing skills for a popular programming language or skill area, CodeSignal probably has a test template for it. All our tests contain one code writing task and 10-20 multiple choice questions.
Now, when you create a new test in CodeSignal, you will be taken to a modal that allows you to choose a test template, categorized by test type. If you do not wish to use a template (that is, you'd like to create a custom test), click SKIP in the bottom right of your screen.
Learn more about:
Other Updates
Here's a comprehensive list of everything else we pushed live in May, grouped by product area:
Content
- Support of Go testing tool with automated scoring. It is now possible to create a Go filesystem task with automated scoring enabled to its unit tests.
- Automated custom tests output. It is now possible to automatically generate output for a candidate's custom tests (if the task contains an author solution attached).
Test
- Full path of a tab can now be viewed on hover when viewing the solution preview in a task result report.
Certify
- For candidates:
- Fixed an issue where B2C badges could sometimes appear on the proctoring setup page.
- For recruiters:
- Fixed the display of button captions in Certify digest emails.
- It is now possible to create labels directly from the Scoring configuration modal.
- Fixed a bug where pending results were not being downloaded correctly with CSV exports.
Interview
- Added a "template" filter to the Interview dashboard.
- Fixed a bug where the "interview template" field would have an invisible value for users looking at interviews with templates they did not have access to.
- AWW whiteboard support is now removed from the application.
- Loading test sessions:
- Fixed a bug where the candidate's view would get stuck if the interviewer loaded two different test sessions from the same test in a row.
- Fixed a bug where candidates could view hidden files if they were loaded as part of a test session.
- Greenhouse integration
- Now, interview feedback can be sent back to Greenhouse if the following conditions are met:
- The interview was created using the Chrome extension's Greenhouse "generate an interview link" functionality. (Using the extension popup window is not good enough; it has to be from the Greenhouse UI.)
- Harvest API Key has permission to GET a list of users.
- The email of the interviewer submitting feedback exactly matches the email of a Greenhouse contact.
- Interview feedback sent to Greenhouse will now be debounced in order to not send the same feedback multiple times, since it is not possible to edit or delete notes added to a candidate in Greenhouse.
- Feedback will be sent 1 hour after there are no further changes.
- Only new/modified feedback will be sent, not necessarily feedback from all interviewers if it didn't change.
- Now, interview feedback can be sent back to Greenhouse if the following conditions are met:
IDE
- Added a new high contrast theme for improved visual accessibility.
- Fixed a bug in the Rust starter code for single function tasks.
- Created a new "empty" view for filesystem tasks when no tabs are open, instead of showing a read-only editor.
Tasks
- Fixed a bug where searching by name in the task library didn't work while also filtering by label.
- Updated workflow for selecting an environment for a filesystem task being created.
- Fixed auto-generation of string outputs.
- For TypeScript filesystem tasks, now only script files will be counted as test files in the ''specs'' folder.
- SQL Creation
- SQL test cases can now be auto-generated in bulk.
- SQL test cases can no longer be reordered while auto-generating output.
API
- Webhooks: Fixed a bug where certificationResultShared's sharedTestSessions payload was ordered in reverse. It will now be ordered by coding score descending (best result first).
- Additionally, added startDate and finishDate to the payload for each test session.
ATS
- There is now a default Greenhouse user field that can be used as a fallback when synchronizing interview feedback, if the interviewer's email can't be mapped back to a Greenhouse user account.
Admin
- Admin Tools
- Fixed a bug where an admin viewing a client user's dashboard could not create interview templates without a team associated.
- Content Admin
- Fixed an issue with the script to re-import author solutions for all tasks.
- Support Admin
- URL Test Search tool now shows labels for a test session, too.
Auth Integration
- Now, invites from SCIM do not expire.
B2B General
- Preventing SSO mis-configuration: CodeSignal will now warn customers when they try to enable SSO without any owned email domains.
- Now, CodeSignal tries to make sure that logging in while viewing an "unauthenticated" B2B page will redirect to the right place after login.
Infrastructure
- Coderunner releases v4.16.0, v4.14.4, and v4.14.3
-
- Python 3 minor version bump: 3.8.3 -> 3.9.5.
- Ability to query Android and Puppeteer versions.
- Improvement to build of Catch 2 unit tests so that tests don't have to all be written within a single file.
- Ruby major version bump: v2.7 -> v3.
- Backend support for scoring C++ unit tests using Catch 2.
- Updated JS README to include new IP-related libraries.
- Fixed display of syntax errors in DevOps tasks for languages like C# that print such errors to stdout.
- Now, when running TypeScript filesystem tasks, only files with the .js, .jsx, .ts, .tsx extensions under the "specs" folder will be considered test files.
- New JavaScript libraries (also available in TypeScript, CoffeeScript):
-
- ipaddr.js, ip-to-int, ip-router
- Requested by Auth0
-
- Version updates (list is not exhaustive with minor/patch updates):
-
- Java to Java 16 (for non-filesystem tasks)
- Mongo to 4.4.5
- Node to 14.16.1
- Swift to 5.4
-
- Fixed display of syntax errors in DevOps tasks.
- Fixed name of "RSpec" testing tool.
- Updated JS image to include Mongoose library.