On this page
- Candidate Recording Panel
- Interview Guide
- Rating
- Submitting Ratings
- Consensus
- Submitting Final Ratings
On-demand interviews do not have a draft or auto-save feature, so plan to finish reviewing and rating all interview question responses in one sitting. Recordings will be archived after 180 days.
If you find that the audio and/or video of a recording has been corrupted in any way (i.e. no or garbled audio, no video when there should be, or lagging video), reach out to the hiring manager to determine next steps.
There are two sections on the review page: The candidate recording panel and the Interview Guide.
Candidate Recording Panel
This section includes the recording of the entire interview. Note that candidates may be required to record with audio and video, or only audio. For audio-only interviews, the video screen will appear black. An interview is not yet ready to be reviewed if there is a message overlaying the video screen that reads “Interview is not available yet”. If you encounter this message, close out of the interview by closing your browser tab and wait 15 minutes before returning to the interview.
Use the following functions when playing back an interview:
- Play icon: Select this icon to play the recording from start to finish.
- Sound icon: Use the scroll bar next to this icon to increase or decrease the volume.
- Double arrows icon: Select this icon to expand the size of the recording window.
Interview Guide
The Interview Guide includes the interview script. This section includes each interview question and its associated rating criteria, as well as a rating scale and notes section to capture your rating and notes for each question.
Navigating Between Questions
In the Interview Guide, the interview questions are displayed vertically. To navigate between questions, use the scroll bar on the right-hand side of the screen or use the “Next” and “Previous” buttons at the bottom of the screen to move from one question to another.
Playing Back Recorded Responses
To play back the recorded response for an individual question, navigate to that question and select the “video icon” to the right of the question. This will play back the candidate’s recorded response for that question in the candidate video panel.
Interviews may include interviewer-only questions. These questions were not presented to the candidate during the interview and are visible to the raters only. Rating and note-taking for these questions can be conducted as normal but note that there will be no “video icon” next to the question because the candidate did not record a response for that question.
Rating
Before selecting a rating for a competency, review the rating criteria. Navigate to an interview question and find the name of the competency below the question. Beneath the competency is the rating scale and the rating criteria for that competency. To hide the rating criteria, select the “Show rating criteria” toggle above the rating scale. To view the rating criteria after hiding it, select the “Hide rating criteria” toggle.
To assign a rating for a competency, select the number in the rating scale that corresponds with the rating you would like to give for that competency. Once selected, the number will be highlighted yellow. To change a rating, select a new number on the rating scale.
Be mindful that multiple competencies may be associated with an individual interview question.
Note-Taking
Each interview question has its own notes section. To document notes on a candidate’s response to an interview question, navigate to an interview question; below the rating criteria is the My Notes field. This field is an open text box that allows for a max of 4,000 characters and does not have any formatting options.
To expand the size of the notes section, select the two gray lines in the bottom, right-hand corner of the open text box and drag the box downwards.
When documenting notes, follow your agency interview protocols and ensure that you capture notes for each interview question should that guidance be in line with your protocols.
Submitting Ratings
Finish rating each competency and review your notes for each question. Once you have completed your review, select the “Submit” button in the bottom, right-hand corner of the screen.
If consensus is required for the interview, these will be considered your initial ratings for the interview. You will not be able to edit your ratings or notes until the panel conducts consensus.
If consensus is not required for the interview, these will be considered your final ratings for the interview. You will not have a future opportunity to edit your ratings or notes.
Once you receive the confirmation page, you can close out of the tab in your browser or close the window to exit the interview.
Consensus
If consensus is required for the interview, consensus coordination will need to be scheduled outside of the USA Hire Interview system. Consensus can be conducted once all raters have submitted their initial ratings. The raters will join the interview and use audio and video to communicate during the consensus process. Even if all questions are within consensus, the rater panel will need to go through the consensus process to submit final ratings for the panel.
Accessing Consensus
To access consensus, navigate back to the candidate record and select the “Join Consensus” button on the right-hand side of the screen below the “Actions” header.
Raters will need to complete the Device Check to access the consensus page. Select the “Run Test” button in the bottom, right-hand corner of the screen to run the Device Check. Once the Device Check is passed, select the “Join Interview” button in the bottom, right-hand corner of the screen to join consensus.
Consensus Interface
Raters will automatically be placed on mute with their video turned off when they enter the consensus interface. Use the “Camera” and “Mic” buttons at the top of the screen to turn audio and video on and off as needed. The raters’ video panels are displayed on the left-hand side of the screen.
The consensus interface presents one interview question at a time. For each question, the system displays the question content and the competency name, rating scale, and rating criteria for each associated competency. It includes your notes section for that question and any notes you documented during the rating process. You can add additional notes or edit your existing notes during consensus. On the rating scale, each raters’ initial rating is represented by a circle overlayed with their initials. Your initial rating circle is blue, the other raters’ circles are gray.
To determine if a question is within consensus, look at each competency name associated with that question. If there is a check mark next to the competency name, the ratings for that competency are within consensus. If there is not a check mark next to a competency name, the ratings for that competency are not within consensus. Next to the competency name, the system will display a message detailing the number of points ratings must be within to achieve consensus.
Consensus leverages an auto-save functionality, so should you leave consensus, edits to your notes or ratings will be automatically saved.
Changing a Rating
To change your rating for a competency, select the number in the rating scale that corresponds with the rating you would like to give for that competency. Once selected, your circle will move to hover over the new rating.
Moderator Role
During consensus, one rater will have the responsibility of serving as the Moderator. The Moderator is responsible for moving the panel from one interview question to another and submitting final ratings on behalf of the panel.
The first rater to join consensus is automatically assigned as the Moderator. To make yourself Moderator, select the blue star icon above the raters’ video panels. The Moderator role can be switched at any time.
To move the panel forward from one question to another, select the “Next” button in the bottom, right-hand corner of the screen. To move the panel backward from one question to another, select the “Previous” button in the bottom, left-hand corner of the screen.
Submitting Final Ratings
Once all questions are within consensus, the blue “Submit Final Ratings” button will appear to the Moderator in the bottom right-hand corner of the Interview Guide.
Confirm that all raters are comfortable with their final ratings and do not need to add any additional notes. Based on your protocols, consensus notes may be documented by each individual rater in their notes section or a single individual may be responsible for taking consensus notes for the interview panel in their notes section.
To submit final ratings, the Moderator selects the “Submit Final Ratings” button. An “Are You Sure” pop-up will appear. Select the “Confirm” button to end consensus.