Statistical Reports Instructions

Thank you for participating in the Society of Critical Care Medicine's (SCCM) 2019 Multidisciplinary Critical Care Knowledge Assessment Program (MCCKAP). The final scoring analysis is now complete and score reports are available for your use.
 
Please read and follow all of the Statistical Reports Instructions in order to view the psychometric information from the examination.
 
  • Log in to the SCCM testing website. Please note that your username is your email address and is case sensitive. If you have forgotten your password, use the “Forgot your password” link on the login page. If you have further difficulty logging in, please contact SCCM Customer Service at +1 847 827-6888 between 8:00 a.m. and 5:00 p.m. Central Time, Monday through Friday.
  • Once logged in, you will be directed to the administrator dashboard. To see a copy of your fellows’ score report summaries, click on the “Users” link from the dashboard. The users page will display a list of all the fellows to whom you granted the MCCKAP examination.
  • To view a specific score report summary, select one of the fellows from your list and click the “Edit” link on the line in which the desired fellow is listed. Edit is located on the far right-hand side of the screen under the “Control” column.
  • After clicking Edit, you will be taken to the edit user page for your fellow. On the left-hand side of the information screen, you will see a list of vertically oriented tabs. Personal info should be highlighted as the default view. To view the score report summary, click the “Exam History” tab.
  • The Exam History tab will take you to a page that displays a list of all the SCCM examinations that your selected fellow has completed on the testing website. Please note that, due to the nature of rescoring an examination after the key verification, there will be multiple listings for the MCCKAP examination in the fellow’s examination history. The top listing is the most recent listing, and it takes into account items that were removed from scoring during the key verification. The bottom listing is the original score report from the day of the examination administration and takes into account all the original examination items.
  • From the list, select the score report you want to view by clicking “View Score Report Summary.” Clicking that button will prompt you to download a copy of the fellow’s Keyword/Reference Report for the examination. Feel free to download and/or print a copy of this report at your leisure.
  • To view overall cohort and examination performance reports, click the Reports tab located at the top of the Exam History page. You can also return to the dashboard and click the “Reports” link.
  • On the Reports page, you will see two categories of reports: Standard and System. Standard reports are dynamic reports that are modifiable in real time, while system reports will require a download of the requested information via an email link. You will find the standard reports to be more user friendly and useful.
  • In the Standard Reports section, you will find the following reports:
    • Exam Grants: a report of all the examination grants that you have issued
    • Exam History: a report of the examination attempts of all the users in your program
    • Users: a report of all the users in the system that are associated with your program
    • Means Score Report: a report of various statistical benchmarks for the examination,; given in raw totals
    • Cohort Performance Report: a report of your particular cohort’s performance on the examination, given in percentages
  • In the System Reports section, you will find the following reports:
    • Exam Responses: a report of all responses for a given examination
    • Bulk Results Export: a report of user examination results
    • Exam Notes: a report of notes entered by users on individual questions
    • Question Comments: a report of administrator comments on questions
    • Exam Settings Export: a report of examination settings
  • To use the various reports, first select the columns that you wish to view in the report with the “Configure Columns” button, which is located on the right-hand side of the screen. Note that not all reports contain the same options in the Configure Columns menu. Once you have selected the columns that you wish to view in a report, click the OK button.
  • After selecting those columns, click the “View Online” button to view the results of your report. Whenever you change parameters of any report, you have to click the “View Online” button to update the results.
  • After viewing the results of any reports online, you can download the results by clicking the “Download XLSX” button. This will prompt you to download a copy of an Excel file containing your report results.
  • Log in to the SCCM testing website. If you experience any difficulty logging in to that domain, proceed to the login webpage. Please note that your username is your email address and is case sensitive. If you have forgotten your password, use the “Forgot your password” link on the login page. If you have further difficulty logging in, please contact SCCM Customer Service at +1 847 827-6888 between 8:00 a.m. and 5:00 p.m. Central Time, Monday through Friday.
  • Once logged in, you will be directed to the Assessments page. Click the “History” link on the right-hand side of that page. The History link will take you to a page that displays a list of all the SCCM examinations that you have completed on the testing website.
  • Find the examination for which you would like to see your score report and click the “Review” link on the right-hand side. Please note that, due to the nature of rescoring an examination after the key verification, you will have multiple listings for the MCCKAP examination in your history. The top listing is the most recent listing, and it takes into account items that were removed from scoring during the key verification. The bottom listing is the original score report from the day of the examination administration and includes all the original examination items.
  •  If you scroll to the bottom of the Review page, you will see a button titled “View Score Report Summary.” If you click on that button, it will prompt you to download a copy of your Keyword/Reference Report for the examination. Feel free to download and/or print a copy of this report at your leisure.