Test Scoring Overview

Introduction

IT Services provides an automated test scoring service for faculty using Scantron sheets to capture students' responses to multiple choice tests. 

Capabilities, Benefits and Key Features

  • Provide Test Scoring
  • Multiple drop off locations
  • 24-48 hour turn around for test processing
  • Two 30 minute parking spots have been designated for test scoring drop-offs, pick-ups, and While-You-Waits, in the Hoyt parking lot.

Who uses it?

  • Faculty

How Do I Get Started?

  • Print and complete the attached Cover Form (required)
  • We no longer use scramble sheets.
    • Instead, please include one scantron test key per version of test you are giving.
  • Deposit Cover Form along with your test sheets at the following locations:
    • Drop-box outside Hughes Hall (west side - AM pickup daily)
    • Hoyt Hall
      • Drop-slot (north side)
      • Drop-box in Lobby (south/parking lot side (24/7)
      • Hoyt 2nd Floor Reception Area
  • Scored tests will be returned via campus mail.
  • To order Scantron test sheets, contact Shriver Center Bookstore at 513-529-2600 or via email at supplysales@MiamiOH.edu. Provide an Index code and a delivery location, and they will be delivered to you, or they can be picked up in Shriver Center Bookstore. 

 

  • Any questions concerning statistical output should be directed to Research Computing Support (rescomp@miamioh.edu)
  • Any questions concerning the operation of the test scoring service should be directed to Test Scoring (testscoring@miamioh.edu), (513)529-8378 (TEST).

What type of technology can be used to consume this service?

  • Scantron machine
  • email 

What Reports Are Available?

The following reports are generated when every test is scored, and sent to the instructor via email.

  • Report 101 - Student Statistics Report
    • The Student Statistics Report is used to view class performance for tests. It optionally shows detailed information about learning objectives, objective questions, and subjective questions. It is a great report for quickly seeing how students are performing and whether they are meeting standards. The Student Statistics report lists each student in the class with his/her grade, raw score, percent score and scaled score (if applicable). If using subjective questions, it can delineate between the objective and subjective score. If using learning objectives, each objective is listed separately, providing the ability to see whether objectives are being mastered. If using benchmark scores, a benchmark bar chart is listed for each student in order to see if he/she met the defined benchmark score. Benchmark scores are also displayed by learning objective. 
  • Report 103 - Class Frequency Distribution Report
    • The Class Frequency Distribution Report provides a distribution of the grades for an entire class and test. This report is useful for gaining a quick grasp on class performance. The Class Frequency Distribution report displays the grade scale for the test, the percent score and raw score for each grade, and the frequency of each grade specified within the grade scale. A corresponding percent is listed for each frequency. A customizable graph of the frequency can also be displayed. In addition, frequencies can be calculated for each learning objective if applicable.
  • Report 105 - Student Response Report
    • The Student Response Report provides a class view of all test responses by student and by question, providing visual insight into both student and question performance. The students are listed down the left side of the report. The questions are listed across the top of the report. Each student's answer to each graded question is listed within a colored box: green for correct responses and red for incorrect responses. A white empty box means the student left the question blank or the answer is somehow invalid. At the beginning of the report, you will find the total score, percent score, grade and scaled score (if applicable) listed. At the bottom of the report the average per questions is listed, as well as averages for the total score, percent score, and grade. The colors used in the report can be customized in the report's style properties.
  • Report 111 - Class Learning Objectives Report
    • The Class Learning Objectives Report provides the average score for the overall test and each learning objective defined in Advanced Grade. Objectives are listed down the left side of the report, and then the grade, total score and percent score are listed for each learning objective. If a scaled score is defined, it can also be displayed. If one or more subjective questions are included, the subjective total is displayed. If a benchmark score was defined, the benchmark difference graph can be displayed. 
  • Report 112 - Student Achievement Report
    • The Student Achievement Report provides the ability to look at student scores in terms of whether they achieved the benchmark you set for the test. You can view scores for the overall test and any learning objectives defined in Advanced Grade. It allows you to quickly see who has and has not mastered the information. Students are listed down the left side of the report, and then the percent score is listed for each student.  If a benchmark score was defined, the achievement gap graph can be displayed.
  • Report 201 - Detailed Item Analysis Report
    • The Detailed Item Analysis report provides answer choice frequency information on a question-byquestion basis, which for test grading is useful for question validity. Using the Detailed Item Analysis Report, you can see how students responded to the question. If problems are found (e.g. the question was poorly worded), you can throw out the question by contacting Test Scoring. Each question displays in a separate table. The question name is displayed at the top of each table. A graph of the frequency appears to the right of the table.
  • Report 203 - Item Analysis Graph Report
    • The Item Analysis Graph Report provides answer choice frequency information on a question-by-question basis, which for test grading is useful for question validity. The Item Analysis Graph Report contains similar graphs to those displayed in the Detailed Item Analysis and limited information pertaining to each graph. This report is a simplified version of the Detailed Item Analysis and provides a good way to view or export just the graph information.
  • Report 204 - Condensed Item Analysis
    • The Condensed Item Analysis Report provides answer choice frequency information on a question-byquestion basis, which for test grading is useful for question validity. It displays the same information from the Detailed Item Analysis report but in a condensed fashion. The question name is displayed at the top of each table. A bar chart is displayed to the right of the table containing the statistics. The bar chart displays the correct response(s) in green and the incorrect response(s) in red. If an incorrect response is chosen more than the correct response(s), its bar chart is yellow. 
  • Report 206 - Condensed Test Report
    • The Condensed Test Report provides answer choice frequency information on a question by question basis, including distractor and class score information. This report is a great way to see question and class performance at a glance. The Condensed Test Report lists each question on the test along with the frequencies for each answer choice. Distractors and non-distractors are pointed out so that you can view question performance. The Point Biserial statistic and upper/lower percentages are displayed. You may optionally display class score data, including Total Possible Points, Total Students, Standard Deviation, Median Score, Mean Score, Reliability Coefficient, Maximum Score, Minimum Score, and Range of Scores. 
  • Report 310 - Test Statistics Report
    • The Test Statistics Report displays basic statistics on the test as a whole and is useful for gaining a quick look at performance and basic statistical analysis. The Test Statistics Report displays: · Score Data: possible number of test points, number of graded items, and high and low scores. · Statistics: mean, benchmark, range, standard deviation, and variance · Percentiles: 25th and 75th percentile, plus interquartile range, and median score · Confidence Intervals: 1, 5, 95 and 99% intervals Test Reliability: Kuder-Richardson and Cronbach Alpha statistics.
  • Report 320 - Test Item Statistics Report
    • The Test Item Statistics Report displays statistical information for each question, allowing you to quickly see which questions were answered correctly and incorrectly, as well as question validity information. The Test Item Statistics report displays each question and its point value, how many times the question was graded on the test, how many students answered the question correctly, incorrectly or did not answer it, Point Biserial (a measure of how closely the performance on a test item is related to the performance on the total test) and the percent of students who answered the question correct (sometimes called P-value).
  • Report 150 - Student Grade Report
    • The Student Grade Report provides complete test information for each student that can be handed back to a student. If you use an image enabled scanner it includes an image of the test form that shows marked responses (optional). The Student Grade reports are run one per student, displaying each student’s grade, total score, percent score and scaled score. It also displays learning objective performance if applicable. Each question can be listed with the student’s response, whether it was correct (incorrect responses are highlighted), and optionally the correct response for those answered incorrectly.
    • This is produced with the image and all answers, and also just the incorrect answers with no image.
  • CSV File
    • This file is a plain text version of student names and scores that can be uploaded directly to Canvas.

Updated: 10/29/19

 
Print Cover Form

Related Articles (1)

Files (1)

pdf

Test Scoring Request Form.pdf

10/1/2019 8:20:38 AM