logo_testshop

phone_img Call Us : +1 928-379-5610

Rescoring Online Tests

Posted by David Fain Jun 5, 2012 12:20:00 PM

 

 

Depending on the type of testing being done and the audience, rescoring is laden with controversy.  In a New York Times article, "State Ends a Practice of Rescoring Regents Tests" on May 25, 2011, the State of New York Regents exam officials have '...ordered schools to end the longstanding but controversial practice of rescoring tests that fall just below the passing grade.' 

Rescoring is a big deal if it means the difference between graduating--or not, getting a promotion--or not or  keeping your job--or not.  Depending on the test and the organization involved, there are formal petition processes that test takers go through to have their test re-scored. 

Rescoring at any level can get messy.  "We have a situation here..." seems to be a line in many a disaster flick.  You know something bad has happened and the outlook is usually grim.  A less ominous "situation" is one we hear from test administrators who discover that the test they've published contains one or more bad items.  By "bad" we mean the question is poorly written, or technically inaccurate or the answer the test author listed as correct is actually incorrect.  What to do?  The answer is, it depends.

Online (LAN, intra- or internet) Testing

It depends on...

1- The organization's policy re rescoring tests

2- Whether or not an organization's tests will be audited

3- At what point in the testing process the test administrator recognizes the problem:  whether or not it's too late in the testing process to unpublish the test, create a new test, require those who have already taken the test to retake the corrected assessment.

4- Whether or not the test administrator recognizes that modifying a test, that has already been given, by correcting or deleting a bad item, or changing one of several key test parameters, will corrupt the test data. 

Paper-and-Pencil Testing
Items 1,2 and 3 above may be factors especially if answer sheets are used and scanned.

If tests are manually graded, it's easier for the test administrator to make allowances for bad test items.  If the test will be given to more than one group, the test author can correct the bad item and reprint the test.  If you are currently doing paper-and-pencil testing, we welcome your comments/feedback regarding how you handle the rescoring of tests containing bad items. 

Question Banks

In the case of online tests that were created by drawing questions from one or multiple question banks, it's important that the test author take steps to correct the bad item in the question bank and include a journal entry under the question's Notes field describing the correction they've made. 

We recognize that in some organizations, modifying a test items may involve some sort of psychometric review by one or more trained test authors. 

The Pyschometric Approach

For those of you interested the topic, read more. 

We welcome your comments and feedback regarding your policies and practices regarding rescoring.

Read More

Topics: evaluating employee performance, testing, Test maker, test creation software, assessments, best practices, online assessment software

Test Generator, Performance Measurement and the Kirkpatrick Model

Posted by David Fain May 30, 2012 1:13:00 PM

Whether you refer to performance measurements as tests, assessments, exams, quizzes, surveys or test papers, it's but one step in the evaluation process.

Kirkpatrick Model
And for those of you who follow the Kirkpatrick's Four Levels of Learning Evaluation (link), you know that Level 2 (Learning) is the testing phase, pre- and post-test assessments following the initial 'training or learning experience.'




Read More

Topics: performance evaluation, ad/ldap, assessments, online assessment software

The Importance of Competency Testing

Posted by Jennie Aldridge Jan 24, 2012 12:44:00 PM

Read More

Topics: performance evaluation, evaluating employee performance, testing, test generator, test creation software, assessments, online assessment software

Randomization Options in Test Maker

Posted by Jennie Aldridge Jan 12, 2012 11:49:00 AM

Whether creating tests, exams, assessments, papers, quizzes or surveys, randomizing questions is a great way to minimize cheating and help keep your test “fresh”.

Read More

Topics: testing terms, testing, randomization, test generator, Test maker, test creation software, online assessment software

Test Generator with Question Banks

Posted by Jennie Aldridge Jan 5, 2012 11:10:00 AM

Test Generator with Question Banks

When searching for test maker software, one key question to ask is, "Does your testing system support the creation and use of question banks?"
This is important because question banks enable test authors to organize and manage their test content efficiently and streamline the test-creation process. 

Read More

Topics: testing, testing software, test generator, Test maker, assessments, question banks, online assessment software

Selecting Online Assessment Software - Part 2

Posted by David Fain Jun 10, 2011 8:34:00 AM

Read More

Topics: testing software, purchasing test creation software, test generator, online assessment software

Selecting Online Assessment Software

Posted by David Fain May 20, 2011 9:27:00 AM

Read More

Topics: testing software, purchasing test creation software, online assessment software

Free 30 day trial

About this blog

Insights into our products, assessments, and the world of testing.

.

Subscribe to Email Updates