logo_testshop

phone_img Call Us : +1 928-379-5610

The Advantages and Disadvantages of Gamifying Assessment

Posted by Jennie Aldridge May 7, 2015 3:01:00 PM

The video gaming industry is larger than ever before. In 2009, the industry hauled in $10.5 billion in revenue, and today approximately 67% of North American households are equipped with a video game console of some sort. 

Read More

Topics: assessments, Generate online tests, Test creator, Generate online exam

Test Authoring and the Reliability Coeficient

Posted by David Fain Sep 5, 2012 1:00:00 PM

Read More

Topics: reliability, item analysis, assessments

Test Maker: Eight Approaches to Discourage or Prevent Cheating

Posted by David Fain Jun 28, 2012 9:04:00 AM

Read More

Topics: evaluating employee performance, cheating, secure testing, assessments

Rescoring Online Tests

Posted by David Fain Jun 5, 2012 12:20:00 PM

 

 

Depending on the type of testing being done and the audience, rescoring is laden with controversy.  In a New York Times article, "State Ends a Practice of Rescoring Regents Tests" on May 25, 2011, the State of New York Regents exam officials have '...ordered schools to end the longstanding but controversial practice of rescoring tests that fall just below the passing grade.' 

Rescoring is a big deal if it means the difference between graduating--or not, getting a promotion--or not or  keeping your job--or not.  Depending on the test and the organization involved, there are formal petition processes that test takers go through to have their test re-scored. 

Rescoring at any level can get messy.  "We have a situation here..." seems to be a line in many a disaster flick.  You know something bad has happened and the outlook is usually grim.  A less ominous "situation" is one we hear from test administrators who discover that the test they've published contains one or more bad items.  By "bad" we mean the question is poorly written, or technically inaccurate or the answer the test author listed as correct is actually incorrect.  What to do?  The answer is, it depends.

Online (LAN, intra- or internet) Testing

It depends on...

1- The organization's policy re rescoring tests

2- Whether or not an organization's tests will be audited

3- At what point in the testing process the test administrator recognizes the problem:  whether or not it's too late in the testing process to unpublish the test, create a new test, require those who have already taken the test to retake the corrected assessment.

4- Whether or not the test administrator recognizes that modifying a test, that has already been given, by correcting or deleting a bad item, or changing one of several key test parameters, will corrupt the test data. 

Paper-and-Pencil Testing
Items 1,2 and 3 above may be factors especially if answer sheets are used and scanned.

If tests are manually graded, it's easier for the test administrator to make allowances for bad test items.  If the test will be given to more than one group, the test author can correct the bad item and reprint the test.  If you are currently doing paper-and-pencil testing, we welcome your comments/feedback regarding how you handle the rescoring of tests containing bad items. 

Question Banks

In the case of online tests that were created by drawing questions from one or multiple question banks, it's important that the test author take steps to correct the bad item in the question bank and include a journal entry under the question's Notes field describing the correction they've made. 

We recognize that in some organizations, modifying a test items may involve some sort of psychometric review by one or more trained test authors. 

The Pyschometric Approach

For those of you interested the topic, read more. 

We welcome your comments and feedback regarding your policies and practices regarding rescoring.

Read More

Topics: evaluating employee performance, testing, Test maker, test creation software, assessments, best practices, online assessment software

Test Generator, Performance Measurement and the Kirkpatrick Model

Posted by David Fain May 30, 2012 1:13:00 PM

Whether you refer to performance measurements as tests, assessments, exams, quizzes, surveys or test papers, it's but one step in the evaluation process.

Kirkpatrick Model
And for those of you who follow the Kirkpatrick's Four Levels of Learning Evaluation (link), you know that Level 2 (Learning) is the testing phase, pre- and post-test assessments following the initial 'training or learning experience.'




Read More

Topics: performance evaluation, ad/ldap, assessments, online assessment software

Question Banks in Test Generator: Best Practices

Posted by Jennie Aldridge Apr 12, 2012 1:16:00 PM

Read More

Topics: test generator, Test maker, assessments, question banks, best practices

Using Media in Test Creation

Posted by Jennie Aldridge Feb 3, 2012 10:14:00 AM

With exceptions duly noted, the days of zero-options paper-and-pencil testing and manual grading are numbered: too labor intensive, too prone to error, too un-manageable, too easily shared.  And in its place, online, feature-rich testing that not only saves time but provides test authors and test administrators with a set of tools that enrich the testing experience--not to mention automatically grading tests, storing test data and simply saving the un-sung test administrator/jack-of-all-trades, a hell of a lot of time. 

Read More

Topics: media, media in testing, testing software, test generator, Test maker, test creation software, assessments

The Importance of Competency Testing

Posted by Jennie Aldridge Jan 24, 2012 12:44:00 PM

Read More

Topics: performance evaluation, evaluating employee performance, testing, test generator, test creation software, assessments, online assessment software

Test Generator with Question Banks

Posted by Jennie Aldridge Jan 5, 2012 11:10:00 AM

Test Generator with Question Banks

When searching for test maker software, one key question to ask is, "Does your testing system support the creation and use of question banks?"
This is important because question banks enable test authors to organize and manage their test content efficiently and streamline the test-creation process. 

Read More

Topics: testing, testing software, test generator, Test maker, assessments, question banks, online assessment software

The importance of performance evaluation

Posted by Jennie Aldridge Dec 15, 2011 10:40:00 AM

  The Importance of Performance Evaluation

                                        

Read More

Topics: performance evaluation, evaluating employee performance, Test maker, test creation software, assessments

Free 30 day trial

About this blog

Insights into our products, assessments, and the world of testing.

.

Subscribe to Email Updates