BTC/U2 Topic 2 Test Administration and Scoring
Before proceeding toward administration of the test review by at least three experts. When the test have been written down and modified in the light of the suggestions and criticisms given by the experts, the test is said to be ready for experimental try-out.
THE EXPERIENTAL TRYOUT/ PRE-TRY-OUT:
The first administration of the test is called EXPERIMENTAL TRY-OUT or PRE-TRY-OUT. The sample size for experimental try out should be 100.
The purpose of the experimental try out is manifold. According to Conrad (1951), the main purpose of the experimental tryout of any psychological and educational test is as follows:
- DETERMINES VAGUENESS AND WEAKNESSES:
Finding out the major weaknesses, omissions, ambiguities and inadequacies of the Items.
- DETERMING DIFFICULTY LEVEL OF EACH ITEM:
Experimental tryout helps in determining the difficulty level of each item, which in turn helps in their proper distribution in the final form.
- DETERMINES TIME LIMIT
Helps in determining a reasonable time limit for the test.
- DETERMINES APPROPRIATE LENGTH OF A TEST
Determining the appropriate length of the tests. In other words, it helps in determining the number of items to be included in the final form.
- IDENTIFYING WEAKNESSES IN DIRECTIONS
Identifying any weaknesses and vagueness in directions or instructions of the test.
The second preliminary administration is called PROPER TRYOUT. At this stage test is delivered to the sample of 400 and must be similar to those for whom the test is intended.
The proper try out is carried out for the item analysis. ITEM ANLYSIS is the technique of selecting discriminating items for the final composition of the test. It aims at obtaining three kind of information regarding the items. That is;
- ITEM DIFFICULTY:
Item difficulty is the proportion or percentage of the examinees or individuals who answer the item correctly.
- DISCRIMINATORY POWER OF THE ITEMS:
The discriminatory power of the items refers to the extent to which any given item discriminates successfully between those who possess the trait in larger amounts and those who possess the same trait in the least amount.
- EFFECTIVENESS OF DISTRACTORS:
Determines the non-functional distractors.
The third preliminary administration is called Final tryout. The sample for final administration should be atleast 100. At this stage the items are selected after item analysis and constitute the test in the final form. It is carried out to determine the minor defects that may not have been detected by the first two preliminary administrations. The final administration indicates how effective the test will be when it would be administered on the sample for which it is really intended. Thus, the preliminary administration would be a kind of “DRESS REHERSAL” providing a sort of final check on the procedure of administration of the test and its time limit.