Wednesday, March 5, 2008

Writing objective test questions

Question types
Multiple choice questions (MCQs) are the traditional 'choose one from a list' of possible
answers. True/False questions require a student to assess whether a statement is true or not.
Assertion-Reason questions combine elements of MCQ and true-false. Multiple response questions (MRQs) are similar to MCQs, but involve the selection of more
than one answer from a list. Graphical hotspot questions involve selecting an area(s) of the screen, by moving a marker to the required position. Advanced types of hotspot questions include labelling and building questions.

Text/Numerical questions involve the input of text or numbers at the keyboard. Matching questions involve linking items in one list to items in a second list. Sore finger questions have been used in language teaching and computer programming, where one word, code or phrase is out of keeping with the rest of a passage. It could be presented as a 'hot spot' or text input type of question. Ranking questions require the student to relate items in a column to one another and can be used to test the knowledge of sequences, order of events, level of gradation.
Sequencing questions require the student to position text or graphic objects in a given
sequence. These are particularly good for testing methodology. Field simulation questions offer simulations of real problems or exercises. Other question types require students to identify and/or manipulate images. Students may be asked to plot a graph, complete a matrix, draw a line or build up an image using parts provided.

Multiple choice questions
Parts of a multiple choice question:
A traditional multiple choice question (or item) is one in which a student chooses one answer from
a number of choices supplied. A multiple choice question consists of
· a stem - the text of the question
· options - the choices provided after the stem
· the key: the correct answer in the list of options
· distracters: the incorrect answers in the list of options


Example of a multiple choice question

As societies increase in complexity from folk to industrial, social control is more
likely to be invested in the
a. family
b. school
c. state
d. peer group
e. religious structures
(Question from Graduate Record Examination, Sociology Test 1997-1999)


Suggestions for constructing multiple choice questions
Writing stems

1. Present a single, definite statement to be completed or answered by one of the several
given choices
A. Weak question: Polysaccharides
a. are made up of thousands of smaller units called monosaccharides
b. are NOT found in the aloe vera leaf
c. are created during photosynthesis
d. can be described by the chemical formula: CHHOH
B. Improved question: Polysaccharides of the plant cell wall are synthesized mainly in
a. the endoplasmic reticulum
b. the cytosol
c. the plasma membrane
d. the Golgi complex
e. amyloplasts
In the top example, there is no sense from the stem what the question is asking. The
second example more clearly identifies the question and offers the student a set of
homogeneous choices.
stem
key
distracters

2. Avoid unnecessary and irrelevant material

A. Weak question: Paul Muldoon, an Irish postmodern poet who uses experimental
and playful language, uses which poetic genre in "Why Brownlee Left"?
a. sonnet
b. elegy
c. narrative poem
d. dramatic monologue
e. haiku
B. Improved question: Paul Muldoon uses which poetic genre in "Why Brownlee Left"?
a. sonnet
b. elegy
c. narrative poem
d. dramatic monologue
e. haiku
The top example contains material irrelevant to the question.

3. Use clear, straightforward language in the stem of the item. Questions that are

constructed using complex wording may become a test of reading comprehension
rather than an assessment of whether the student knows the subject matter.

Weak example: As the level of fertility approaches its nadir, what is the most likely
ramification for the citizenry of a developing nation?
a. a decrease in the labour force participation rate of women
b. a dispersing effect on population concentration
c. a downward trend in the youth dependency ratio
d. a broader base in the population pyramid
e. an increased infant mortality rate
Improved question: A major deline in fertility in a developing nation is likely to produce
a. a decrease in the labour forces participation rate of women
b. a dispersing effect on population concentration
c. a downward trend in the youth dependency ratio
d. a broader base in the population pyramid
e. an increased infant mortality rate

4. Use negatives sparingly. If negatives must be used, capitalize, underscore embolden
or otherwise highlight.

Weak question: Which of the following is not a symptom of osteoporosis?
a. decreased bone density
b. frequent bone fractures
c. raised body temperature
d. lower back pain
Improved question: Which of the following is a symptom of osteoporosis?
a. decreased bone density
b. raised body temperature
c. hair loss
d. painful joints

5. Put as much of the question in the stem as possible, rather than duplicating material in
each of the options. (Gronlund 1988)

Weak question: Theorists of pluralism have asserted which of the following?
a. The maintenance of democracy requires a large middle class.
b. The maintenance of democracy requires autonomous centres of
contervailing power.
c. The maintenance of democracy requires the existence of a multiplicity of
religious groups.
d. The maintenance of democracy requires a predominantly urban population.
e. The maintenance of democracy requires the separation of governmental
powers.
Improved question: Theorists of pluralism have asserted that the maintenance of
democracy requires
a. a large middle class
b. autonomous centres of contervailing power
c. the existence of a multiplicity of religious groups
d. a predominantly urban population
e. the separation of governmental powers.

2 comments:

drm said...

Patricia, there is a common belief that MC questions are good indicators. I strongly disagree...as you have pointed out, carefully crafted questions can be powerful evaluation instruments.

Patricia Appiah-Boateng said...

Prof,

I must admit that we have learnt a lot under you can't wait to see you come summer. Thanks