Canonical Tag Script

Saturday, January 9, 2021

The procedure for development of multiple choice tests items and assembling the test prepare ten multiple choice items from subject of your choice | Teacher Education | aiou solved assignment | Course Code 8602

Q 5:  Briefly describe the procedure for the development of multiple-choice test items assemble the test and prepare ten multiple-choice items from the subject of your choice.

CourseEducational Assessment and Evaluation

Course code 8602

Level: B.Ed Solved Assignment 

Answer:

Multiple choice test questions, also known as items, can be an effective and efficient way to assess learning outcomes. Multiple choice test items have several potential advantages:

Versatility: 

Multiple choice test items can be written to assess various levels of learning outcomes, from basic recall to application, analysis, and evaluation. Because students are choosing from a  set of potential answers, however, there are obvious limits on what can be tested with multiple-choice items. For example, they are not an effective way to test students’ ability to organize thoughts or articulate explanations or creative ideas.


Reliability: 

Reliability is defined as the degree to which a test consistently measures a learning outcome. Multiple-choice test items are less susceptible to guessing than true/false questions, making them a more reliable means of assessment. The reliability is enhanced when the number of MC items focused on a single learning objective is increased. In addition, the objective scoring associated with multiple choice test items frees them from problems with scorer inconsistency that can plague the scoring of essay questions.


Validity: 

Validity is the degree to which a test measures the learning outcomes it purports to measure. Because students can typically answer a multiple-choice item much more quickly than an essay question, tests based on multiple-choice items can typically focus on a relatively broad representation of course material, thus increasing the validity of the assessment. The key to taking advantage of these strengths, however, is the construction of good multiple-choice items.


A multiple-choice item consists of a problem, known as the stem, and a list of suggested solutions, known as alternatives. The alternatives consist of one correct or best alternative, which is the answer, and incorrect or inferior alternatives, known as distractors.



Constructing an Effective Stem

1. The stem should be meaningful by itself and should present a definite problem. A stem that presents a definite problem allows a focus on the learning outcome. A stem that does not present a clear problem, however, may test students’ ability to draw inferences from vague descriptions rather than serving as a more direct test of students’ achievement of the learning outcome.




2. The stem should not contain irrelevant material, which can decrease the reliability and the validity of the test scores (Haldyna and Downing 1989)


3. The stem should be negatively stated only when significant learning outcomes require it. Students often have difficulty understanding items with negative phrasing (Rodriguez 1997). If a significant learning outcome requires negative phrasing, such as the identification of dangerous laboratory or clinical practices, the negative element should be emphasized with italics or capitalization.



4. The stem should be a question or a partial sentence. A question stem is preferable because it allows the student to focus on answering the question rather than holding the partial sentence in working memory and sequentially completing it with each alternative (Statman 1988). The cognitive load is increased when the stem is constructed with an initial or interior blank, so this construction should be avoided.






Related Topics 


Saturday, January 2, 2021

Compare the Blooms taxonomy with SOLO Taxonomy of educational objectives. | Teacher Education | aiou solved assignment | Course Code 8602

     


Q 4:  Compare Bloom's taxonomy with the SOLO Taxonomy of educational objectives.


CourseEducational Assessment and Evaluation

Course code 8602

Level: B.Ed Solved Assignment 

Topic: Bloom taxonomy with SOLO Taxonomy of educational objectives


Answer:

The reasons why we prefer to use SOLO Taxonomy


The SOLO Taxonomy (Biggs & Collis, 1982), provides a measure of cognitive learning outcomes or understanding of thinking, that, in my experience, teachers have felt comfortable adopting. This hierarchical model is comprehensive, supported by objective criteria, and used across different subjects and on differing types of assignments (Hattie & Purdie, 1998). 
Teachers enjoy the way that SOLO represents student learning of quite diverse material in stages of ascending structural complexity, and that these stages display a similar sequence across tasks. Furthermore, surface or deep levels of understanding can be planned for and assessed by coding a student’s thinking performance against unstructured, multi-structural, relational, or extended abstract categories, as shown in Table 1. Using visual symbols to represent levels of understanding in SOLO means that coding for the complexity of thinking can be undertaken by both student and teacher, allowing “where should we go next?” decisions and thinking interventions to more accurately target student learning needs. Hook, P. 2006 A Thinking Curriculum NZCER p100


Notes from Professor John Hattie

Course 224: Assessment in the Classroom (The University of Auckland)
"Creating best tests using Bloom's taxonomy or the SOLO classification."


Critique of Bloom's taxonomy

The taxonomy was published in 1956, has sold over a million copies, has been translated into several languages, and has been cited thousands of times.  The Bloom taxonomy has been extensively used in teacher education to suggest learning and teaching strategies, has formed the basis of many tests developed by teachers (at least while they were in teacher training), and has been used to evaluate many tests.  It is thus remarkable that the taxonomy has been subject to so little research or evaluation.

Most of the evaluations are philosophical treatises noting, among other criticisms, that there is no evidence for the invariance of these stages, or claiming that the taxonomy is not based on any known theory of learning or teaching.

▪  The Bloom taxonomy presupposes that there is a necessary relationship between the questions asked and the responses to be elicited, whereas, in the SOLO taxonomy, both the questions and the answers can be at differing levels.

Whereas Bloom separates 'knowledge' from the intellectual abilities or processes that operate on this 'knowledge', the SOLO taxonomy is primarily based on the processes of understanding used by the students when answering the prompts.  Knowledge, therefore, permeates across all levels of the SOLO taxonomy.

▪  Bloom has argued that his taxonomy is related not only to complexity but also to an order of difficulty such that problems requiring behavior at one level should be answered more correctly before tackling problems requiring behavior at a higher level. Although there may be measurement advantages to this increasing difficulty, this is not a necessary requirement of the SOLO method. It is possible for an item at the relational level, for example, to be constructed so that it is less difficult than an item at the unstructured level. For example, an item aiming to elicit relational responses might be 'How does the movement of the Earth relative to the sun define day and night'. This may be easier (depending on instruction, etc.) than a unstructured item that asks 'What does celestial rotation mean?'

▪  Bloom’s taxonomy is not accompanied by criteria for judging the outcome of the activity (Ennis, 1985), whereas SOLO is explicitly useful for judging the outcomes. Take, for example, a series of art questions suggested by Hamben (1984).

Knowledge

Who painted Guernica?

Comprehension. 

Describe the subject matter of Guernica.
Application. 
Relate the theme of Guernica to a current event.

Analysis. 

What compositional principles did Picasso use in Guernica?

Synthesis. 

Imagine yourself as one of the figures in Guernica and describe your life history?

Evaluation. 

What is your opinion of Picasso’s Guernica?

When using Bloom’s taxonomy, the supposition is that the question leads to a particular type of Bloom response. There is no necessary relationship, however, as a student may respond with a very deep response to the supposedly lower-order question: 'Describe the subject matter of Guernica?' Similarly, a student may provide a very surface response to 'What is your opinion of Picasso’s Guernica'? When using the SOLO taxonomy, either the questions would be written differently, or the test scorer would concentrate on classifying the responses only. An example of re-writing to maximize the correspondence between the question asked and the answer expected is:

Unistructural. 

Who painted Guernica?

Multistructural. 

Outline at least two compositional principles that Picasso used in Guernica.

Relational. 

Relate the theme of Guernica to a current event.

Extended Abstract. 

What do you consider Picasso was saying via his painting of Guernica?

Advantages of the SOLO model for evaluation of student learning

▪  There are several advantages of the SOLO model over the Bloom taxonomy in the evaluation of student learning.

▪  These advantages concern not only item construction and scoring, but incorporate features of the process of evaluation that pay attention to how students learn, and how teachers devise instructional procedures to help students use progressively more complex cognitive processes.

▪  Unlike the Bloom taxonomy, which tends to be used more by teachers than by students, the SOLO can be taught to students such that they can learn to write 
progressively more difficult answers or prompts.

▪  There is a closer parallel between how teachers teach and how students learn.

▪  Both teachers and students often progress from more surface to deeper constructs and this is mirrored in the four levels of the SOLO taxonomy.

▪  There is no necessary progression in the manner of teaching or learning in the Bloom taxonomy.

▪  The levels can be interpreted relative to the proficiency of the students. Six-year-old students can be taught to derive general principles and suggest hypotheses, though obviously to a different level of abstraction and detail than their older peers. Using the SOLO method, it is relatively easy to construct items to assess such abstractions.

▪  The SOLO taxonomy not only suggests an item writing methodology, but the same taxonomy can be used to score the items. The marker assesses each response to establish either the number of ideas (one = unstructured; _ two = multi-structural) or the degree of interrelatedness (directly related or abstracted to more general principles). This can lead to more dependability of scoring.

▪  Unlike the experience of some with the Bloom taxonomy it is relatively easy to identify and categorise the SOLO levels.

▪  Similarly, teachers could be encouraged to use the 'plus one' principle when choosing appropriate learning material for students. That is, the teacher can aim to move the student one level higher in the taxonomy by appropriate choice of learning material and instructional sequencing


Related Topics 


Discuss Historical Research covering the Concept of Primary Sources, Secondary Sources Internal and External Criticism.

Discuss historical research covering the concept of primary sources, secondary sources internal and external criticism. Course: Research Met...