Designing descriptors for the evaluation of syntheses

LIRUSO, SUSANA; LOPEZ BARRIOS, MARIO LUIS; SIERRA, LINA; MORRA, ANA MARÍA

Research in academic English: Communicative skills and strategies in the university context.

Universidad de Alcalá

Lugar: Alcalá; Año: 2002; p. 141 - 153

The present study developed analytic band scales for the evaluation of syntheses produced from multiple sources by expert readers-writers (university graduates) and non-expert readers-writers (undergraduates) in English as a foreign language. Research proceeded in three stages. In stage 1 we formulated the criteria in order to devise the rating scales, we designed the scales and piloted them. In stage 2, based on the difficulties encountered, we reorganized and reformulated the descriptions under four categories: relevance of ideas, conceptual thruthfulness, coherence and task achievement. These descriptors were used to judge 16 syntheses of expert subjects. Finally, in stage 3 we applied the obtained scales to evaluate 16 syntheses of non-expert subjects.