There is something reassuring for university administrators and decision-makers in using the results of large-scale tests. They seldom worry about their contextual appropriateness, or about their cost, or even enquire about their quality. The large reach of the test in their minds ensures its reputation. As to costs? Well, the argument goes, if students wish to undertake studies at this university, they must be prepared to pay for that privilege.
But do institutions of higher education get what they want from large-scale commercial tests, some of which have a global reach? Do they find enough diagnostic information in them, for example, to help them devise focussed language courses that would overcome the problems identified? Continue reading →
What influence does the institutional, social or political landscape have on the way in which we test a person’s ability to handle academic language? And how should one go about it? What impact should the tests have on language planning, instruction, and development?
These and other challenges will be thoroughly discussed by a team of experts on July 4, at the 40th Language Testing Research Colloquium (LTRC 2018).
The evaluation of language programme and instruction quality is highly relevant, everywhere. To test the effectiveness of a language intervention programme, one needs to take a holistic approach. For a language intervention to be effective, the designer has to bring into harmony five components: policy prescription, curriculum, instruction, learning and assessment When these are aligned, we have the golden pentagon of language intervention design. Where to begin? Continue reading →
The Code of Ethics of the International Language Testing Association (ILTA) is a guide to language testers of how they should conduct their business in ways that are caring and compassionate, and at the same time deliberate and professional. It is complemented by locally formulated Codes of Practice. The Code of Ethics is already available in eleven languages.
A team of South African translators, Sanet Steyn and Gini Keyser, tasked by the Network of Expertise in Language Assessment (NExLA), did the initial translation of the Code of Ethics into Afrikaans. Then Colleen du Plessis, Albert Weideman, and language policy specialist Theo du Plessis produced a further two drafts. The fourth draft of the Code is now being presented to the language testing community at large, and has been placed on the NExLA website for comment. Continue reading →
Returning to the still unresolved issue of how best to conceptualize test validation and validity, I attempt to answer this question in a special issue of Language & Communication that commemorates the work of the late Alan Davies. In particular, I argue that responsible test design encompasses ethicality and accountability, and is a conceptually clearer way of thinking about the quality of a language test.
Elsevier, the publisher of the journal, has generously, though for a limited period, provided unlimited access to the article that I contributed to this commemorative issue. The final published version of the article, “Does responsibility encompass ethicality and accountability in language test design?” is available until 17 December to anyone who clicks on the following link: https://authors.elsevier.com/a/1Vy-wzlItpy~5. No sign up, registration or fees are required – you can simply click and read.
Part of the annual winter conference round of language associations (CLASA 2017) will be our two-day symposium (26 & 27 June) at the upcoming SAALT conference in Grahamstown. It’s theme? Pre- and post-admission language assessment in South African universities. Featuring a number of prominent South African scholars, the symposium will be enriched by having John Read (University of Auckland) as lead scene-setter. Continue reading →