Validity: Theoretical Development and Integrated Argumentsprovides a historical overview of validity, targeting developments in both the UK and the US. It explores theoretical notions of validity as well as pragmatic validation practices and expands the arguments that need to be attended to in order to document quality.
The authors examine the need to consider, in addition to the psychometric evidence, which has continued to prevail especially in the US, other critical sources of quality evidence. They call attention to principled design and the evidence accumulated from various departments/groups involved in test design and development. They also promote the concept of impact by design, which places consequences at the top of the evidence chain to guide all testing efforts and quality documentation. They envision validity scholarship to attend to consequences at the individual, aggregate/group, and larger educational/organisational/societal levels. Concomitant with this attention to consequences are considerations of stakeholders and the tailoring of communication to engage intended groups. Such an approach yields a more convincing validity argument. The monograph ends by calling on professionals in the field to publish case studies which showcase localised validity arguments in practice. Local case studies represent critical endeavours to illustrate how evidence and arguments are pulled together to support the quality of a testing programme and all that it entails.
Micheline Chalhoub-Deville (Ph.D., The Ohio State University, USA) is Professor of Educational Research Methodology at the University of North Carolina at Greensboro (UNCG), USA http://erm.uncg.edu/. At UNCG, she also serves as Director of a research group, Testing and Evaluation in Educational Accountability Models (TEEAM) https://www.teeamaccountability.com/. Professor Chalhoub-Deville is the President of the International Language Testing Association (ILTA) http://www.iltaonline.com/. Professor Chalhoub-Deville is the recipient of the Outstanding Young Scholar Award by the Educational Testing Service-TOEFL Program, the ILTA Best Article Award, and the UNCG School of Education Outstanding Senior Scholar Award. Professor Chalhoub-Deville has published widely especially in second language testing and validity. She has also directed federally-funded projects to design and develop foreign language proficiency-based, computer adaptive tests, and a K-12 academic English language assessment battery. Professor Chalhoub-Deville is the founder of the Mid-West Association of Language Testers (MwALT). She is also a founding member of the British Council Assessment Advisory Board and the Duolingo English Test (DET) Advisory Board. She is a former Chair of the TOEFL Committee of Examiners as well as a member of the TOEFL Policy Board. She currently serves on MetaMetrics Technical Advisory Committee, the DET Advisory Board as well as the Language Testing and Language Assessment Quarterly Editorial Boards.
Barry O'Sullivan is Head of Assessment Research and Development, the British Council, London, Visiting Professor of Language Assessment at the University of Reading, and Advisory Professor at Shanghai Jiao Tong University.
