Workshop leaders : John De Jong (Pearson, UK) and Ying Zheng (University of Southampton, UK)
This workshop will be designed to engage the participants to learn more about useful statistical methods in the context of language testing and assessment. The speakers will talk about analysis approaches commonly used in large testing organizations including procedures in conducting item field testing, item difficulty estimates, item bias evaluation and score reporting and equation. The participants are anticipated to achieve the following learning outcomes by the end of the workshop:
- Know more about basics of classical test theory especially about the error in estimating means etc. in relation to sampling
- Further understanding of item response theory
- Further understanding in the interpretations of Rasch analysis output.
This workshop is designed for participants with some experience in dealing with testing data, or who have taken introductory statistics, and would like to know more about statistical approaches in testing. Some prior knowledge of CEFR, excel spreadsheets, SPSS, and/or Rasch software would be beneficial.
The workshop will have both seminar sessions and practical sessions.
In the seminar sessions, the instructors will give an overview of the use and interpretation of statistical analysis procedures commonly used in testing organizations to improve testing and assessment quality. Practice datasets will be sent to participants beforehand. In the practical sessions, the instructors will lead and demonstrate analysis procedures to enable participants to connect assessment theories and concepts with hands-on practices.
Maximum number of participants: 30
Some preparatory readings will be provided prior to the workshop.
John H.A.L. de Jong (PhD) is Senior Vice President Global Assessment Standards with Pearson and Professor of Language Testing at VU University Amsterdam. He has 40 years’ experience in language testing. John graduated in General Linguistics, French and English languages from Leiden University and obtained a Ph.D. in Educational Measurement from Twente University. He has published widely on language assessment and educational measurement and has specialised in empirical scaling and the development of internationally standardised reporting scales of language proficiency. Before starting his career in language testing John had been teaching French for seven years in secondary schools. He joined Pearson in September 2006 where apart from directing language testing programmes he is also Programme Director for developing the Frameworks for PISA 2015, 2018 and PISA for Development.
Ying Zheng (PhD) is an associate professor at Faculty of Humanities and Deputy Director of the Confucius Institute, University of Southampton. She worked as a Psychometrician and Director of Research in the Language Testing Division of Pearson, London before she joined Southampton. Her research interests include psychometric analysis of language testing data, English as second/foreign language learner characteristics, and quantitative research methodology. Ying's publications can be found in Language Testing, Canadian Journal of Education, Canadian Modern Language Review, International Journal of Pedagogies & Learning, and TESL-EJ. Her area of work covers language tests from China, Canada, and the UK. Ying has been serving as an external psychometric consultant over the years for international language testing organizations. She currently supervises MA/PhD students working in the fields of assessment literacy, large-scale testing and psychometrics.