Pre-conference workshops will take place on Sunday 13 July. Each half-day workshop can be booked via our registration form, or the online booking system.

You can take advantage of our special booking rate by booking a second workshop for half-price. Please be sure to only book one AM and one PM workshop!

You will find details of each workshop below. Please be aware that we will upload information for the workshops as we receive it from the presenters.

Barbara Byrne:
Testing for Measurement and Structural Equivalence: Basic Concepts, Applications, and Issues

An important prerequisite to multigroup comparisons is knowledge that the assessment measures are operating equivalently (i.e., they are invariant) across groups. Designed within the framework of structural equation modeling (SEM), this workshop demonstrates the procedures involved in testing for: (a) equivalence of a measuring instrument across groups, and (b) differences in latent factor means. Working from examples of first and second-order CFA models that involve the analysis of means and covariance structures, participants are "walked through" the process, from model specification in the computer input to interpretation of the computer output. Important issues related to particular applications are discussed throughout. To gain the most from this workshop, some knowledge of, and experience with SEM is recommended.

Bruno Zumbo: (University of British Columbia)
Psychometric methods for investigating item and scale/test level invariance: DIF and scale-level techniques

Methods for detecting differential item functioning (DIF) and scale (or construct) equivalence typically are used in developing new measures, adapting existing measures, or validating test score inferences. DIF methods allow the judgment of whether items (and ultimately the test they constitute) function in the same manner for various groups of examinees, essentially flagging problematic items or tasks. In broad terms, this is a matter of measurement invariance; that is, does the test perform in the same manner for each group of examinees? You will be introduced to a variety of DIF methods, some developed by the presenter, for investigating item-level and scale-level (i.e., test-level) measurement invariance. The objective is to impart psychometric knowledge that will help enhance the fairness and equity of the inferences made from tests. Topics include: 1.What is measurement invariance, DIF, and scale-level invariance? 2.Construct versus item or scale equivalence 3.Description of DIF methods 4.Description of scale-level invariance, focus on MG-EFA 5.Recommendations 6.Appendix 1: DIF with rating scales, using SPSS 7.Appendix 2: Construct comparability from a factor analysis perspective.

Ron Hambleton & Craig Wells: (University of Massachusetts at Amherst, USA)
Item Response Theory: Introduction to Concepts, Models and Applications

Many testing agencies and researchers would like to use item response theory (IRT) models for developing, scoring, identifying bias, and equating of their aptitude, achievement, and personality tests. These IRT models, too, can be used to provide the measurement underpinnings for new test designs such as multi-stage testing and computer-adaptive testing. In this half-day workshop, we will survey the following topics: (1) Shortcomings of classical test theory that have inspired the development of IRT models, (2) specific IRT models for fitting binary and polytomously-scored data (e.g., 1-, 2-, and 3-parameter logistic models, graded response model), (3) basics of item and ability parameter estimation, (4) graphical and statistical approaches for assessing model fit, (5) introduction to IRT software (e.g., BILOG-MG, PARSCALE), (6) development of tests using item information, and (7) equating of test scores (designs and methods). Because of the limited time available to cover these topics comprehensively, we will provide a bibliography to facilitate follow-up reading.

Chris and Richard Sale: (EDAC)
Applying the ITC Computer and Internet testing Guidelines to a global setting

In this workshop we will examine the 4 major themes of the ITC Guidelines and demonstrate how to construct an integrated approach to global assessment that combines computer-based testing (CBT) and the Internet in a way that conforms to or exceeds these recommendations. The session will be built around a methodology developed to support a global practitioner network working with psychometrics, capability assessment and 360-degree performance report, together with online one to one feedback.
By the end of the morning, delegates will be able to:
· Apply the Guidelines constructively to enhance global assessment
· Understand how to protect questionnaire data as it moves around the Internet
· Identify key legal constraints and strategies for overcoming these
· Experience the power of fully integrated CBT and associated management utilities, including integrated statistical routines like Factor Analysis and T Test.

Eugene Burke: (SHL Group)
Test adaptation: Lessons learned from a large scale multi language programme.

With the global economy driving multi-language and multi-geography employment testing programmes, the issue of equivalence and comparability of test scores is becoming increasingly important. This session shares learning from a large-scale test development programme spanning UK English (the reference language version), Dutch, French, German, Italian, Castilian Spanish, Chinese and Japanese. The session will provide insights to:
• Where theory and practice separate in an applied programme of language adaptation
• How to establish practical quality standards for the adaptation of test content
• New statistical models for evaluating how bad an adaptation needs to get before it is rejected
• Models for evaluating the practical impacts in terms false negatives and false positives when language versions are deployed across languages and borders
• A practical checklist for ensuring that test adaptation programmes are effective

Dave Bartram, Patricia Lindley and Rachel Middleton (Psychological Testing Centre, BPS). Reaching people, ensuring quality and adding value through standards.

The workshop will review international developments in standards for assessment and tes use (such as the ISO project on assessment in work and organizational settings and the ITC Test Use Guidelines) and test user qualifications. It will also describe the role within the UK of the BPS Psychological Testing Centre (PTC). The focus of the workshop will be on why standards are important for managing the impact testing and assessment has on people and on how we can add value by moving towards greater harmonisation across countries in terms of standards of assessment, test use and testing while allowing for the significant differences in practice that occur between nations.

At the end of the workshop, delegates should have an understanding of how test and test user standards are implemented in the UK and an understanding of current developments in implementing test and test user standards in other countries. Delegates will also be updated on important international developments (such as the ISO project) and know how they can contribute to them if they so wish.

Rob Bailey (Oxford Psychologists Press).
Cross-cultural organizational applications of personality assessment

This workshop concerns the adaptation of psychometric personality instruments into other languages. The need for assessments in multiple languages appears to be on the rise as a result of two key factors:
computing technology and the growth of international organisations. The Internet is making the world a smaller place for many organizational activities including employee recruitment and development. The growth in the number of companies operating, and consequently, recruiting internationally is one factor that has contributed to the increased application of multilingual assessments. While some HR functions remain relatively unchanged in a global market place, the cross-cultural use of psychological assessments for employment decisions brings a new set of challenges and complexities to the recruitment process. This can include considerations around the use of appropriate norm groups, consequences of assessing in a second language, and measurement equivalence. It is unreasonable to expect organizational end users of psychological assessments to develop the expertise necessary to resolve these issues.
Thus it is incumbent on test publishers to evaluate and provide adequate evidence supporting the use of inferences from test scores resulting from multiple language versions. The workshop will cover the issues involved in adapting an assessment into other languages including the translation processes, the appropriate use of norms, forms of evidence for measurement equivalence across versions and how the purpose of the assessment influences these choices

Mark Shermis (University of Florida).
Integrating Assessment and Instruction: The Case for Automated Essay Scoring

This session will focus on the use of automated essay scoring (AES) as both a standardized assessment and vehicle for writing instruction. In this sense, the assessment of writing can be embedded as part of the daily activities associated with teaching it. Moreover, AES can automatically track student growth (using standard benchmarks) throughout the school year, and can be made available to students outside of formal classroom settings. The presenter will describe the basics of how the technology works, demonstrate its use, and discuss relevant research findings.