What is the BPS Statistics and Research Methods Advisory Panel and what does it do?

The BPS Statistics and Research Methods Advisory Panel was set up in 2022 to support the BPS's 11 peer-reviewed journals with Wiley. We provide expert advice on advanced statistics and research methods, and we aim to support editors in improving the quality of reviews for the benefit of the journal and (we hope) those submitting to our journals. 

Statistics allow researchers to present data in more understandable ways, making it easier to analyse, interpret and draw conclusions. Yet the range of applications and approaches is vast, which can be a challenge for journals when finding suitable reviewers. The expectation was that the panel would offer expert advice similar to statistical reviewers at other journals but tailored to psychological research. 

From the start, this included ethical expertise and qualitative research, with current expertise ranging from Bayesian statistics and statistical theory to multilevel modelling, psychometrics and clinical trials.  Our panel members are all volunteers, meeting twice annually and reporting to the BPS's Editorial Advisory Group.  

We developed a structure that was incorporated into the Wiley editorial systems with a specialist reviewer role. As Chair of the panel, I would take invitations and either respond directly to simple queries or, more often, seek a panel member with appropriate expertise to review the manuscript.

Reviewing a range of technical and advanced methods

In terms of demand, we receive a lot of queries about unusual methods or those that are more novel (to psychology). Also, many queries for advanced methods that are reasonably well known but may be unfamiliar to a particular editor or set of reviewers, perhaps because the given field is strong in qualitative methods expertise, whereas the paper uses advanced statistics (or vice versa). 

We get many requests for qualitative methods reviews, and often we are brought in during later reviewing rounds to resolve very specific issues about a particular method. In all cases, the journal editor has the final decision on accepting a paper; it is our job to provide editors with the information to inform that decision.

Expanding the panel

Now that the panel has operated for over two years, we are in a position to refine membership and, with a larger panel, expand our capacity. For instance, we are keen to offer methods review for more routine use of advanced methods to ensure best practice. 

If you are interested in joining the panel, we have vacancies for specific areas of expertise. In addition, we are looking for generalists in qualitative, mixed or statistical methods who can cover a broad range of papers using common advanced methods. 

Methods reviewers should have substantial experience in publishing research in peer-reviewed journals using advanced methods, significant experience in reviewing very specific, technical and specialist statistical methods for academic journals and a good understanding of the scholarly journal publication process.

To make sure we do not exclude early career researchers (ECRs) we have introduced a mentoring pilot for ECRs who would like to join the panel and work with a more experienced panel member. For more details, contact [email protected].