Tag Archives: Peer review

The cruel optimism of peer review

The cruel optimism of peer review

A relation of cruel optimism exists when something you desire is actually an obstacle to your flourishing. It might involve food, or a kind of love; it might be a fantasy of the good life, or a political project. It might rest on something simpler, too, like a new habit that promises to induce in […] … learn more→

The peer review system is breaking down. Here’s how we can fix it

The peer review system is breaking down. Here’s how we can fix it

Scientific publishing relies on peer review as the mechanism that maintains trust in what we publish. When we read a journal article, we assume experts have rigorously scrutinised it before publication. This crucial system is currently under severe strain. We conducted a comprehensive study of Australian academic journals and their editors – surveying 139 editors and interviewing 27. […] … learn more→

AI will soon be able to audit all published research – what will that mean for public trust in science?

AI will soon be able to audit all published research – what will that mean for public trust in science?

Self-correction is fundamental to science. One of its most important forms is peer review, when anonymous experts scrutinise research before it is published. This helps safeguard the accuracy of the written record. Yet problems slip through. A range of grassroots and institutional initiatives work to identify problematic papers, strengthen the peer-review process, and clean up the […] … learn more→

What is peer review? The role anonymous experts play in scrutinizing research before it gets published

What is peer review? The role anonymous experts play in scrutinizing research before it gets published

Reviewer 1: “This manuscript is a timely and important contribution to the field, with clear methodology and compelling results. I recommend publication with only minor revisions.” Reviewer 2: “This manuscript is deeply flawed. The authors’ conclusions are not supported by data, and key literature is ignored. Major revisions are required before it can be considered.” […] … learn more→

‘Vague, confusing, and did nothing to improve my work’: how AI can undermine peer review

‘Vague, confusing, and did nothing to improve my work’: how AI can undermine peer review

Earlier this year I received comments on an academic manuscript of mine as part of the usual peer review process, and noticed something strange. My research focuses on ensuring trustworthy evidence is used to inform policy, practice and decision making. I often collaborate with groups like the World Health Organization to conduct systematic reviews to […] … learn more→

Peer review isn’t perfect − I know because I teach others how to do it and I’ve seen firsthand how it comes up short

Peer review isn’t perfect − I know because I teach others how to do it and I’ve seen firsthand how it comes up short

When I teach research methods, a major focus is peer review. As a process, peer review evaluates academic papers for their quality, integrity and impact on a field, largely shaping what scientists accept as “knowledge.” By instinct, any academic follows up a new idea with the question, “Was that peer reviewed?” Although I believe in the […] … learn more→

Familiarity and peer review

Familiarity and peer review

I’ve been doing some work. How don’t get me wrong, I love literature work. But I am finding it all a bit same old same old right now. All the papers read the sme, even though they have different things to say. Yawn. I think I have an explanation for why that’s so. There’s a […] … learn more→

How does open assessment renew the scientific conversation?

How does open assessment renew the scientific conversation?

The polarization of the discussions but also the scale of the public health issues in the debate on the scientific reliability of preprints have not always allowed the general public to grasp the importance of the peer review process – also called “evaluation” – for the functioning of the scientific community. The publishing model in today’s academic […] … learn more→

Reviewers should stop doing the market’s dirty work

Reviewers should stop doing the market’s dirty work

I’m planning some renovations in the house, so I’m learning about party wall surveyors. Their role is to resolve disputes between neighbours. But, strikingly, no matter who appoints them or pays for their services, party wall surveyors do not act on behalf of either neighbour. Rather, they act “for the wall”. Science, too, is a […] … learn more→