01-02-23, 12:15 PM
Watts Up With That?
The Rise and Fall of Peer Review
Charles Rotter
January 2, 2023
Excerpt:
Adam Mastroianni has written a marvelous article at his substack, Experimental History, evaluating the history, the function and the misfunction of the peer review process.
For the last 60 years or so, science has been running an experiment on itself. The experimental design wasn’t great; there was no randomization and no control group. Nobody was in charge, exactly, and nobody was really taking consistent measurements. And yet it was the most massive experiment ever run, and it included every scientist on Earth.
Most of those folks didn’t even realize they were in an experiment. Many of them, including me, weren’t born when the experiment started. If we had noticed what was going on, maybe we would have demanded a basic level of scientific rigor. Maybe nobody objected because the hypothesis seemed so obviously true: science will be better off if we have someone check every paper and reject the ones that don’t pass muster. They called it “peer review.”
This was a massive change. From antiquity to modernity, scientists wrote letters and circulated monographs, and the main barriers stopping them from communicating their findings were the cost of paper, postage, or a printing press, or on rare occasions, the cost of a visit from the Catholic Church. Scientific journals appeared in the 1600s, but they operated more like magazines or newsletters, and their processes of picking articles ranged from “we print whatever we get” to “the editor asks his friend what he thinks” to “the whole society votes.” Sometimes journals couldn’t get enough papers to publish, so editors had to go around begging their friends to submit manuscripts, or fill the space themselves. Scientific publishing remained a hodgepodge for centuries.
https://experimentalhistory.substack.com...eer-review
==============
Retraction Watch shows that a lot of bad papers survived "peer review" many times.
Here is a list of 250 Corona Virus papers retracted for various reasons,
Retracted coronavirus (COVID-19) papers
LINK
The Rise and Fall of Peer Review
Charles Rotter
January 2, 2023
Excerpt:
Adam Mastroianni has written a marvelous article at his substack, Experimental History, evaluating the history, the function and the misfunction of the peer review process.
For the last 60 years or so, science has been running an experiment on itself. The experimental design wasn’t great; there was no randomization and no control group. Nobody was in charge, exactly, and nobody was really taking consistent measurements. And yet it was the most massive experiment ever run, and it included every scientist on Earth.
Most of those folks didn’t even realize they were in an experiment. Many of them, including me, weren’t born when the experiment started. If we had noticed what was going on, maybe we would have demanded a basic level of scientific rigor. Maybe nobody objected because the hypothesis seemed so obviously true: science will be better off if we have someone check every paper and reject the ones that don’t pass muster. They called it “peer review.”
This was a massive change. From antiquity to modernity, scientists wrote letters and circulated monographs, and the main barriers stopping them from communicating their findings were the cost of paper, postage, or a printing press, or on rare occasions, the cost of a visit from the Catholic Church. Scientific journals appeared in the 1600s, but they operated more like magazines or newsletters, and their processes of picking articles ranged from “we print whatever we get” to “the editor asks his friend what he thinks” to “the whole society votes.” Sometimes journals couldn’t get enough papers to publish, so editors had to go around begging their friends to submit manuscripts, or fill the space themselves. Scientific publishing remained a hodgepodge for centuries.
https://experimentalhistory.substack.com...eer-review
==============
Retraction Watch shows that a lot of bad papers survived "peer review" many times.
Here is a list of 250 Corona Virus papers retracted for various reasons,
Retracted coronavirus (COVID-19) papers
LINK
“A theory that is not refutable by any conceivable event is non-scientific.” – Karl Popper
Terms of Service
Moderation Guidelines
Terms of Service
Moderation Guidelines
