Product Design, Manufacturing & Innovation Resources
Home » Online Tools » Problematic Paper Screener (PPS)

Problematic Paper Screener (PPS)

The Problematic Paper Screener (PPS) tool runs automated “fingerprint-queries” against the Dimensions.ai academic search engine, hunting for textual or structural patterns that correlate with known fraud. Malpractices are automatically identified using specific fingerprint-queries submitted to Dimensions.ai, and human peer judgment can then confirm or refute the status of a suspect paper. The public interface also lets users propose new fingerprints, so the detection list keeps growing. (extract from Wikipedia, as text below).

What it actually catches:

  • Tortured phrases — garbled paraphrases like “fake neural organization” instead of “artificial neural network,” produced when fraudsters run stolen text through synonym-swapping software to dodge plagiarism checkers.
  • Computer-generated gibberish — papers built from nonsense generators like SCIgen and Mathgen, identified via fixed phrases these tools always produce, such as “though many skeptics said it couldn’t be done”.
  • ChatGPT fingerprints — leftover snippets of telltale AI-generated text accidentally left in a submitted manuscript, plus several other detector types for things like suspicious citation patterns.

Its track record: the screener has been instrumental in more than 1,000 retractions, and some publishers have built it directly into their editorial workflow to catch suspect papers before publication rather than after. It was named one of ten key developments in science by Nature in 2021. Over 12,000 flagged-but-not-yet-retracted papers have also been integrated into a separate tool called Signals, where they’re collectively cited more than 160,000 times — illustrating how long flagged-but-unretracted fraud can keep circulating and influencing other research before anyone formally acts on it.

It doesn’t replace human editorial judgment, but it does the one thing humans can’t do at scale — continuously scanning tens of millions of papers for fraud fingerprints and surfacing the suspicious ones for a person to actually review.

Disciplines: Research integrity, Scientific publishing, Bibliometrics, Academic research.
Free alternative to Clear Skies Papermill Alarm, Dimensions.
Problematic Paper Screener compared with Clear Skies Papermill Alarm and Dimensions
Problematic Paper Screener (PPS)Clear Skies Papermill AlarmDimensions
Detection approach: PPS runs fingerprint queries, which are fixed word sequences. They target tortured phrases such as fake neural organization for artificial neural network, and the output of text generators such as SCIgen and Mathgen. A match is only a suspicion.Detection approach: The Papermill Alarm gives each paper a traffic-light rating. Red means high similarity to known paper-mill content, orange moderate similarity, green no resemblance. Clear Skies states that it kept only detection methods with real predictive power, including AI-based text analysis and network analysis.Detection approach: Dimensions is not a detector. In this pairing it is the academic search engine against which PPS submits its fingerprint queries.
Data and inputs: PPS searches the Dimensions index regularly, so newly indexed papers are screened. Each flagged record links to the Dimensions entry, the DOI, the fingerprints found in the full text and related PubPeer posts.Data and inputs: The system is described as self-improving as new data arrives from publishers. The public version launched in 2022 and is optimized for cancer research.Data and inputs: Dimensions links publications, datasets, grants, patents, clinical trials, policy documents and reports, plus researchers and organizations. It is a bibliometric database, not a screening corpus.
Access and users: PPS has a public online interface where anyone can view suspect papers and propose new fingerprints. The aim is post-publication reassessment by researchers, sleuths and editors.Access and users: Publishers are the target users. Access is offered as an API through a direct agreement, or through partners such as the STM Integrity Hub and Morressier. Publisher integration in the Hub is opt-in.Access and users: Access is through the web application or an API. The API page offers a demo or a quote on request and lists subscription offerings. At its 2018 launch, Dimensions also had a free core version and paid tiers.
Validity limits: Detection depends on known fingerprints, so new generators or phrasings can be missed until someone adds them. Flags stay suspicions until human peers classify the paper as problematic or not. The authors report no accuracy or error rates, and validation covers mainly computer-generated and synonymized text.

More OSINT, Search tools

Suggest your best online tool:

Do you know a better, a complementary or a replacement website to the one listed above ?

> Suggest it here <

10th year anniversary

Full size images and downloads are only available, 100% free, for registered members.

> Login <