Skip to main content

Reporting check for research papers

Rigor Scan

Drop in a paper and get a reporting check on its design, statistics, materials, data and claims in seconds. Every result points to the sentence it rests on.

Example paperDubowitz et al. · PLOS ONE 18(11) · 2023 · doi:10.1371/journal.pone.0293905 · CC BY 4.0

Type of anesthesia for cancer resection surgery: No differential impact on cancer recurrence in mouse models of breast cancer

Study typeNew experimental dataAssigned treatmentsAnimal experimentsCell linesAntibodiesHuman participantsClinical trialPrediction modelOmics data
47in good shape
2unclear
12missing or flagged
13don't apply to this study
Read on device
Software checks
Check items
Link evidence

Scan complete. Select any check to see its evidence on the page.

Page 1 / 16Cell authentication · p. 3
100%
Loading page…
1
Loading page…
2
Loading page…
3
Loading page…
4
Loading page…
5
Loading page…
6
Loading page…
7
Loading page…
8
Loading page…
9
Loading page…
10
Loading page…
11
Loading page…
12
Loading page…
13
Loading page…
14
Loading page…
15
Loading page…
16
Rigor fingerprint61 checks apply
0%35%70%100%Study design67Statistics80Materials89Data & code62Ethics & disclosure89Claims87
79
Completeness index
out of 100
ReportedUnclearMissingWarning sign foundspoke length = evidence it is reported
SelectedCell authentication
Reportedevidence 98%

Does the paper state that cell lines were authenticated, for example by STR profiling?

Cell line identities were confirmed by short tandem repeat profiling (Cellbank, Australia).
Methods · page 3

This measures how completely a paper reports what it did. It does not judge whether the findings are right.

ChecksEvidence

Study design

index 67

Statistics

index 80

Materials

index 89
Reportedevidence 98%

Does the paper state that cell lines were authenticated, for example by STR profiling?

Cell line identities were confirmed by short tandem repeat profiling (Cellbank, Australia).
Methods · page 3

Data & code

index 62

Ethics & disclosure

index 89

Claims

index 87
Don't apply to this study 13 checks

This paper doesn't include these kinds of study, so their checks are left out of the score.

Study types not found

Human participants
Clinical trial
Prediction model
Omics data

Checks left out

Informed consent
Trial registration
Allocation concealment
Adverse events
Confounders adjusted
Missing data handled
Held-out evaluation
Leakage prevented
Baseline compared
External validation
Omics accession
FDR control
Batch effects

Checked by software

Plain code, no judgment calls. Statistics are recalculated, references are checked for retractions, cell lines are matched against a register of problem lines, and data links are opened.

Statistics consistentNo retracted referencesNo problem cell linesData link worksWorth a look
Statistics
3 results recomputed, all consistent
Ratio and interval: consistent
Estimate, interval and p-value agree (implied p ≈ 0.004).
HR, 0.76; 95% CI, 0.63–0.92; P < 0.01
Ratio and interval: consistent
Estimate and interval agree (implied p ≈ 0.274).
HR 0.83; 95% CI, 0.59 to 1.15)
Ratio and interval: consistent
Estimate and interval agree (implied p ≈ 0.307).
HR, 1.12; 95% CI, 0.90 to 1.39)
Nothing else to recompute
No t, F, χ², r or z results with a p-value, percentages with counts, means of whole-number data found.
References
48 references, none retracted
No retracted references
Checked 45 of 48 references: 41 DOIs in Crossref, which includes the Retraction Watch database, and 44 PubMed IDs. 3 references couldn't be matched.
2 references with a published correction
Reference 6: 2 corrections · Reference 47: 1 correction
This paper has no notices
No retraction, correction or expression of concern on its DOI.
10.1371/journal.pone.0293905
Cell lines
3 lines named, no problem lines
No problem cell lines
None of the 1,391 contaminated, misidentified or misclassified lines in Cellosaurus is named.
4T1.2
In Cellosaurus.
CVCL_GR32open ↗
66cl4 (listed as 66cl-4)
In Cellosaurus.
CVCL_9721open ↗
MDA-MB-231
In Cellosaurus, with an STR profile on file.
CVCL_0062open ↗
Data, code & registries
2 identifiers opened
Data record opens
Zenodo · open access · CC-BY-4.0 · 5 files (90 KB)
10.5281/zenodo.8429174open ↗
The data record includes analysis code
It holds .R, .RPROJ files, but the paper doesn't say its code is available.
NCT04316013 is registered
Volatile Anaesthesia and Perioperative Outcomes Related to Cancer: the VAPOR-C Trial · terminated
ClinicalTrials.govopen ↗
No RRIDs in the paper
Antibodies and other resources carry no research resource identifiers to check.
No other repositories
No GitHub, GEO, SRA, PRIDE identifiers found.

Close the gaps with K-Dense Web

15 gaps found. K-Dense Web can run the analyses, such as a power analysis or effect sizes, and draft the missing methods text. Pick what to send.

The brief lists the gaps and what to do about each one. Your paper isn't sent. Attach it in K-Dense Web if you want it to work from the full text.

Overall judgments

How much detail the methods give, and how strongly the abstract states its conclusion. Shown for context; they don't count towards the score.

Methods detailmostly detailed
MinimalPartialDetailedProtocol-level
Claim strengthmostly confident
TentativeMeasuredConfidentSweeping
  1. 1

    Read on your device

    Your browser reads the text and layout of each page. The PDF itself never leaves your computer.

  2. 2

    Check with software

    Statistics are recalculated, references checked for retractions, cell lines matched against a register and data links opened.

  3. 3

    Check each item

    About 60 reporting items are checked against the text, and each result is tied to the sentence that supports it.

  4. 4

    Score

    Items with strong evidence count as reported and items with weak evidence as missing. The score averages the items that apply to this kind of study.

Your PDF stays with you

  • The file is read in your browser and never uploaded.
  • Only the extracted text is sent for checking, and only identifiers and reference citations for the database lookups. K-Dense doesn't save any of it.
  • Results live in this tab. Close it and they're gone.

Checklist v0.3 · 23 September 2026

How scoring works

Everything that decides a result is published here: every question, every threshold and every software rule. The launch post explains how a scan works and why it's built this way.

Scoring rules

  1. An AI model reads the paper's text and answers each check below with a probability that the paper reports that item. The questions are exactly as written in the table.
  2. A check counts as reported at 70% or above, missing below 35%, and unclear in between.
  3. Warning-sign checks are scored the other way round: finding the problem lowers the score.
  4. The same pass decides which study types the paper contains. Checks for a study type below 60% are skipped and left out of every score.
  5. A domain score is the average evidence across its checks that apply. The completeness index is the average across all checks that apply, so larger domains weigh more.
  6. Software checks are reported on their own and never change the index.
  7. The checklist is versioned. Compare scores only within the same version.
evidence = p          for a reporting check
         = 1 − p      for a warning-sign check
status   = reported if evidence ≥ 0.70, missing if < 0.35, else unclear
index    = 100 × mean(evidence over the checks that apply)

Study types

Asked of every paper. A type counts as present at 60% or above.

New experimental data
Does the paper report its own experiments or measurements on people, animals, cells, tissues, or other biological samples?
Assigned treatments
Does the paper assign subjects or samples to treatments, conditions, or experimental groups chosen by the investigators?
Animal experiments
Does the paper report experiments performed on live animals?
Human participants
Does the paper report data collected from human participants, patients, or patient records?
Clinical trial
Is the paper a clinical trial that prospectively assigns human participants to interventions?
Cell lines
Does the paper report experiments on cultured cell lines?
Antibodies
Does the paper use antibodies, for example for staining, blotting, flow cytometry or immunoprecipitation?
Prediction model
Does the paper build or validate a model whose purpose is to predict outcomes for new cases?
Omics data
Does the paper generate high-throughput data such as sequencing, transcriptomics, or proteomics?

Overall judgments

Graded reads shown next to the score. They don't count towards it.

Methods detail
How much procedural detail does the methods section give for another lab to repeat the experiments? Levels: Minimal → Partial → Detailed → Protocol-level.
Claim strength
How strongly does the abstract's conclusion state its main claim? Levels: Tentative → Measured → Confident → Sweeping.
74 checks
CheckQuestion askedApplies toGuidelineType
Study design · 15
Hypothesis statedDoes the paper state a specific hypothesis or research question that the experiments test?All papersreporting
Primary outcome definedDoes the paper name a primary outcome measure for its main experiment?All papersreporting
Control groupDoes the paper include a control or comparison group for its main experiment?New experimental data or Human participantsreporting
Group sizes reportedDoes the paper report the number of animals, participants, or samples in each experimental group?New experimental data or Human participantsreporting
Sample size justifiedDoes the paper explain how the sample size was chosen, for example with a power calculation?New experimental data or Human participantsARRIVE 2.0 · item 2reporting
RandomizationDoes the paper state that subjects or samples were randomly allocated to experimental groups?Assigned treatmentsARRIVE 2.0 · item 4reporting
Randomization methodDoes the paper describe the method used to generate the random allocation sequence?Assigned treatmentsreporting
Blinded allocationDoes the paper state that the people who allocated subjects or gave the treatments did not know which group each subject was in?Assigned treatmentsARRIVE 2.0 · item 5reporting
Blinded assessmentDoes the paper state that outcomes were assessed, or data analysed, by someone who did not know which group each subject was in?Assigned treatmentsARRIVE 2.0 · item 5reporting
Inclusion criteriaDoes the paper state criteria for including or excluding subjects, samples, or data points?New experimental data or Human participantsARRIVE 2.0 · item 3reporting
Exclusions reportedDoes the paper report whether any subjects, samples, or data points were excluded from analysis?New experimental data or Human participantsARRIVE 2.0 · item 3reporting
Independent replicationDoes the paper state that key experiments were repeated independently or replicated in more than one model?New experimental datareporting
Replicate type definedDoes the paper say whether replicates are biological or technical replicates?Cell line work or Animal studiesreporting
Trial registrationDoes the paper give a clinical trial registration number, such as an NCT number?Clinical trialsreporting
Allocation concealmentDoes the paper describe how treatment allocation was concealed until assignment?Clinical trialsreporting
Statistics · 17
Tests namedDoes the paper name the statistical tests or models used to analyse the data?All papersARRIVE 2.0 · item 7reporting
Experimental unitDoes the paper state what the experimental unit of analysis is, such as a single animal, cage, or culture?New experimental dataARRIVE 2.0 · item 1reporting
Assumptions checkedDoes the paper describe checking the assumptions of its statistical tests, such as normality?All papersreporting
Multiplicity handledDoes the paper describe correcting for multiple comparisons or a pooled approach that addresses them?All papersreporting
Uncertainty reportedDoes the paper report confidence intervals, credible intervals, or standard errors for its main estimates?All papersreporting
Effect sizesDoes the paper report the size of the effect or difference between groups, not only whether it was significant?All papersreporting
Error bars definedDoes the paper define what its error bars or dispersion measures represent, such as SD or SEM?All papersreporting
Analysis softwareDoes the paper name the software or packages used for statistical analysis?All papersreporting
p-value only reportingDoes the paper report results only as significant or not significant, without estimates of effect size?All paperswarning sign
Confounders adjustedDoes the paper adjust its analysis for potential confounding variables?Human participantsreporting
Missing data handledDoes the paper describe how missing data were handled?Human participantsreporting
Held-out evaluationDoes the paper evaluate its model on data that were not used for training?Prediction modelsreporting
Leakage preventedDoes the paper describe steps taken to prevent information leaking from test data into training?Prediction modelsreporting
Baseline comparedDoes the paper compare its model against a simpler baseline method?Prediction modelsreporting
External validationDoes the paper validate its model on an independent external dataset?Prediction modelsreporting
FDR controlDoes the paper control the false discovery rate for its high-throughput analyses?Omics datareporting
Batch effectsDoes the paper describe how batch effects were assessed or corrected?Omics datareporting
Materials · 12
Species & strainDoes the paper report the species and strain of the animals used?Animal studiesARRIVE 2.0 · item 8reporting
Sex reportedDoes the paper report the sex of the animals used?Animal studiesARRIVE 2.0 · item 8reporting
Age or weightDoes the paper report the age or weight of the animals used?Animal studiesARRIVE 2.0 · item 8reporting
Animal sourceDoes the paper name the supplier or source of the animals?Animal studiesARRIVE 2.0 · item 8reporting
Housing & husbandryDoes the paper describe how the animals were housed, such as cage conditions, light cycle, or food and water access?Animal studiesARRIVE 2.0 · item 15reporting
Cell line sourceDoes the paper name the source of each cell line used?Cell line workreporting
Cell authenticationDoes the paper state that cell lines were authenticated, for example by STR profiling?Cell line workreporting
Mycoplasma testingDoes the paper state that cell lines were tested for mycoplasma contamination?Cell line workreporting
Antibody identifiersDoes the paper give clone names, catalogue numbers, or RRIDs for the antibodies used?Antibody usereporting
Reagent sourcesDoes the paper name the manufacturer or supplier of key reagents?Cell line work or Animal studiesreporting
Doses & routesDoes the paper report the doses and routes of administration for treatments given?Assigned treatmentsreporting
Instruments namedDoes the paper name the instruments or equipment models used for measurements?New experimental datareporting
Data & code · 10
Data statementDoes the paper include a data availability statement?All papersreporting
Data in a repositoryDoes the paper deposit its data in a public repository and give an accession number, DOI, or link?All papersreporting
Data only on requestDoes the paper say its data are available only on request from the authors?All paperswarning sign
Code availableDoes the paper state that its analysis code is publicly available?All papersreporting
Code linkDoes the paper give a link or DOI for its analysis code?All papersreporting
Protocol sharedDoes the paper link to a detailed protocol, such as on protocols.io or in the supplement?New experimental datareporting
PreregisteredDoes the paper state that the study or its analysis plan was preregistered?All papersreporting
Supporting filesDoes the paper provide supplementary data, tables, or figures?All papersreporting
Raw dataDoes the paper state that raw or individual-level data are shared, not only summary statistics?All papersreporting
Omics accessionDoes the paper give an accession number for its sequencing or omics data, such as a GEO or SRA ID?Omics datareporting
Ethics & disclosure · 11
Ethics approvalDoes the paper state that an ethics committee or institutional board approved the study?Human participants or Animal studiesARRIVE 2.0 · item 13reporting
Approval numberDoes the paper give the protocol or approval number from the ethics committee?Human participants or Animal studiesreporting
Informed consentDoes the paper state that informed consent was obtained from participants?Human participantsreporting
Humane endpointsDoes the paper define humane endpoints for the animals?Animal studiesARRIVE 2.0 · item 16reporting
Anaesthesia & analgesiaDoes the paper describe the anaesthesia or pain relief given to the animals?Animal studiesreporting
Euthanasia methodDoes the paper describe how the animals were euthanised?Animal studiesreporting
Funding statementDoes the paper state who funded the work?All papersreporting
Funder roleDoes the paper state what role, if any, the funders had in the study?All papersreporting
Competing interestsDoes the paper include a competing interests or conflict of interest statement?All papersreporting
Author contributionsDoes the paper list what each author contributed?All papersreporting
Reporting guidelineDoes the paper state that it follows a reporting guideline such as ARRIVE, CONSORT, or STROBE?New experimental data or Human participantsreporting
Claims · 9
Limitations discussedDoes the paper discuss limitations of its own study?All papersreporting
Compared to prior workDoes the paper compare its findings with results from previous studies?All papersreporting
Alternative explanationsDoes the paper consider alternative explanations for its findings?All papersreporting
Null results reportedDoes the paper report experiments that found no effect or no difference?All papersreporting
Translation caveatDoes the paper caution that results in its model system may not carry over to humans?Animal studiesreporting
Causal overreachDoes the paper describe a correlation or association as if it proves causation?All paperswarning sign
OvergeneralizationDoes the paper generalize its conclusions to populations or conditions it did not study?All paperswarning sign
Next steps statedDoes the paper state what further studies are needed to confirm or extend its findings?All papersreporting
Adverse eventsDoes the paper report adverse events or harms in each group?Clinical trialsreporting

Software checks

Reported statistics

t, F, χ², r and z results that come with a p-value are recomputed. The rounding of the reported statistic is allowed for. A mismatch is flagged, and marked serious when the recomputed p falls on the other side of 0.05.

Method follows statcheck (Nuijten et al., 2016, Behavior Research Methods).

Ratios and intervals

For hazard, odds and risk ratios with a 95% interval, the estimate must lie inside the interval and near its centre on the log scale, and any p-value must agree with the one the interval implies.

Altman & Bland (2011), BMJ 343:d2090.

Percentages

Every "x of n (y%)" is recomputed and must match to the precision reported.

Plain arithmetic.

GRIM

A mean of whole-number data (counts, scores, ratings) must be reachable with the reported n. Only applied when the sentence says the data are whole numbers and n is small enough for the test to say anything.

Brown & Heathers (2017), Social Psychological and Personality Science.

Retractions and notices

Each reference DOI is looked up in Crossref, which carries the Retraction Watch database, and each PubMed ID in PubMed. A reference without either is matched in Crossref by its citation, and the match only counts when the title agrees. Retractions and expressions of concern are flagged; corrections are listed. The paper's own DOI is checked too.

Crossref REST API, Retraction Watch, NCBI E-utilities.

Cell lines

Cell line names in the text are compared with the lines Cellosaurus lists as contaminated, misidentified or misclassified. Named lines are also looked up for their Cellosaurus accession and STR profile.

Cellosaurus (SIB), CC BY 4.0.

Data, code and registries

Repository DOIs must resolve and, where the repository says, hold files. GitHub repositories must exist. GEO accessions must be public. Trial registration numbers must exist in their registry. RRIDs must resolve.

doi.org, Zenodo, GitHub, NCBI, ClinicalTrials.gov, SciCrunch.

What leaves your device

Only identifiers (DOIs, PubMed IDs, accession and registration numbers, cell line names) and the citations of references that have no identifier. Never the body of the paper.

Limits

  • Text only. Figures, and tables drawn as images, aren't read.
  • Supplementary files aren't included unless they're part of the PDF.
  • Scanned PDFs without a text layer can't be read.
  • English works best.
  • A check reads what the paper says, not whether it's true. A paper can report every item and still be wrong.
  • The AI can misread. Every result links to its evidence so you can check it.

Example: Dubowitz J, Ziegler AI, Beare R, et al. (2023) Type of anesthesia for cancer resection surgery: No differential impact on cancer recurrence in mouse models of breast cancer. PLOS ONE 18(11): e0293905. Licensed CC BY 4.0.

Checks adapted from ARRIVE 2.0 and common journal reporting checklists. Software checks use Crossref and the Retraction Watch database, PubMed, Cellosaurus (CC BY 4.0), Zenodo, GitHub, NCBI GEO, ClinicalTrials.gov and SciCrunch.