Checking for missing content type metadata ...

Checking for non-preferred file/folder path names (may take a long time depending on the number of files/folders) ...

CIROH publication data, code, and software sharing audit (2022-2026): item-level audit data, publication list, protocol, and analysis code
Authors:
Owners: This resource does not have an owner who is an active HydroShare user. Contact CUAHSI (help@cuahsi.org) for information on this resource.
Type: Resource
Storage: The size of this resource is 730.8 KB
Created: Oct 10, 2026 at 12:06 a.m. (UTC)
Last updated: Oct 20, 2026 at 3:14 p.m. (UTC) (Metadata update)
Published date: Oct 20, 2026 at 3:14 p.m. (UTC)
DOI: 10.4211/hs.e189373b5beb464580745347ecb070c1
Citation: See how to cite this resource
Content types: CSV Content 
Sharing Status: Published
Views: 127
Downloads: 22
+1 Votes: 2 others +1 this
Comments: No comments (yet)

Abstract

This resource contains the complete data, protocol, and analysis code behind a manual, paper-by-paper audit of data, code, and software sharing in the peer-reviewed publication record of the Cooperative Institute for Research to Operations in Hydrology (CIROH), a NOAA Cooperative Institute. Two trained reviewers examined each publication's data, code, and software availability statements, methods, and supplements and logged one row per distinct dataset, code repository, or software tool mentioned, recording its name, link or DOI, type, whether it was created for the paper or used as an input, the repository hosting it, whether it carries a citable DOI, and whether the deposit itself acknowledges CIROH or NOAA funding. Every row was reviewed a second time by the other reviewer. The corpus combines 225 publications from CIROH award-reporting records (March 2026) with 53 publications added from the CIROH Zotero group library after June 30, 2026 and retained only if Crossref identifies them as journal articles published in 2022 or later; the 45 group-library candidates excluded by that rule are listed with reasons. The frozen audit workbook (803 logged rows across 278 publications), the 229-publication master tracking list, a per-publication table with Crossref years, the written audit protocol, and a Python script that recomputes every statistic and regenerates the figures reported in the accompanying paper are included. The resource supports the paper "Unarchived and undercounted: A systematic audit of data, code, and software sharing practices in NOAA hydrologic research" (Bowcut, Parker, Ames, Castronova, and Read; submitted to PLOS Water, 2026).

Subject Keywords

Coverage

Temporal

Start Date:
End Date:

Content

README.md

CIROH publication data, code, and software sharing audit (2022–2026)

Item-level audit data, publication list, audit protocol, and analysis code supporting:

Bowcut S, Parker B, Ames DP, Castronova A, Read JS. Unarchived and undercounted: A systematic audit of data, code, and software sharing practices in NOAA hydrologic research. Submitted to PLOS Water, 2026. (Add the article DOI here when assigned.)

Corresponding author: Daniel P. Ames, Brigham Young University, dan.ames@byu.edu

Contents

Path What it is
data/CIROH_data_audit_sheet.xlsx The completed item-level audit workbook (frozen 2026-10-11). Sheet Data Entry holds one row per dataset, code repository, or software tool mentioned in each publication (803 logged rows across 278 publications; header on row 2). Rows for the 45 group-library candidates that failed the inclusion rule (see below) have been removed; they are listed in excluded_publications.csv. Sheet Instructions is the working guide the reviewers followed.
data/CIROH_data_audit_sheet.csv The Data Entry sheet exported as UTF-8 CSV (content rows only, header on row 1) for use without Excel.
data/CIROH_publication_tracking_list.csv The 229-publication master tracking list (CIROH award-reporting records provided by CUAHSI, March 2026, as maintained by BYU through 2026-10-08), including research theme, PI, publication type, status, date, and DOI. Column Included in data audit marks the 225 publications audited at the item level.
data/excluded_publications.csv The 45 group-library candidates removed by the inclusion rule (journal articles published 2022 or later, per Crossref), with year, type, rows removed, and reason.
data/audit_papers_with_crossref_years.csv One row per audited publication DOI with its source (master list or Zotero group-library expansion), Crossref publication year and type, row counts, and a flag column marking items that predate CIROH (before 2022), preprints, conference proceedings, or unresolvable DOIs. Generated 2026-08-21 for the corpus-validity check described in the paper's Limitations.
data/hydroshare_resource_status_check_2026-08.json Raw HydroShare system-metadata responses for the 16 HydroShare resources cited by landing-page URL rather than DOI, retrieved August 2026 (published / public / discoverable flags).
protocol/S1_Text_audit_protocol.pdf The written manual audit protocol (S1 Text of the paper).
code/compute_summary_stats.py Recomputes every summary statistic reported in the paper's Results from CIROH_data_audit_sheet.xlsx. Requires Python 3 and openpyxl.
code/compute_summary_stats_output.txt Output of the script on the frozen workbook.
code/make_figures.py Produces Fig 1 (master-list publications by year and theme, from the tracking list), Fig 2 (repository by item type), and Fig 3 (DOI and funder acknowledgment by repository) as 300-dpi TIFF and PNG. Requires matplotlib and openpyxl.

Column dictionary for the audit sheet

Column Values Meaning
paper_doi DOI, handle, or ISBN of the publication (one master-list technical report carries the placeholder _) Publication the row belongs to. One publication can have many rows.
Checked by: reviewer name First-pass reviewer.
Double Checked TRUE Row was reviewed a second time by the other reviewer. All 803 rows are TRUE.
section_source Data Availability, Code Availability, Software Availability, Methods, Supplement, Table, Open Research, None found Where in the paper the item was found. None found marks a placeholder row for a paper with no locatable statement.
item_type Data, Code, Software, Figure Blank where not recorded.
item_name text Name exactly as given in the paper.
item_link URL or DOI As given in the paper; DOI preferred when both exist.
has_doi Yes, No Whether the item carries a citable DOI.
origin Created for this paper, Pre-existing, Unclear Whether the item was produced for the paper or used as an input.
origin_confidence High, Medium, Low High: two or more of the three signals below; Medium: one; Low: none (reviewer judgment). Recorded for created-for-paper rows and one unclear row.
author_overlap Yes, No, Not checked Deposit creators overlap the paper's authors.
ciroh_grant_ack Yes, No, Not checked Deposit metadata or description acknowledges CIROH or the NOAA/NSF award.
data_references_paper Yes, No, Not checked Deposit explicitly references or links to the paper.
notes text Reviewer notes, including reasoning for Low-confidence calls.
repository GitHub, Zenodo, HydroShare, No repository, or the named host Where the item is hosted.
hydroshare_candidate Yes, No, Maybe Reviewer judgment on whether the item could be hosted on HydroShare.

Rows after the divider row Publications Added After June 30th come from the CIROH Zotero group-library expansion; rows before it come from the master tracking list. Group-library entries were retained only if Crossref identified them as journal articles published in 2022 or later; the corpus is 225 master-list publications plus 53 retained additions.

Reproducing the paper's numbers

bash pip install openpyxl matplotlib python code/compute_summary_stats.py data/CIROH_data_audit_sheet.xlsx python code/make_figures.py data/CIROH_data_audit_sheet.xlsx figures data/CIROH_publication_tracking_list.csv

Funding

This work was supported by the Cooperative Institute for Research to Operations in Hydrology (CIROH) with funding under award NA22NWS4320003 from the NOAA Cooperative Institute Program. The statements, findings, conclusions, and recommendations are those of the authors and do not necessarily reflect the opinions of NOAA.

License

Creative Commons Attribution 4.0 International (CC BY 4.0).

Related Resources

This resource is described by Bowcut S, Parker B, Ames DP, Castronova A, Read JS. Unarchived and undercounted: A systematic audit of data, code, and software sharing practices in NOAA hydrologic research. Manuscript submitted to PLOS Water, 2026. (Placeholder: will be replaced with the article DOI on publication.)

Credits

Funding Agencies

This resource was created using funding from the following sources:
Agency Name Award Title Award Number
National Oceanic and Atmospheric Administration Cooperative Institute for Research to Operations in Hydrology (CIROH) NA22NWS4320003

How to Cite

Bowcut, S., Parker, B., Ames, D., Castronova, A. M., Read, J. S. (2026). CIROH publication data, code, and software sharing audit (2022-2026): item-level audit data, publication list, protocol, and analysis code, HydroShare, https://doi.org/10.4211/hs.e189373b5beb464580745347ecb070c1

This resource is shared under the Creative Commons Attribution CC BY.

 http://creativecommons.org/licenses/by/4.0/
CC-BY

Comments

There are currently no comments

New Comment

required