Checking for non-preferred file/folder path names (may take a long time depending on the number of files/folders) ...

This resource contains some files/folders that have non-preferred characters in their name. Show non-conforming files/folders.

This resource contains content types with files that need to be updated to match with metadata changes. Show content type files that need updating.

Data and Code for Build and Execute Scientific Workflows in the Cloud

Authors:
Owners:		This resource does not have an owner who is an active HydroShare user. Contact CUAHSI (help@cuahsi.org) for information on this resource.
Type:	Resource
Storage:	The size of this resource is 146.7 MB
Created:	May 30, 2024 at 3:28 p.m.
Last updated:	May 31, 2024 at 2:22 p.m.
Citation:	See how to cite this resource

Sharing Status:	Public
Views:	412
Downloads:	260
+1 Votes:	Be the first one to this.
Comments:	No comments (yet)

Abstract

This resource contains data and codes demonstrating how to build and execute scientific workflows in the cloud using cyberinfrastructure developed as part of the “HydroShare Modernization” CIROH research project. The goal is to illustrate how the general-purpose cloud analysis workflows developed to support common data archival operations can also be leveraged for scientific computing. This notebook describes the process for using the outcomes of the aforementioned CIROH project; however, these capabilities are still under active development and are not ready for widespread public use.

Subject Keywords

Deleting all keywords will set the resource sharing status to private.

Content

Learn more about the BagIt download

Select a file to see file type metadata.

readme.md

Content of this resource:

img: This folder contains the image (vpu-16.png) of HUC2 16 (the Great Basin Region) referenced in the execute-cfe-in-the-cloud.ipynb file.
execute-cfe-in-the-cloud.ipynb: This notebook demonstrates how to run a full simulation of a hydrological model within the ngen framework.
modify-parameters-and-execute-cfe.ipynb: This notebook demonstrates how to modify model input parameters (e.g., a parameter used in surface runoff parameterization) and re-run the model with the new configuration.
nextgen_16.gpkg: The geopackage of the VPU (vector processing unit) 16. This is one of the input required for mapping purposes in the jupyter notebook and selecting the region of interest and get the id of the most downstream catchment for which we want to delineate the upstream watershed and contrbituing areas and run the model.
helpers.py: A Python script containing helper functions used in the notebooks.
utils.py: A Python script containing utility functions used in the notebooks.
requirements.txt: A text file listing the dependencies required to run the notebooks.
2024-CIROH-Cloud-Workflows-Workshop-Slides: Slides presented at the workshop.

To successfully run the notebooks, please ensure that:

✅ You have a HydroShare account to authorize the CIROH platform to access your resource content.
✅ You have already added the CIROH JupyterHub WebApp to your “Open With” list menu. You can access the "CIROH Production Jupyterhub" resource on HydroShare (https://www.hydroshare.org/resource/2dd1ac86e8854d4fb9fe5fbafaec2b98/). This resource is a "web app connector" allowing you to add the CIROH production JupyterHub to your list of apps available via your "Open with" menu in HydroShare. Ensure that the square icon labeled "Add Web App to Open with list" in HydroShare is green. If it appears red, a single click will change it to green.
✅ You have access to the CIROH JupyterHub environments.

Follow the instructions provided in the Word document to help you check these items above.

Related Geospatial Features

This HydroShare resource is linked to the following geospatial features

Geoconnex, through the Internet of Water: This field allows you to relate this resource to overlapping geospatial features in order to increase the FAIRness and discoverability of your data. Below, collections of reference features within the United States are provided. Search these collections to find features that overlap with your data, or provide a URL that resolves to a geospatial feature not yet in the Geoconnex collections.
Learn more about Related Geospatial Features

We highly recommend that you add Spatial Coverage to this resource before searching for related geospatial features. Otherwise query times can be excessive.

Please note: your resource spatial extent (${(resSpatialExtentArea * 1e-6).toFixed(0)} square kilometers) is larger than a big US state. You might experience reduced performance during your searches.

${ searchResultString }

${ messageObj.message }

${value.text}

Click a point to search for features that overlap with that location.

Select a feature for more information.

Credits

Funding Agencies

This resource was created using funding from the following sources:

Agency Name	Award Title	Award Number
National Oceanic and Atmospheric Administration (NOAA), University of Alabama	CUAHSI HydroShare Modernization

How to Cite

Garousi-Nejad, I., A. M. Castronova, S. Black (2024). Data and Code for Build and Execute Scientific Workflows in the Cloud, HydroShare, http://www.hydroshare.org/resource/0d0a8d67a7fe4676bc84f6973dde0fc8

This resource is shared under the Creative Commons Attribution CC BY.

http://creativecommons.org/licenses/by/4.0/

Comments

There are currently no comments