Unidata Science Gateway
Table of Contents
Figure 1: Unidata Python Gallery GOES-16 true color notebook by Brian Blaylock available via the Unidata JupyterHub.
News
01/30/2024, AMS 2024
We will be presenting an e-poster entitled Advancing Atmospheric Science Education: Customized PyAOS JupyterHubs via the Unidata Science Gateway
Introduction
Welcome to the Unidata Science Gateway. Unidata is a diverse community of education and research institutions with the common goal of sharing geoscience data and the tools to access and visualize that data. For more than 30 years, Unidata has been providing data, software tools, and support to enhance Earth-system education and research. Funded primarily by the National Science Foundation (NSF), Unidata is one of the University Corporation for Atmospheric Research (UCAR)'s Community Programs (UCP).
The Unidata Science Gateway unites Unidata technologies with the NSF Jetstream cloud computing platform and open-source software such as Project Jupyter to provide the academic and research community an environment they can employ to access, analyze and visualize real-time and case study Earth system science data. The Unidata Science Gateway is a virtual space where communities can collaborate, share resources, and learn from each other in a classroom or workshop setting.
The Unidata Science Gateway employs a collection of data distribution and serving technologies to provide data to a variety of analysis and visualization applications both within and outside the gateway. The Unidata Science Gateway receives real-time data through the LDM/IDD peer-to-peer data transfer system. Once data have been ingested by the Science Gateway, THREDDS, RAMADDA, AWIPS EDEX, and ADDE data servers supply real-time and case study data to analysis and visualization applications through a variety of well-known and standard data access and subsetting mechanisms. In addition, the Unidata Science Gateway can contain Jupyter Notebook environments pre-configured with PyAOS (Python for the Atmospheric and Oceanic Sciences) libraries to provide data analysis and visualization notebook environments accessible from a web browser. Data available on the Science Gateway can also be accessed from traditional geoscientific desktop applications such as the IDV, AWIPS CAVE, and McIDAS.
The COVID-19 pandemic and the transition to remote work and learning has significantly increased use of the Unidata Science Gateway. The Unidata Science Gateway has supported workshops and semester-long classes at about a dozen universities and other institutions. It has been used to support two AMS Python workshops, IT training for UCAR SOARS Protégés as well as for individual internship projects, and an NSF REU program at the University of Oklahoma. To date, the Unidata Science Gateway has supported about 700 students (mostly undergraduate meteorology students).
JupyterHub
JupyterHub is a technology that can serve programmatic, interactive notebooks to a class of students or for scientific researchers. The Unidata JupyterHub provides users access to the notebooks contained within the Unidata/python-training project and the computing environment required to run them. To gain access to this server, please send a message to support-gateway@unidata.ucar.edu. A free GitHub login is required for access. After logging in, please read the README_FIRST.ipynb
notebook that is periodically updated with relevant information concerning this JupyterHub installation.
Also available are dedicated notebook servers for workshops or semester long classes. Please email us at support-gateway@unidata.ucar.edu for these types of requests.
THREDDS Data Server
The Unidata THREDDS Data server (TDS) is a web server that provides metadata and data access for scientific datasets, using a variety of remote data access protocols. A TDS is available on Jetstream at https://tds.scigw.unidata.ucar.edu/thredds/catalog.xml
supplying a good portion of the data available on the IDD with a five day archive.
This TDS can be accessed from the IDV or from Python with the netCDF-Python or Siphon APIs or any THREDDS client (e.g., PyCSW).
THREDDS AWS Nexrad Server
THREDDS AWS Nexrad Installation on Jetstream
In collaboration with the NOAA and Amazon Web Services (AWS), Unidata has deployed a THREDDS AWS Nexrad Server on the Jetstream Cloud. More than twenty years of Nexrad Level II data are available from this server. The data reside on AWS, but are served out by a THREDDS Data server running on Jetstream.
AWIPS EDEX
EDEX installation on Jetstream: edex-cloud.unidata.ucar.edu
AWIPS is a meteorological display and analysis system used by the National Weather Service. EDEX is the server-side component of this system. Unidata maintains an EDEX data server on Jetstream to ingest and serve real-time AWIPS data for rendering by the CAVE client and the python-awips data access framework. For CAVE, simply enter edex-cloud.unidata.ucar.edu
in the CAVE Connectivity Preferences dialog to connect.
RAMADDA Geoscience CMS
RAMADDA installation on Jetstream
RAMADDA is a geoscience content management system (CMS) originally developed at Unidata and now maintained by Geode Systems. The RAMADDA installation on Jetstream contains IDV bundles that retrieve data from Jetstream data servers.
LDM
The Unidata Local Data Manager (LDM) system is a peer-to-peer network for event-driven data distribution, and is the fundamental component of the Unidata Internet Data (IDD) system. Two internal LDM nodes supply data to our Jetstream resources.
ADDE
ADDE installation on Jetstream: adde://adde.scigw.unidata.ucar.edu:112
ADDE (Abstract Data Distribution Environment) is a data server developed by the University of Wisconsin, Space Science Engineering Center. It primarily serves satellite and radar imagery and point observations to the IDV, McIDAS-V, McIDAS-X. An ADDE server is available at adde.scigw.unidata.ucar.edu
over (the usual) port 112
.
IDV Resources
The Unidata Integrated Data Viewer (IDV) is a desktop application for viewing data in two and three dimensions. It excels at bringing together geoscience data from disparate sources into one integrated display.
Running the IDV on Jetstream
For those who have a Jetstream allocation (e.g., startup, education, research), an IDV image is available when selecting VMs through the Jetstream Atmosphere dashboard. If you do not have a Jetstream allocation, it is possible to obtain a Jetstream Trial Access account. When searching for images, search for "IDV". You will find the Unidata IDV <version>
image. Launching that image will then allow you to "Open Web Desktop" where the IDV will be available pre-loaded with the Jetstream plugin. The catalogs available via the IDV Dashboard, Data Choosers will default to the TDS and RAMADDA servers running on Jetstream enabling data-proximate performance, especially for large datasets. You can also select image sizes that are appropriate to your goals. For example, if working with a data intensive bundle, you could choose an m1.medium VM with 6 vCPUS, 16 GB RAM.
IDV Jetstream Plugin
The IDV Jetstream plugin allows easy access to Jetstream installations of the TDS, RAMADDA and ADDE from the IDV. The plugin URL is https://science-gateway.unidata.ucar.edu/jetstream.jar
. See here for how to install an IDV plugin from a URL.
Conference Presentations
Past Presentations
- ESIP Summer Meeting 2017 | July 25-28, 2017 – Bloomington, IN USA
- Gateways 2017 | October 23–25, 2017 – Ann Arbor, MI USA
- 2017 AGU Fall Meeting | December 11–15, 2017 – New Orleans, LA USA
- 2018 AMS Annual Meeting | January 7–11, 2018 – Austin, TX USA
- EGU General Assembly 2018 | April 8–13, 2018 - Vienna, Austria
- OGC TC/PC Meetings | June 4-8, 2018 - Fort Collins, Colorado, USA
- IWSG 2018 | June 13-15 2018 - Edinburgh, Scotland
- PEARC 18 | July 22-27, 2018 - Pittsburgh, PA USA
- ESIP Summer Meeting 2018 | July 17-20, 2018 – Tucson, AZ USA
- Gateways 2018 | September 25–27, 2018 – Austin, TX USA
- 2019 AMS Annual Meeting | January 6–10, 2019 – Phoenix, AZ USA
- ESIP Summer Meeting 2019 | July 16-19, 2019 – Tacoma, WA USA
- Gateways 2019 | September 23–25, 2019 – San Diego, CA USA
- 2020 AMS Annual Meeting | January 12–16, 2020 – Boston, MA USA
- Gateways 2020 | October 19–21, 2020 – Bethesda, MD USA
- 2021 AMS Annual Meeting | January 10–14, 2021 – Virtual
- 17th IEEE eScience 2021 | September 20-23, 2021 - Innsbruck, Austria
- American Geophysical Union Fall Meeting | December 12 -17, 2021 - New Orleans, LA USA
- American Meteorological Society | January 23-27, 2022 - Houston, TX USA
- Mini Gateways 2022 | April 5-7, 2022 - Online
- Gateways 2022 | October 18-20, 2022 - San Diego, CA USA
- Democratizing Access to Atmospheric Modeling with WRF employing NSF Cloud Computing Resources
- Unidata Science Gateway Reimagined: Unifying Access to Educational and Research Resources
- 2023 AMS Annual Meeting | January 8–12, 2023 – Denver, CO USA
- 103rd AMS Annual Meeting, 39th Conference on Environmental Information Processing Technologies
- In addition, we supported these workshops:
Forthcoming Presentations
TBA
{Source Code}
Contact
If you wish to contact Unidata concerning this science gateway, please contact support-gateway@unidata.ucar.edu
.
Acknowledging the Unidata Science Gateway
If you have benefited from the Unidata Science Gateway, please use this DOI for citations in your publications: doi:10.5065/688s-2w73.
Acknowledgments and Bibliography
Acknowledgments
National Science Foundation
Funding for this project was generously provided by the National Science Foundation (Grant NSF-1901712)
XSEDE ECSS
We thank Brian Beck, Maytal Dahan, Jeremy Fischer, Victor Hazlewood, Peg Lindenlaub, Suresh Marru, Lance Moxley, Marlon Pierce, Semir Sarajlic, Craig Alan Stewart, George Wm Turner, Nancy Wilkins-Diehr, Nicole Wolter and Andrea Zonca for their assistance with this effort, which was made possible through the XSEDE Extended Collaborative Support Service (ECSS) program.
Bibliography
References
[1] | Steve Ansari, Stephen Del Greco, Edward Kearns, Otis Brown, Scott Wilkins, Mohan Ramamurthy, Jeff Weber, Ryan May, Jed Sundwall, Jeff Layton, et al. Unlocking the potential of nexrad data through noaa’s big data partnership. Bulletin of the American Meteorological Society, 99(1):189--204, 2018. [ bib ] |
[2] | S. Arms and J Chastang. Student python workshop for the 101st ams annual meeting. In 101st AMS Annual Meeting, New Orleans, Louisiana, USA, Jan. 12-16 2021. [ bib | .html ] |
[3] | S. Arms, J. Chastang, M. Grover, J. Thielen, and M. Wilson. Student python workshop for the 100th ams annual meeting. In 100th AMS Annual Meeting, Boston, Massachusetts, USA, Jan. 12-16 2020. [ bib | .html ] |
[4] | S. Arms, J. Chastang, M. Grover, J. Thielen, M. Wilson, and D. Dirks. Introducing students to scientific python for atmospheric science. Bulletin of the American Meteorological Society, 101(9):E1492–E1496, 9 2020. [ bib | DOI | http ] |
[5] | D. Camron, N. Corbin, R. M. May, and J Chastang. Student python workshop for the 102nd ams annual meeting. In 102nd AMS Annual Meeting, Houston, Texas, USA, Jan. 23-27 2022. American Meteorological Society. [ bib | http ] |
[6] | J. Chastang. Unidata ldm docker container. https://github.com/Unidata/ldm-docker/, 2016. [ bib | http ] |
[7] | J. Chastang. Unidata science gateway. https://github.com/Unidata/science-gateway/, 2017. [ bib | DOI | http ] |
[8] | J. Chastang. Unidata science gateway jupyterhub. In ESIP Summer Meeting 2018, Tucson, AZ USA, 7 2018. Earth Science Information Partners. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[9] | J. Chastang. Deploying a Unidata JupyterHub on the NSF Jetstream cloud, lessons learned and challenges going forward. In ESIP Summer Meeting 2019, Tacoma, Washington, USA, 7 2019. Earth Science Information Partners. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[10] | J. Chastang. Jupyterhub for atmospheric science research and education on the NSF Jetstream cloud. In 99th AMS Annual Meeting, Phoenix, Arizona, USA, Jan. 6-10 2019. [ bib | DOI | http ] |
[11] | J. Chastang. A jupyterhub for atmospheric science research and education on the unidata science gateway. In Gateways 2019, San Diego, California, USA, Sep. 23-25 2019. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[12] | J. Chastang, N. Corbin, E. Davis, B. Espinoza, and T. Vance. Unidata Science Gateway Reimagined: Unifying Access to Educational and Research Resources. In Gateways 2022, San Diego, California, USA, Oct. 18-20 2022. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[13] | J. Chastang, D. J. Delene, W. J. Flynn, K. H. Goebbert, and J. T. Potemra. Assisting university earth science programs transition to online learning with computational notebooks. In 30th Conference on Education at the 101st AMS annual meeting, New Orleans, Louisiana, USA, Jan. 12-16 2021. [ bib | DOI | http ] |
[14] | J. Chastang and A. Espinoza. Advancing Atmospheric Science Education: Customized PyAOS JupyterHubs via the Unidata Science Gateway. In Proceedings, 40th Conference on Environmental Information Processing Technologies, 104th AMS Annual Meeting, Baltimore, Maryland, USA, 28 Jan.--1 Feb. 2024. American Meteorological Society. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[15] | J. Chastang, A. Espinoza, and M. Ramamurthy. Unidata Science Gateway: Past, Present, and Future Plans. In Proceedings, 39th Conference on Environmental Information Processing Technologies, 103rd AMS Annual Meeting, Denver, Colorado, USA, Jan. 8-12 2023. American Meteorological Society. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[16] |
J. Chastang, W. Fisher, and S. Arms.
Unicloud: Docker use at unidata.
In Proceedings, 32nd Conference on Environmental Information
Processing Technologies, 96th AMS Annual Meeting, New Orleans, LA, 1 2016.
American Meteorological Society.
See also http://unidata.github.io/Unidata-Dockerfiles/index.html.
[ bib |
.html ]
Keywords: UPC |
[17] | J. Chastang and K. Maull. Unidata partners with ucar soars program to help protégés and their mentors with atmospheric science internships. In Proceedings, Third Symposium on Diversity, Equity, and Inclusion, 102nd AMS Annual Meeting, Houston, Texas, USA, Jan. 23-27 2022. American Meteorological Society. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[18] | J. Chastang and M. K. Ramamurthy. Unidata science gateway on the XSEDE Jetstream cloud. In Gateways 2017, Ann Arbor, Michigan, USA, Oct. 25-25 2017. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[19] | J. Chastang and M. K. Ramamurthy. A cloud-based science gateway for the geoscience community. In OGC TC/PC Meetings, Fort Collins, Colorado, USA, Jun. 4-8 2018. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[20] | J. Chastang and R. Signell. Met/ocean modeling workflows on XSEDE via HPC & cloud. In ESIP Summer Meeting 2017, Bloomington, IN USA, 7 2017. Earth Science Information Partners. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[21] | J. Chastang, R. Signell, and J. L. Fischer. Reducing time to science: Unidata and JupyterHub technology using the Jetstream cloud. In 2017 AGU Fall Meeting, New Orleans, Louisiana, USA, Dec. 11-15 2017. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[22] | J. Chastang, R. Signell, and J. L. Fischer. A Unidata JupyterHub server: An online PyAOS resource for students and educators. In 98th AMS Annual Meeting, Austin, Texas, USA, Jan. 22-26 2018. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[23] | J. Chastang, T. Yoksas, and M. K. Ramamurthy. Geoscientific data distribution in the XSEDE Jetstream cloud. In Proceedings, 33nd Conference on Environmental Information Processing Technologies, 97th AMS Annual Meeting, Seattle, WA USA, 1 2017. American Meteorological Society. See also https://science-gateway.unidata.ucar.edu. [ bib | .html ] |
[24] | Julien Chastang. Demonstration of unidata science gateway, 4 2020. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[25] | Douglas Dirks. Notre dame of maryland university test drives unidata science gateway jupyterhub, Feb 2020. [ bib | http ] |
[26] | Douglas Dirks. Ucar mentorship and remote computing resources boost remote research for soars student, Oct 2020. [ bib | http ] |
[27] | Douglas Dirks. Unidata science gateway jupyterhubs are helping u.s. naval academy faculty learn python, Feb 2020. [ bib | http ] |
[28] | A. Espinoza, J. Chastang, and W. G. Blumberg. Deploying an Educational JupyterHub for Exploratory Data Analysis, Visualization, and Running Idealized Weather Models on the Jetstream2 Cloud. In Gateways 2023, Pittsburgh, PA, USA, 30 Oct.--1 Nov. 2023. [ bib | DOI | http ] |
[29] | B. Espinoza, J. Chastang, J. Weber, D. Dye, and P. Romine. Democratizing Access to Atmospheric Modeling with WRF employing NSF Cloud Computing Resources. In Gateways 2022, San Diego, California, USA, Oct. 18-20 2022. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[30] | David Y Hancock, Jeremy Fischer, John Michael Lowe, Winona Snapp-Childs, Marlon Pierce, Suresh Marru, J Eric Coulter, Matthew Vaughn, Brian Beck, Nirav Merchant, et al. Jetstream2: Accelerating cloud computing via jetstream. In Practice and Experience in Advanced Research Computing, pages 1--8. 2021. [ bib ] |
[31] | Thomas Kluyver, Benjamin Ragan-Kelley, Fernando Pérez, Brian Granger, Matthias Bussonnier, Jonathan Frederic, Kyle Kelley, Jessica Hamrick, Jason Grout, Sylvain Corlay, Paul Ivanov, Damián Avila, Safia Abdalla, and Carol Willing. Jupyter notebooks -- a publishing format for reproducible computational workflows. In F. Loizides and B. Schmidt, editors, Positioning and Power in Academic Publishing: Players, Agents and Agendas, pages 87--90. IOS Press, 2016. [ bib ] |
[32] | T. C. Meyer and S. Carter. Unidata awips update. In Proceedings, 101st AMS Annual Meeting, New Orleans, Louisiana, USA, Jan. 12-16 2021. [ bib | http ] |
[33] | T. C. Meyer, S. Carter, and N. Corbin. Unidata awips update. In Proceedings, 102nd AMS Annual Meeting, Houston, Texas, USA, Jan. 23-27 2022. American Meteorological Society. [ bib | http ] |
[34] | T. C. Meyer, S. Carter, and N. Corbin. Unidata AWIPS Hosted in the Cloud . In Proceedings, 39th Conference on Environmental Information Processing Technologies, 103rd AMS Annual Meeting, Denver, Colorado, USA, Jan. 8-12 2023. American Meteorological Society. [ bib | http ] |
[35] | Jeffrey Perkel. Why jupyter is data scientists' computational notebook of choice. Nature, 563:145--146, 11 2018. [ bib | DOI ] |
[36] | M. Ramamurthy and J. Chastang. The use of the Unidata Science Gateway as a cyberinfrastructure resource to facilitate education and research during COVID-19. In EGU General Assembly 2022, Vienna, Austria, May 23-27 2022. See also https://science-gateway.unidata.ucar.edu. [ bib | .html ] |
[37] | M. Ramamurthy, J. Chastang, and A. Espinoza. Unidata Science Gateway: A research infrastructure to advance research and education in the Earth System Sciences. In 15th International Workshop on Science Gateways, Tübingen, Germany, Jun. 13-15 2023. See also https://science-gateway.unidata.ucar.edu. [ bib ] |
[38] | M. Ramamurthy, J. Chastang, and A. Espinoza. Unidata Science Gateway: A research infrastructure to advance research and education in the Earth System Sciences. In EGU General Assembly 2023, Vienna, Austria, Apr. 23-28 2023. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[39] | M. K. Ramamurthy. Unidata 2018: Transforming geoscience through innovative data services. Technical report, Unidata Program Center, UCAR Community Programs, University Corporation for Atmospheric Research, 3300 Mitchell Ln, Boulder, CO 80301 USA, 10 2013. [ bib | .pdf ] |
[40] | M. K. Ramamurthy. A cloud-based science gateway for the geoscience community. In ESIP Summer Meeting 2018, Tucson, AZ USA, 7 2018. Earth Science Information Partners. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[41] | M. K. Ramamurthy. Unidata: Next-generation data services and workflows to advance geoscience research and education. Technical report, Unidata Program Center, UCAR Community Programs, University Corporation for Atmospheric Research, 3300 Mitchell Ln, Boulder, CO 80301 USA, 4 2019. [ bib | .pdf ] |
[42] | M. K. Ramamurthy and J. Chastang. A cloud-based science gateway for the geoscience community with end-to-end workflows on the Jetstream cloud system. In 2018 EGU Spring Meeting, Vienna, Austria, Apr. 8-13 2018. See also https://science-gateway.unidata.ucar.edu. [ bib ] |
[43] | M. K. Ramamurthy and J. Chastang. A cloud-based science gateway for the geoscience community with end-to-end workflows on the Jetstream cloud system. In IWSG 2018 - 10th International Workshop on Science Gateways, Edinburgh, Scotland, Jun. 13-15 2018. See also https://science-gateway.unidata.ucar.edu. [ bib ] |
[44] | M. K. Ramamurthy and J. Chastang. Unidata: A cloud-based science gateway for the atmospheric sciences. In Gateways 2018, Austin, Texas, USA, Sept. 25-27 2018. See also https://science-gateway.unidata.ucar.edu. [ bib ] |
[45] | M. K. Ramamurthy and J. Chastang. A cloud-based science gateway for enabling open and reproducible science. In 99th AMS Annual Meeting, Phoenix, Arizona, USA, Jan. 6-10 2019. [ bib | http ] |
[46] | M. K. Ramamurthy and J. Chastang. The use of the unidata science gateway as a resource for facilitating education and research during covid. In 2021 AGU Fall Meeting, New Orleans, Louisiana, USA, Dec. 13-17 2021. See also https://science-gateway.unidata.ucar.edu. [ bib ] |
[47] | M. K. Ramamurthy and J. Chastang. The use of the unidata science gateway as a resource for facilitating education and research during covid-19. In 17th IEEE eScience 2021, Innsbruck, Austria, Sept. 20-23 2021. [ bib | DOI | http ] |
[48] | M. K. Ramamurthy, J. Chastang, R. M. May, and M. James. Unidata and data-proximate analysis and visualization in the cloud. In ESIP Summer Meeting 2017, Bloomington, Indiana, USA, 7 2017. Earth Science Information Partners. See also https://science-gateway.unidata.ucar.edu. [ bib | DOI | http ] |
[49] |
S. Sarajlic, J. Chastang, S. Marru, J. Fischer, and M. Lowe.
Scaling jupyterhub using kubernetes on jetstream cloud: Platform as a
service for research and educational initiatives in the atmospheric sciences.
In Proceedings of the Practice and Experience on Advanced
Research Computing, PEARC ’18, New York, NY, USA, 2018. Association for
Computing Machinery.
Recipient of Best Poster Award.
[ bib |
DOI |
http ]
Keywords: OpenStack, JupyterHub, Kubernetes, Cloud Computing, Workforce Development, Unidata, Magnum |
[50] |
Craig A. Stewart, Timothy M. Cockerill, Ian Foster, David Hancock, Nirav
Merchant, Edwin Skidmore, Daniel Stanzione, James Taylor, Steven Tuecke,
George Turner, Matthew Vaughn, and Niall I. Gaffney.
Jetstream: A self-provisioned, scalable science and engineering cloud
environment.
In Proceedings of the 2015 XSEDE Conference: Scientific
Advancements Enabled by Enhanced Cyberinfrastructure, XSEDE '15, pages
29:1--29:8, New York, New York, USA, 2015. ACM.
[ bib |
DOI |
http ]
Keywords: atmosphere, big data, cloud computing, long tail of science |
[51] | John Towns, Timothy Cockerill, Maytal Dahan, Ian Foster, Kelly Gaither, Andrew Grimshaw, Victor Hazlewood, Scott Lathrop, Dave Lifka, Gregory D. Peterson, Ralph Roskies, J. Ray Scott, and Nancy Wilkins-Diehr. XSEDE: Accelerating scientific discovery. Computing in Science & Engineering, 16(5):62--74, 2014. [ bib | DOI ] |
[52] | J. Weber, D. Dye, and P. Romine. A Network System for Environmental Monitoring, Data Sovereignty and Data Governance on Tribal Lands. In 39th Conference on Environmental Information Processing Technologies, 103rd AMS Annual Meeting, Denver, Colorado, USA, Jan. 8-12 2023. American Meteorological Society. [ bib | http ] |
[53] | K. Wilcox and J. Chastang. Unidata thredds docker container. https://github.com/Unidata/thredds-docker/, 2015. [ bib | http ] |
[54] |
Nancy Wilkins-Diehr, Sergiu Sanielevici, Jay Alameda, John Cazes, Lonnie
Crosby, Marlon Pierce, and Ralph Roskies.
An overview of the XSEDE extended collaborative support
program, volume 595 of Communications in Computer and Information
Science, pages 3--13.
Springer Verlag, Germany, 2016.
[ bib |
DOI ]
The Extreme Science and Engineering Discovery Environment (XSEDE) is a flagship cyberinfrastructure project funded by the US National Science Foundation (NSF). XSEDE’s Extended Collaborative Support Services (ECSS) program is a significant component of the XSEDE effort, dedicated to extended engagements with our user community which transform their research. We describe the organization, operation and some highlights of the program in this submission. |
[55] | Tyler Wixtrom. Vertical coordinate interpolation. Technical report, Unidata Program Center, UCAR Community Programs, University Corporation for Atmospheric Research, 3300 Mitchell Ln, Boulder, CO 80301 USA, 8 2017. [ bib | .pdf ] |
[56] | A. Zonca. Deploy jupyterhub on top of kubernetes on jetstream, 2017. [ bib | http ] |
[57] | A. Zonca. Jetstream kubespray: Deploy a production ready kubernetes cluster, 2018. [ bib | http ] |
[58] | A. Zonca and J. Chastang. Distributed computing on the cloud for science gateways with dask. In Mini Gateways 2022, Online, Apr. 5-7 2022. See also https://youtu.be/6S1_T3se828. [ bib | DOI | http ] |
[59] |
A. Zonca, R. P. Signell, J. Chastang, J. Fischer, J. M. Lowe, and R. S.
Sinkovits.
Deploy kubernetes and jupyterhub on xsede jetstream.
In Gateways 2020 Proceedings, Oct. 19-23 2020.
See also https://science-gateway.unidata.ucar.edu.
[ bib |
DOI |
http ]
Keywords: OpenStack, JupyterHub, Kubernetes, Cloud Computing, Unidata, Magnum |