About the IOOS Data Management and Cyberinfrastructure Subsystem
A coherent strategy that enables the integration of marine data streams across disciplines, institutions, time scales, and geographic regions is central to the success of IOOS and other regional, national, and international ocean and coastal observing systems. The system that must be developed, while challenging, is within the scope of current information technology (IT). It can be developed by building upon existing capabilities through relatively straightforward software engineering. The greatest challenge to enhancing marine data integration is one of coordination and cooperation among the members of IOOS and its user communities.
The IOOS Program Office coordinates the infrastructure to enable the integration of marine data streams.
One of the primary goals of the Data Management and Cyberinfrastructure (DMAC) Subsystem is making discovery, access, and understanding ocean, coastal, and Great Lakes information for the public. To help IOOS researchers and partners make their data available online, the DMAC system enables the integration of marine data streams across disciplines, institutions, time scales, and geographic regions. Accessing IOOS data is possible through a suite of national and regional Data Portal and Viewers. The success of data integration with this distributed system is only possible through the use of common standards, formats, and data services. The U.S. IOOS Program Office maintains information on how to contribute data to IOOS and updates those steps and policies as new standards and technologies emerge.
Annual DMAC Meetings
The IOOS Data Management and Cyberinfrastructure (DMAC) meeting is a backdrop for coordination and communication between managers of ocean, coastal, Great Lakes data and information. Attendees represent IOOS Regional Associations, federal agencies, academia and the private sector. The meeting themes span issues that support IOOS’ data management framework for searching, discovering, accessing, and using information.
2024 Meeting
Background
Presentations
- Coming soon!
2023 Meeting
Background
Presentations
- Introduction/Meeting Kickoff (Micah Wengren/IOOS, Mathew Biddle/IOOS)
- U.S. IOOS Office Updates (Becky Baltes/IOOS)
- CIOOS Updates (Ray Brunsting/CIOOS)
- OTN, ATN, Nodes, and OBIS (Jon Pye/OTN, Angela Dini/OTN)
- SoundCoop - Passive Acoustic Monitoring Access Network (Carrie Wall/NCEI)
- Data Management Workflow and Challenges in Developing a California Ocean Acidification and Hypoxia Data Portal (Marine Lebrec/CeNCOOS)
- Standardizing Marine Biological Data: Working Group update (Tim van der Stap/Hakai Institute)
- ATN data pipeline updates - GTS/OceanOPS and NCEI (satellite telemetry sharing) (Megan McKinzie/ATN)
- Application of Cloud-Native Solutions to challenging datasets (Kelly Knee/Audra Luscher)
- DOIs and other Digital Persistent Identifiers (Sarah O'Connor/NCEI, Tom Boyer/NCEI)
- NCOS Coastal Reports and Ocean Finder: Real Time Geoanalytics of IOOS Data Streams in Support of Marine Spatial Planning (Rob Bochenek/Axiom)
- Extending Data Services Beyond the US EEZ: GCOOS Experience (Felimon Gayanilo/Texas A&M, Sandeep Jilla/Texas A&M, Tuomo Saari/Texas A&M)
- NERACOOS Infrastructure Update (Alex Kerney/NERACOOS, Dylan Pugh/NERACOOS)
- GLOS Updates: Seagull Update/Overview + Technical Overview (Joe Smith/GLOS)
- HF Radar Range Series Archival Project Status Update (Shane St. Savage/RPS)
- Serving QC solutions: New approaches (Eugene Burger/PMEL)
- Water Level QC AI (Lindsay Abrams/CO-OPS, James Spore/IOOS, Hassan Moustahfid/IOOS)
- IOOS/NOAA Cloud Sandbox Update (Patrick Tripp/RPS, Tiffany C. Vance/IOOS)
- IOOS Sensor Map ERDDAP Integration Status Update (Shane St. Savage/Axiom)
- Stress in the Geosciences (Alex Kerney/NERACOOS)
- Modeling Breakout: Tools for Observational Data Access/Subsetting/Aggregation, QA/QC, Visualization, Validation
- Modeling Breakout: searvey
- Modeling Breakout: ERDDAPY
- Modeling Breakout: Subsetting
- Modeling Breakout: Skill Assessment
2022 Meeting
Background
Presentations
- Introduction/Meeting Kickoff (Matt Biddle/IOOS)
- U.S. IOOS Office Updates (Carl Gouldman/IOOS)
- IOOS Operations Division Updates (Derrick Snowden/IOOS)
- New Blue Economy (Schuyler Nardelli/IOOS)
- IOOS Code Sprint Recap and GSoC Updates (Filipe Fernandes/SECOORA, Matt Biddle/IOOS)
- CIOOS update (Ray Brunsting/CIOOS)
- ESIP Biological Data Standards Cluster (Abby Benson/USGS)
- Marine Data Cluster (Matt Biddle/IOOS)
- New ERDDAP Features in v2.15 to 2.19 (Bob Simons/SWFSC)
- MBON DMAC updates on eDNA (Kathleen Pitz/MBARI)
- AI Ready Data Standards and Best Practices (Stacie Robinson/NMFS, Douglas Rao/NCEI)
- CO-OPS Model Data Visualization and Validation (James Doyle/RPS, Matt Iannucci/RPS)
- DMAC Topic 2 - Reach for the Clouds (Kelly Knee/RPS)
- Passive Acoustic Monitoring Access Network (Carrie Wall Bell/NCEI)
- Connection between community DACs and NCEI products (Matt Grossi/NCEI)
- QARTOD - 5 year plan (Mark Bushnell/IOOS)
- Using QARTOD for moving platforms (Joshua Osborne/PMEL)
- Cloud Sandbox Update (Patrick Tripp/RPS)
2021 Meeting
Background
Presentations
- Introduction/Meeting Kickoff (Micah Wengren/IOOS)
- US IOOS Office Updates (Krisa Arzayus/IOOS)
- IOOS Operations Division Updates (Derrick Snowden/IOOS)
- IOOS Google Summer of Code 2021 (Filipe Fernandes/SECOORA, Micah Wengren/IOOS)
- IOOS Cloud Sandbox - v2 Infrastructure as Code Using Terraform; Integration of Access via JupyterHub (Patrick Tripp/RPS)
- SanctSound: Acoustic Observing Systems & Data Portal (Brian Stone/Axiom, Carrie Wall Bell/NCEI)
- Sanctuaries and IEA infographics partnership (Jennifer Brown)
NMFS/DISMAP (Melissa Karp) - Pa’ la Playa Beach App (Sylvia Rodríguez-Abudo)
- ESIP Marine Data Cluster & Biological Data Cluster (Chris Olson/R2R, Abby Benson/USGS)
- CIOOS Update (Mike Smit/CIOOS)
- WMO/netCDF/WIS 2.0 (Kevin O’Brien/PMEL)
- ATN DAC: Quality Controlled Animal Bourne Ocean Profiles on the GTS (Kyle Wilcox/Axiom)
- GliderDAC update/QC Thresholds (John Kerfoot/Rutgers)
- Proper QC of ADCP Data: The GulfHub Experience (Bruce Magnell/WHG)
- Advancing Marine Life Data Management: CIOOS (Jon Pye)
- PAM Cyberinfrastructure/SanctSound Portal (Carrie Wall)
- BioTrack/ATN DAC (Megan McKinzie)
- Faster Visualizations of Gridded Data (Luke Cambpbell/Axiom)
- Processing and presentation of World Ocean Database (Greg Williams/RPS)
- ERDDAP New Features in Action (Kevin O’Brien/PMEL, Bob Simons/NMFS)
- IOOS ERDDAP Implementation: GTS and Sensor Map Transition (Micah Wengren/IOOS, Shane St. Savage/Axiom)
- BSEE/NTL Data Services Transitioned to GCOOS from NDBC: Updates (Felimon Gayanilo/GCOOS)
- Saildrone Data Handling (Eugene Burger/PMEL)
- National Water Model Data Access API (Dalton Kell/RPS)
- WebCOOS: Best Management Practices for Video Data (Kyle Wilcox/Axiom)
Past Meetings
2020 Meeting
Background
Presentations
- Introduction/Meeting Kickoff (Micah Wengren)
- IOOS Ops Div Updates (Derrick Snowden)
- CIOOS Updates (Mike Smit, Ray Brunsting)
- QARTOD Implementation and `ioos_qc` Improvements (Kyle Wilcox)
- NOAA AI Strategy, NOS AI/ML WG (Greg Dusek, Hassan Moustahfid)
- DMAC Data Services Evolution: Past, Present & Future (Micah Wengren, Kyle Wilcox)
- IOOS ERDDAP Deployment Update (Kathy Bailey)
- ERDDAP 2.10 Update (Bob Simons)
- Dashboards and Monitoring (RPS/Axiom)
- ERDDAP Dataset monitoring and alerts using Prometheus and Grafana (Jess Austin)
- DMAC monitoring dashboards using InfluxDB and Grafana (Bob Fratantonio)
- Evolution of the IOOS Glider DAC and Potential Applications for other DMAC Realms (John Kerfoot, Bob Fratantonio)
- GCOOS Data Visualization for Gliders and MBON (Bob Currier)
- Cloud Stuff - Modeling Sandbox and NOAA BDP Datasets from the RAs? (Tiffany Vance)
- Cloud Sensor Data Ingest Project (Micah Wengren, Bob Fratantonio, Bob Fleming)
- NCEI Archive Update (Julie Bosch, Matt Biddle)
- Applying IOOS Data Management Techniques to OOI Data (Jessica Austin)
- Exploring the CKAN API for creating dynamic IOOS workflows (Rich Signell)
- NWM Data Access (Dalton Kell)
2019
Background
Presentations
- Introduction/Meeting Kickoff (Micah Wengren)
- IOOS Welcome and Program Office Updates (Krisa Arzayus, IOOS Deputy Director)
- Glider DAC (Ben LaCour)
- ATN DAC (Bill Woodward)
- MBON/Bio Data (Gabrielle Canonico)
- IOOS Catalog/Sensor Map/EDS (Micah Wengren/Tiffany Vance/Kathy Bailey/Bob Fratantonio)
- Compliance Checker (Bob Fratantonio)
- COMT/OTT Projects (Tiffany Vance)
- IOOS Unified Approach to Biology: Role for DMAC (Bill Woodward, Gabrielle Canonico)
- NDBC Update (Dawn Petraitis)
- IOOS ERDDAP Project Status
- Open Access to GTS Project (Kevin O’Brien)
- Discussion on IOOS ERDDAP Configuration/User Requirements
- ERDDAP 2.0 Capabilities (Bob Simons)
- Ontology Registry and Repository/IOOS Controlled Vocabularies (Felimon Gayanilo)
- Open Discussions Session #1
- GLOS Cloud Implementation and DMAC Plans (Tim Kearns, Sneha Bhadbhade)
- IOOS and the Cloud - Opportunities and Challenges (Brian McKenna)
- CIOOS Update (Ray Brunsting, Brad Covey)
- Open Discussions Session #2
- GCOOS’ Growing Involvement with the Oil and Gas Industry (Felimon Gayanilo)
- Bio/Physical Data Analysis - a Probabilistic Approach (Steve Lockhart)
- CeNCOOS Project - AI/IFCB (Patrick Daniel)
- The State of IOOS Python Tools (Filipe Fernandes)
- NOAA Modeling Program (Derrick Snowden/Brian McKenna)
- THREDDS/UGRID Implementation (Kyle Wilcox)
- Open Discussions Session #3
- 2019 DMAC Code Sprint Goals and Planning
- ESIP - Marine Data Cluster, Data for Black Lives (Steve Diggs)
- DOIs and IOOS (Steve Lockhart)
- QARTOD Implementation Discussion (Kyle Wilcox)
- SECOORA Project - Hurricane Tracking Tool (Kyle Wilcox)
- Update on Ocean Best Practice System/QARTOD OBP demonstration (Mark Bushnell)
- OOI update - IOOS Data Portals (Jim Potemra)
- From Data to SMS - A Sneak Peak at the GLOS OTT HAB Rapid Prototype (Tim Kearns)
- AOOS Project - Arctic Oil Spill Risk Assessment and Other Tools (Jessica Austin)
- Closeout/Open Discussion
2018
Background
Presentations
- Opening Presentation (Carl Gouldman, IOOS Director)
- Program Office Priorities Relative to DMAC (Derrick Snowden)
- DMAC Overview/Outcomes of RA DMAC Webinars (Micah Wengren)
- Certification Audits (Kathleen Bailey)
- Compliance Checker scoring update (Jennifer Bosch)
- MBON and Biological Data Management (Gabrielle Canonico/Jennifer Bosch)
- ATN Update (Bill Woodward/Rob Bochenek, Axiom)
- Presentation (Bill Woodward)
- Presentation (Rob Bochenek)
- RA Data Manager Coordinated Session - Introduction (Tad Slawecki)
RA Data Manager Coordinated Session - Analytics (Patrick Daniel) - Discussion - QARTOD (Mark Bushnell)
- Matt Howard Tribute (Felimon Gayanilo)
- AWIPS (Ronla Henry, NWS/AWIPS Program Manager)
- NDBC Presentation (Dawn Petraitis, NWS/NDBC)
- Coastal and Global Observations/JCOMM (Derrick Snowden/Kevin O’Brien, OAR/PMEL)
- Argo/GO-SHIP/OceanSITES: Sharing technical best practices across the entrenched programmatic blood-brain barriers (Steve Diggs, UCSD)
- THREDDS Update (Ethan Davis, UCAR/Unidata)
- IOOS PO ERDDAP Project (Micah Wengren)
- IOOS PO ERDDAP Attribution (Kathleen Bailey)
- Open Access to GTS Discussion/Next Steps (Kevin O’Brien)
- Jupyter Notebooks (Rich Signell, USGS)
- OTN and CIOOS updates (Jonathan Pye, OTN)
- SECOORA/WebCAT Project: Web Camera Testbed (Tiffany Vance/Kyle Wilcox, Axiom)
- Data Upload Tool (Bob Fratantonio, RPS/ASA)
- Hands On Workshop with Sensor Map and MBON Portal (Axiom)
2017
Background
Presentations
- Attribution to sources in Regional and National Products (Kathy Bailey, IOOS)
- ERDDAP overview, new feature review, archiving features in collaboration with NCEI (Bob Simons):
- OpenGTS project overview, ERDDAP capabilities, discussion (Kevin O’Brien)
- ATN/OTN (Bill Woodward, IOOS; Brad Covey/Jon Pye, OTN)
- Cloud Modelling Environment (Brian McKenna, ASA)
- IOOS Catalog Update (Luke Campbell, ASA)
- RA/DMAC Session: Lightning updates: successes/challenges in DMAC:
- Archiving Update/NCEI (Matt Biddle, NCEI)
- Axiom Big Data Analysis/AIS (Rob Bochenek, Axiom)
- Improving delivery and use of DMAC services:
- Docker/Conda improvements for service delivery (Kyle Wilcox, Axiom)
- Jupyter Notebooks and Web Client demos using DMAC services (Rich Signell, USGS)
- IOOS PO News/Wrap Up/Discussion (Micah Wengren, IOOS)
2016
Background
Presentations
- Opening Remarks
- IOOS Update
- IOOS Data Management Path Forward
- IOOS Catalog
- QARTOD in Practice
- Compliance Checker
- IOOS URNs
- IOOS Regional Archiving:
- IOOS Catalog and Service Requirements
- Water Quality Portal
- NOAA's OneStop Data Discovery and Access Project
- IOOS Environmental Data Server Model Viewer
- IOOS Environmental Sensor Map
- Marine Biodiversity Observation Network:
- IODE-OBIS-ENV-DATA Project
- Ocean Tracking Network/Animal Telemetry Network:
2015
Background
Presentations
- IOOS Program Update
- Data Management for Animal Tracking Activities
- Marine Biodiversity Observation Network and Biological Data Enrollment Procedures:
- National Glider DAC
- Observing System Monitoring Center
- United Access Framework Catalog Cleaner
- Exploiting IOOS: A Distributed, Standards-Based Framework and
Open-Source Software Stack for Searching, Accessing, Analyzing
and Visualizing Met-Ocean Data:
- Framework for Analyzing and Visualizing Met-Ocean Data
- sci-wms
- QARTOD in Practice
- IOOS Archive Project Update
- EPA Continuous Monitor Data Strategy
2013
Background
Presentations
- DMAC Meeting Introduction
- IOOS Data Services with the THREDDS Data Server
- DMAC Integration Test
- Animal Telemetry Data Assembly Center
- Data Storage and Archiving Submission Process
- IOOS National Glider Data Assembly Center
- Geospatial Data Policies and Activities within NOS and NOAA
- IOOS Common Product Introduction
Standards & Requirements
Visit our Standards & Requirements page to learn more about the core capacity requirements for IOOS Regional Associations and other IOOS grant recipients who are contributing data to IOOS.