1
Web ServicesUSGS/EPACollaborationFebruary 21, 2008Dwane Young, U.S. EPA; Jon Scott, USGS; Dorinda Gellenbeck, USGS;Nate Booth, USGSWeb ServicesUSGS/EPACollaborationFebruary 21, 2008Dwane Young, U.S. EPA; Jon Scott, USGS; Dorinda Gellenbeck, USGS;Nate Booth, USGS
2
USGS NWIS* & STORET Over TimeUSGS NWIS* & STORET Over Time
1999:
Modern
STORET
2003:
USGS / EPA
Agreement
2007:
Water-
Quality
Data
Exchange
1960s:
NWPCA
(WATSTORE)
NWIS*
Legacy
STORET
Data copied
from NWIS
to STORET
1972
EPA created
* USGS National Water Information System
3
OverviewOverview
Working together to develop a commonsuite of web servicesWorking together to develop a commonsuite of web services
Focus: sharing of water monitoring datavia a common format and commonterminologyFocus: sharing of water monitoring datavia a common format and commonterminology
USEPA initial web services are nowavailableUSEPA initial web services are nowavailable
USGS web services are in final testing forinitial servicesUSGS web services are in final testing forinitial services
4
RelevanceRelevance
Efficiency - more with lessEfficiency - more with less
New capabilitiesNew capabilities
Data miningData mining
Reporting to other systemsReporting to other systems
Support monitoring networksSupport monitoring networks
Shared applicationsShared applications
OMB mandateOMB mandate
Now... momentum towards a community ofwater-quality informationNow... momentum towards a community ofwater-quality information
5
Why Now?Why Now?
Business:Business:
Water-quality data standards (NWQMC)Water-quality data standards (NWQMC)
Move towards monitoring network partnershipsMove towards monitoring network partnerships
Technical:Technical:
Industry move towards data and processsharingIndustry move towards data and processsharing
Technology standardsTechnology standards
6
What is a Web Service?What is a Web Service?
USGS
EPA
Internet(XML)
•Computer-to-computer
•Uses Input parameters and outputsXML
•Can be used in multiple ways by manyapplications
7
A common web serviceexampleA common web serviceexample
Input Parameter: Zip Code
Weather Network
Returns XML
Weatherbug translates XML intoinformation for the task bar
Weatherbug is an example thatmany are familiar with
This is all done via a WebService
8
An example using Monitoring DataAn example using Monitoring Data
9
XML Google Earth (KML)XML Google Earth (KML)
10
So What?So What?
Web Services allow for more accessibilityto the data.Web Services allow for more accessibilityto the data.
No longer limited to EPA or USGSinterfaces for interacting with the data.No longer limited to EPA or USGSinterfaces for interacting with the data.
Web Services makes a STORET/NWIScollaboration possible.Web Services makes a STORET/NWIScollaboration possible.
11
So What? (cont’d)So What? (cont’d)
Web services can:Web services can:
potentially serve as feeds for other statereporting or analysis databasespotentially serve as feeds for other statereporting or analysis databases
provide a commonly formatted dataset fordata analysis and modelingprovide a commonly formatted dataset fordata analysis and modeling
serve as the backbone for project dataapplications (mashups)serve as the backbone for project dataapplications (mashups)
12
Water-Quality Web ServicesInitial TasksWater-Quality Web ServicesInitial Tasks
Design a common data format based on USEPAWQXDesign a common data format based on USEPAWQX
Map Parameter Codes to EPA’s SubstanceRegistry SystemMap Parameter Codes to EPA’s SubstanceRegistry System
Translate other data elements:Translate other data elements:
Site Type, Media and Chemical GroupsSite Type, Media and Chemical Groups
Develop common services for serving Sites,Samples and ResultsDevelop common services for serving Sites,Samples and Results
13
DataTranslationDataTranslation
PCODE
SRS Name
Units
Fraction
Temperature
Basis
Statistical Basis
Time Basis
Weight Basis
Particle Size
Substance Registry System
14
What Web Services are planned?What Web Services are planned?
Four core services are being developed:Four core services are being developed:
Stations service – provides specific stationinformationStations service – provides specific stationinformation
Results service – provides results for modeling,analysis, and decision makingResults service – provides results for modeling,analysis, and decision making
Watershed/Station Catalog service –provides summary information on what data areavailableWatershed/Station Catalog service –provides summary information on what data areavailable
Project Catalog service – provides summaryinformation by projects based on an input of min/maxlatitude/longitudeProject Catalog service – provides summaryinformation by projects based on an input of min/maxlatitude/longitude
15
What’s NextWhat’s Next
Testing of services with both USEPA and USGSactiveTesting of services with both USEPA and USGSactive
Expect to release this yearExpect to release this year
A common portal for interacting with theseservicesA common portal for interacting with theseservices
Additional design for sediment and groundwaterAdditional design for sediment and groundwater
Inventory (Data Discovery) and summaryservices by:Inventory (Data Discovery) and summaryservices by:
Site, Geographic Area, Watershed, ProjectSite, Geographic Area, Watershed, Project
16
FutureFuture
Dealing with duplicated dataDealing with duplicated data
Common spatial framework: NHDPlusCommon spatial framework: NHDPlus
Web services support: software libraries andformat translatorsWeb services support: software libraries andformat translators
Portal and analytical applicationsPortal and analytical applications
17
Other OpportunitiesOther Opportunities
Expanding the net:Expanding the net:
These methodologies could grow beyond thecurrent collaboration, and potentially include:These methodologies could grow beyond thecurrent collaboration, and potentially include:
•Sharing data with other countries (Canada,Mexico)•Sharing data with other countries (Canada,Mexico)
•National Science Foundation•National Science Foundation
•Other EPA offices running monitoring operations(Great Lakes, Chesapeake Bay)•Other EPA offices running monitoring operations(Great Lakes, Chesapeake Bay)
•Other Federal Agencies•Other Federal Agencies
18
Q&AQ&A