WQX Web and OISC FIFRA Data,and follow-on work in 2015
Larry Theller, ABE, Purdue University
April 16, 2015
NEIEN Grant Progress
•A) OISC FIFRA data upload project (done)
–Establish Node
–Train OISC Staff
–Transfer IT Knowledge
•B) Load Duration Curve model upgrade (inprogress)
–Improve LDC interface to WQX
–Mine WQX for calibration data for online model
Federal Insecticide, Fungicide, andRodenticide Act (FIFRA)
•EPA is specifically authorized to: (1) strengthenthe registration process by shifting the burden ofproof to the chemical manufacturer, (2) enforcecompliance against banned and unregisteredproducts, and (3) promulgate the regulatoryframework missing from the original law.
•FIFRA provides EPA with the authority to overseethe sale and use of pesticides. However, becauseFIFRA does not fully preempt state/tribal or locallaw, each state/tribe and local government mayalso regulate pesticide use.
OISC
•The Office of the Indiana State Chemist (OISC)is charged with administering severalagricultural laws involving animal feeds,fertilizers, pesticides and seeds.
•The goals of these laws are to ensure truth-in-labeling, food safety, user safety and theprotection of our environment.
Win2003Server
Purdue-OISC WQX NODE Network Design
RedHatServer
MySQL
8-Core
Red Hat Server
UbuntuDevServer
MySQL
MySQL
Oracle
AuthenticatedQUERY to CDX
Development(Test) computer
Main DevelopmentServer
Interim Production Server
Rollover to:
Permanent Production Server
abeip867
abe2k3s2
Templeton.ecn
Data Loader Test
Query Test
Backup ofProd.database
Proposed, Tested, but NotImplemented
Current WQX Web Design
Staging
CDX
Authenticatedupload tostagingdatabase
Spreadsheet of results
Excel
QC doneandReformat toXML
OISC
AuthenticatedXML upload toCDX
1
2
The pink colored tab is usedto export data for upload;
The yellow tabs to set-upthe input data;
The green tabs provide alinked reference fordocumented elements inWQX.
In this typical spreadsheet layout, the measurements are incolumns, and each set of samples from a location is a row.
The columns need to pivot so each measurement becomesone row, and the data collection notes need to be replicatedfor each measurement.
The EPA template has dictionaries of data elements. For example thereare 3046 analytical methods in this table, with Method ID, Name andContext (Agency)
The biggest issue for OISC was that analytical methods for quantitativeanalysis of unregistered and new pesticides (e.g. nicotininoids) are notincluded in the template, and must be created by hand.
Success loading data sets
Grant 2: Tools to consume data
•Load and Flow Duration Curve (LDC)
–Auto Upload of flow data from USGS
–Auto Upload of water quality data from USGS
–Manual Upload of water quality data from WQX
Current Grant: WQX Data in Action
Needs Flow and matching WQ data
9 years of Water QualityData
Matching Flow Data
Currently user downloads file and examines it, then uploads to model.
Water Quality Data
Alternative: STORET map window fortext query
Alternative: STORET Text query
User is downloading a CSV file from STORET and processing it in two screens thenuploading to us. This is a perfect example of a step that needs to be replaced with aREST service.
Water Quality Data
Alternative: USGS and WQ Portal
Model analyzes the two data sets and picks matching time periods
Annual Load,plus requiredreduction foreach FlowRegime
User has established aload target.
Provides BMPs, based on the target compound, which arefrom list implemented in STEPL
STEPL opens and asks for user input
Populates reductioninformation from LDC
User can run an optimization module to compare efficiency(including efficacy in the flow regimes) of BMPs for the specificload target.
Current grant seeks to pre-calculate these efficiencies from WQX dataand provide them as streaming data to models, rather than as a user-created one time effort.
Web-based LDC Tool and STEPL
IdentifyingRequiredReduction
Observed
Annual Load
Web-based
LDC Tool
Calibration of
Simulated
Annual Load
Simulation of
BMP Effect
Online STEPL
WEB
https://engineering.purdue.edu/~ldc/
The End