Columbia Basin Fish and Wildlife Program Columbia Basin Fish and Wildlife Program
SOW Report
Contract 58576: 2008-507-00 EXP TRIBAL DATA NETWORK
Project Number:
Title:
CRITFC Inter-Tribal Monitoring Data
Stage:
Implementation
Area:
Province Subbasin %
Basinwide - 100.00%
Contract Number:
58576
Contract Title:
2008-507-00 EXP TRIBAL DATA NETWORK
Contract Continuation:
Previous: Next:
54190: 2008-507-00 EXP TRIBAL DATA NETWORK
  • 63000: 2008-507-00 EXP CRITFC INTER-TRIBAL MONITORING DATA
Contract Status:
Closed
Contract Description:
The purpose of the Tribal Data Network (TDN) is to assist CRITFC and its member tribes in the timely and accurate capture, storage, processing, and dissemination of data for management of anadromous fish and their habitats.  There are four main objectives for the project.
1. Assist CRITFC and member tribes to develop cost effective computer architectures and data management strategies for anadromous fish and habitat data.  Develop pilot systems and tools demonstrating cost effective ways to collect, store, summarize, and disseminate fish and habitat data. Convert successful pilot projects into production computer systems as resources allow.
2. Provide data management services to the tribes. These take a variety of forms, but includes:
                a. Partial support for tribal data coordinators (in this expanded proposal),
                b. Developing shared data capture, management, and reporting tools for CRITFC and member tribes,
                c. Expert advice and coordination of efforts, especially through the annual Tribal Data Workshops and
                d. Limited support for tribal infrastructure through one-time purchases of hardware and software.
3. Assist member tribes to build internal capacity for improved data management and to achieve the tribal gravel-to-gravel management vision of the Commission.  Combine local data from tribal sources with regional and international data on mainstem, estuary and ocean impacts on salmon and salmon management decisions; and
4. Enable tribal participation in regional data management coordination processes, provide tribal input and coordination on regional coordination of data management and sharing best practices, facilitate inter-tribal coordination on the level of monitoring data.

At the end of the first two years of the project, a suite of pilot projects is underway, and some pilots have already displayed demonstrable success.  The data management approach and technology used in the current pilots has proven successful, and can be applied elsewhere.  The expectation is that the technologies used in the pilots will be used to address priorities identified in the Coordinated Assessment process.  TDN system architectures depend on lessons learned during the past 15 years of experience developing data management systems for the mainstem Columbia River.  

Lessons Learned:

1. The most cost effective data management systems are those that enter field data one time and one time only.  It is always more expensive to re-enter the same data into multiple formats.
2. QA and QC should be pushed out to be as close to the field staff as possible.  The person who entered the data is the best at performing QA/QC on the data, for he/she knows the most about the data.  QA/QC is far more accurate and cost effective when performed by the field staff.  
3. A paper trail and an audit trail should be created.  Data in the Columbia Basin is often subjected to scientific, judicial, and policy review; data management systems must be designed to provide defensible accounting from top to bottom.  Estimates and other summarized quantities need to be able to be traced back to field data collection, and responsibility for the data collection must be able to be traced back to identifiable field staff.  
4. To get buy-in from the field staff, provide tools that actually make their job easier.  To get management buy-in, provide aggregated data more accurately and timely.
5. Minimize fish handling, minimize stress on fish.  When monitoring ESA listed fish in the Columbia Basin, there are so many concurrent studies; over handling of fish is a recurrent problem.
6. Focus effort on getting the field data into SQL servers that drive dynamic web sites.  Once the monitoring data is stored electronically under policy maker control, then it just a matter of what, where, and who to output the data to.  Once data is in an SQL server, it is a simple matter to aggregate and summarize the data into any format.  SQL servers driving dynamic web sites and web services gives one the most flexible method of outputting monitoring data into whatever formats management needs now and in the future.
7. Build on existing field data collection methods and practices whenever possible to minimize training expense and disruption of current field data collection efforts.  
8. All access to monitoring data is controlled by the individual tribe who owns it.  CRITFC generated data is controlled by the Fish Commission, individual tribal monitoring data is controlled by the individual tribe that owns it.  Where the monitoring data is hosted and stored is up to the individual tribes.

Current Pilot and Production Projects using digital pen technology and web services architecture:
1. Bonneville Adult Fish Facility Data Management
2. Snake River Harvest Estimate
3. Zone 6 Harvest Estimate (Nez Perce Tribe component)
4. Below Bonneville Harvest Estimate
5. Willamette Falls Lamprey Data Management
6. Klickitat Basin Surveys
                a. Spawner Patch Survey
                b. Habitat Unit Survey
                c. Large woody debris survey
                d. Stream Bedrock survey
                e. Large woody debris jam survey
                f. Discharge data
                g. Electrofishing survey
                h. Sampling events tracking table
                i. Stream Survey Tracking table showing reaches for each stream

These projects all use paper forms and a digital pens to collect field data.  There are 17 pens deployed to date. The data is transmitted to a web site in the cloud where an electronic copy of each form can be viewed by field staff from any web browser.  A slider bar along the bottom of the form allows the field staff to view their own handwriting, and to view what the computer interprets it to be.  Validation code in each cell allows for range checking, lookup tables, and other constraints to reduce transcription and other errors.  When the field staff has validated the data, pressing an “approve” button sends the data via web services to an SQL server hosted by the appropriate entity, be it CRITFC or a member tribe.  Summarization, aggregation, and other data processing takes place on the SQL servers, and the data is almost instantly made available on web sites under tribal management control in whatever form is required.  Once the data is hosted on an SQL server, it is a simple programming task to output it into whatever form is needed, on whatever schedule is needed (for example, DETs).  A digital copy of each form in the PDF format is also generated by this process, so one can trace any estimate back to the original paper forms, or an electronic scan of the original paper forms.
Other current pilot and production projects:

1. Portable Anadromous Data Structure (PADS) to facilitate lifecycle analysis for legacy and current biological and habitat data in the Grand Ronde basin. This effort is focused on Chinook on the Upper Grand Ronde and Catherine Creek.
2. Web based tag loss application for estimating tag loss.
3. CRITFC Data Center for Tribal Data Network.

Current resources are focused on assisting the tribes to get field data consolidated on SQL servers under the appropriate tribal management control.  Current funding supports the ongoing activities of the TDN, and some new development.  Additional resources are required to produce the estimates and summarized data currently desired by the Coordinated Assessment from the existing field data.  If the field data is consolidated under management control on SQL servers, it is a straightforward task to produce any format of output that the Coordinated Assessment (DETs) or adaptive management may require.

Appendix M of the "Columbia River Basin Collaborative Data Sharing Strategy: Salmon and Steelhead Population Abundance and Productivity Indicators" describes Tier 1 high priority data gaps that need to be filled to enable CRITFC member tribes to share the three initial VSP parameters with the region.  The additional funds needed to fill these Tier 1 gaps is $351,000.  
$100,000 in funding has been provided, which will enable the Tribal Data Network to address the goals of the Collaborative Data Sharing Strategy, and the Framework for Fish and Wildlife Program Data Management.
The modified statement of work enumerates three deliverables to be produced with this additional funding:
1) A Preliminary Data Inventory for all BPA funded projects for each tribe
2) Progress on a Tribal Data Management Strategy for each tribe
3) Progress on producing Monitoring Data Sharing Agreements for each tribe
The specific statements of work for each of the Tribal Data Stewards are found in attachments.  it is hoped that four tribal data stewards will be hired and onboard by June 1st, 2013.  These data stewards will focus on producing specific deliverables similar to the general deliverables described here. For specific deliverable variations, see the attachments.
Account Type(s):
Expense
Contract Start Date:
09/15/2012
Contract End Date:
09/14/2013
Current Contract Value:
$423,700
Expenditures:
$423,700

* Expenditures data includes accruals and are based on data through 30-Nov-2024.

BPA COR:
Env. Compliance Lead:
Work Order Task(s):
Contract Type:
Contract (IGC)
Pricing Method:
Cost Reimbursement (CNF)
Click the map to see this Contract's location details.

No photos have been uploaded yet for this Contract.

Viewing of Work Statement Elements

Deliverable Title WSE Sort Letter, Number, Title Start End Concluded
Fulfill all administrative tasks with quality products and in a timely manner. A: 119. Administer Contract 09/14/2013 09/11/2013
Attend coordinated assessment meetings, workshops, and hold at least one tribal data workshop. B: 189. Attend coordinated assessment meetings, workshops, and hold at least 1 tribal data workshop 09/14/2013 09/11/2013
Updated Inventory and assessment of tribal data needs and summary report for selected existing C: 114. Update tribal needs assessment and identification and selection of existing data projects as needed 09/14/2013 09/13/2013
Updated Tribal Data Network Design to COTR D: 175. Update functional design based on ongoing assessments and rapidly advancing technologies 09/14/2013 09/13/2013
Produce reviews of new technologies used in pilots to improve data management E: 122. Test and Evaluate New Technologies to improve data management 09/14/2013 09/13/2013
Update Pilot Test Implementations F: 160. Update Pilot Test Implementations (ongoing) 09/14/2013 09/13/2013
Update and Maintain Accords Database (ongoing) G: 160. Update and Maintain Accords Database (ongoing) 09/14/2013 09/13/2013
Exploratory development of website for hosting PSC habitat and enhanced harvest data H: 160. Exploratory Hosting of PSC enhanced harvest and habitat data (ongoing) 08/14/2013 09/13/2013
Maintain databases and consolidate, curate and manage legacy data as opportunities arrive. I: 160. Exploratory development and maintenance of databases of legacy data 09/14/2013 09/13/2013
Pilot climate change database J: 160. Exploratory development and maintenance of databases for climate change project (ongoing) 09/14/2013 09/13/2013
Maintenance and development of Accords data dissemination on CRITFC website K: 160. Update and maintain portions of CRITFC web site for Accords data (ongoing) 09/14/2013 03/15/2013
Exploratory development of FGDC metadata clearinghouse node L: 160. Exploratory development of Federal Geospatial Data Committee (FGDC) metadata and other metadata 09/14/2013 09/13/2013
Capture histories and Burnham histories M: 161. Assist in the production of capture histories and summaries for tribal fish and disseminate via web 09/14/2013 09/13/2013
Annual Progress Report to BPA O: 132. Submit Progress Report for the period 09/15/2011 to 09/14/2012 08/15/2013 08/15/2013
Preliminary data inventory for selected projects P: 115. Produce preliminary data inventory for selected projects 09/13/2013 09/13/2013
Assist tribes to develop a data management strategy Q: 141. Make progress on developing data management strategy 09/14/2013 09/13/2013
Make progress developing tribal data sharing agreements R: 141. Make progress developing data sharing agreements 09/14/2013 09/13/2013

Viewing of Implementation Metrics
Viewing of Environmental Metrics Customize

Primary Focal Species Work Statement Elements
Chinook (Oncorhynchus tshawytscha) - All Populations
  • 1 instance of WE 175 Produce Design
  • 1 instance of WE 161 Disseminate Raw/Summary Data and Results
Chinook (O. tshawytscha) - Deschutes River Summer/Fall ESU
  • 1 instance of WE 114 Identify and Select Projects
  • 1 instance of WE 115 Produce Inventory or Assessment
Chinook (O. tshawytscha) - Lower Columbia River ESU (Threatened)
  • 1 instance of WE 114 Identify and Select Projects
Chinook (O. tshawytscha) - Mid-Columbia River Spring ESU
  • 1 instance of WE 114 Identify and Select Projects
Chinook (O. tshawytscha) - Snake River Fall ESU (Threatened)
  • 1 instance of WE 114 Identify and Select Projects
  • 1 instance of WE 115 Produce Inventory or Assessment
Chinook (O. tshawytscha) - Snake River Spring/Summer ESU (Threatened)
  • 1 instance of WE 114 Identify and Select Projects
  • 1 instance of WE 115 Produce Inventory or Assessment
Chinook (O. tshawytscha) - Snake River Spring/Summer (not listed)
  • 1 instance of WE 114 Identify and Select Projects
Chinook (O. tshawytscha) - Upper Columbia River Spring ESU (Endangered)
  • 1 instance of WE 115 Produce Inventory or Assessment
Chinook (O. tshawytscha) - Upper Willamette River ESU (Threatened)
  • 1 instance of WE 114 Identify and Select Projects
Steelhead (Oncorhynchus mykiss) - All Populations
  • 1 instance of WE 175 Produce Design
Steelhead (O. mykiss) - Middle Columbia River DPS (Threatened)
  • 1 instance of WE 115 Produce Inventory or Assessment
Steelhead (O. mykiss) - Snake River DPS (Threatened)
  • 1 instance of WE 115 Produce Inventory or Assessment
Steelhead (O. mykiss) - Upper Columbia River DPS (Threatened)
  • 1 instance of WE 115 Produce Inventory or Assessment
Lamprey, Pacific (Entosphenus tridentata)
  • 1 instance of WE 175 Produce Design
Sturgeon, White (A. transmontanus) - Lower Columbia River
  • 1 instance of WE 175 Produce Design

Sort WE ID WE Title NEPA NOAA USFWS NHPA Has Provisions Inadvertent Discovery Completed
A 119 Administer Contract 09/15/2012
B 189 Attend coordinated assessment meetings, workshops, and hold at least 1 tribal data workshop 09/15/2012
C 114 Update tribal needs assessment and identification and selection of existing data projects as needed 09/15/2012
D 175 Update functional design based on ongoing assessments and rapidly advancing technologies 09/15/2012
E 122 Test and Evaluate New Technologies to improve data management 09/15/2012
F 160 Update Pilot Test Implementations (ongoing) 09/15/2012
G 160 Update and Maintain Accords Database (ongoing) 09/15/2012
H 160 Exploratory Hosting of PSC enhanced harvest and habitat data (ongoing) 09/15/2012
I 160 Exploratory development and maintenance of databases of legacy data 09/15/2012
J 160 Exploratory development and maintenance of databases for climate change project (ongoing) 09/15/2012
K 160 Update and maintain portions of CRITFC web site for Accords data (ongoing) 09/15/2012
L 160 Exploratory development of Federal Geospatial Data Committee (FGDC) metadata and other metadata 09/15/2012
M 161 Assist in the production of capture histories and summaries for tribal fish and disseminate via web 09/15/2012
N 185 Periodic Status Reports for BPA 09/15/2012
O 132 Submit Progress Report for the period 09/15/2011 to 09/14/2012 09/15/2012
P 115 Produce preliminary data inventory for selected projects 09/15/2012
Q 141 Make progress on developing data management strategy 09/15/2012
R 141 Make progress developing data sharing agreements 09/15/2012