A Newsletter from StreamNet
A Fish Data Delivery Project for the Pacific Northwest
Issue #11 - October 30, 2009
Go to: Previous newsletter. Next newsletter.
Welcome to the eleventh StreamNet News!
Table of Contents
- Successful test of remote access to speed data flow
- Increasing tribal data flow to StreamNet
- Updating the StreamNet regional hydrography
- StreamNet partners meet to consider higher resolution hydrography for Montana
- Access the StreamNet Library via social networks
- Data sets added to the Data Store
1. SUCCESSFUL TEST OF REMOTE ACCESS TO SPEED DATA FLOW
StreamNet recently made a copy of its main database remotely available to data compilers and GIS technicians in state, federal and tribal agencies that contribute data to StreamNet. This provides additional capabilities to the compilers and will lead to better quality control and faster data transfer and posting on StreamNet.
The initial uses for this remote access include allowing compilers to capture the latest table structures and data records in the master database and compare those tables with their own to identify schema differences, data orphans, duplicates, errors, omissions, and other data problems. In addition, there are a number of stored procedures that can be used to perform quality control.
Accessibility to this external database from their desktop computers was tested successfully using Access databases via ODBC connections and directly from SQL Server Management Studio and Enterprise Manager consoles. The next step in this developing effort will test compilers' ability to pre-validate data using a library of the macros and queries used by the regional StreamNet Data Manager in processing data sets for linking to back end StreamNet tables, validating new data against the Data Exchange Format, and comparing their data to records previously shared with StreamNet.
Ultimately, we will enhance these capabilities to allow compilers to load new data directly into this external SQL Server database as an alternative to submitting Access databases to the Data Manager, thereby streamlining the process of data submission, checking, loading and posting.
2. INCREASING TRIBAL DATA FLOW TO STREAMNET
The Columbia River Inter-Tribal Fish Commission (CRITFC) and its member tribes have begun a Tribal Data Network project aimed at addressing several high priority data management needs. The first priority is to improve data management capabilities and services at the tribal fishery project level. Faster capture of field data and improved data quality are two expected benefits of this effort. The second priority of the project is to improve reporting to track progress toward delisting salmon populations under the Endangered Species Act, meeting expected benefits of the Columbia River Fish Accords, and restoration and management of other fish populations. A direct benefit of the project will be wider dissemination of tribal data through StreamNet and other avenues.
The actual configuration and operation of the Tribal Data Network will evolve as the project gains momentum. One model would have Tribal Data Network staff at CRITFC working with tribal staff to develop applications and procedures to facilitate local data capture and management processes. Tribal Data Network staff could provide guidelines, software, and hardware to assist the tribes in capturing and managing the monitoring data they need.
The architectural vision for the Tribal Data Network at this time is distributed, with each member tribe having a relational database server at the tribal or field office level that data entry software will feed. The locally consolidated data on each database server will be assembled from local projects and under the control of the tribe, ensuring tribal ownership and control over their monitoring data.
Written data sharing agreements will document how each tribe wishes to share its monitoring data with other entities. The Tribal Data Network will produce applications that query the local tribal monitoring databases and transmit the data that each tribe has agreed to share among themselves and with CRITFC using XML format.
A web interface will make the agreed tribal monitoring data, summarized to the appropriate degree, available to the region and public at large. Using these and similar means, the Tribal Data Network project will facilitate sharing tribal monitoring data with StreamNet and the region.
3. UPDATING THE STREAMNET REGIONAL HYDROGRAPHY
StreamNet's regional hydrography GIS layer provides the georeferencing framework for the vast majority of regionally standardized fish data delivered through StreamNet. As higher resolution stream layers come into use by our partner agencies, StreamNet incrementally incorporates and uses these higher resolution data at the regional level and updates publication of our 'best available mixed scale hydrography' layer. In May, 2009 we incorporated higher resolution data from Washington Department of Fish and Wildlife into version 1 of this dataset. We are currently incorporating Oregon Department of Fish and Wildlife's high resolution hydrography for Oregon and will be making the switch to version 2 of our regional mixed scale hydrography dataset (MSHv2) in the very near future. The mixed scale hydrography is designed to include all 1:100,000 scale streams plus all named streams at 1:24,000 as well as additional streams for which we have data.
Our long term goal is to use a regional whole-stream route system based on line work that is sourced from and maintained within the High Resolution National Hydrography Dataset (NHD). While the U.S. Geological Survey no longer uses map scale in describing the dataset, these data are generally equivalent to 1:24,000 and finer. This approach will enable StreamNet partners and data users to leverage and contribute to the data review, maintenance and tool development investments of the NHD stewardship program while benefiting from the simplicity of whole stream routes for recording and reporting fish data. Importantly, this approach will make it much easier to exchange and integrate data from StreamNet's system with those managing data tied to the NHD.
4. STREAMNET PARTNERS MEET TO CONSIDER HIGHER RESOLUTION HYDROGRAPHY FOR MONTANA
A number of Montana state agencies and hydrography stakeholders met in August at the Montana State Library in Helena to discuss and identify solutions to obstacles preventing adoption of the High Resolution National Hydrography Dataset (NHD) as a common georeferencing system within the state of Montana. Participants included representatives from Montana Fish Wildlife and Parks (MFWP), the Library's Montana Natural Resource Information System (NRIS, the official Montana NHD data stewards), U.S. Geological Survey (USGS), Horizon Systems, and other Montana state agencies along with StreamNet GIS staff from MFWP, Pacific States Marine Fisheries Commission, Washington Department of Fish and Wildlife, Idaho Department of Fish and Game, and Oregon Department of Fish and Wildlife.
Attendees described how they currently use routed hydrography and identified their business needs for a routed hydrography system. For Montana StreamNet partners, this includes an ongoing need for a whole stream route identifier (LLID) and an ability to map and manage fish data as whole stream linear events. Fortunately, this need was well understood in advance by the USGS and their contractor, Horizon Systems. Horizon described a proposed process for migrating MFWP LLIDs to High Resolution NHD that they tested for the upper Missouri Basin (HUC 100301). The process involves first moving the LLID identifiers onto the Medium Resolution NHD (100k) and then migrating from the Medium to High Resolution NHD using an ArcView 3.x tool previously developed with EPA funding. Horizon was able to conceptually prove and document the process and suggested that the Hydro Event Management (HEM) tool available through the PNW Hydrography Framework Clearinghouse could be used to maintain LLIDs as linear events on top of NHD into the future.
As an outcome of the meeting, NRIS offered to undertake a more complete pilot project testing these methods on the Kootenai-Pend Oreille-Spokane Subregion (HUC 1701). If this pilot effort is successful, it may identify a path forward for MFWP and StreamNet that would enable the management and publication of fish data on whole stream routes that are based on the geometry present and maintained within High Resolution NHD.
Please send any hydrography and GIS related questions to StreamNetGIS@psmfc.org.
5. ACCESS THE STREAMNET LIBRARY VIA SOCIAL NETWORKS
The StreamNet Library is now available on Facebook (StreamNet Library) and Twitter (@StreamNetLib). The Library is building a following by helping people find information about fisheries, the Columbia River or Pacific salmon. The Library staff watches for postings on these topics via Tweetdeck and responds to questions through direct Tweets. They are also gathering and pushing out information to followers on relevant meetings, public forums and news stories as they appear through various websites or postings from other Twitter users.
These are two additional ways to access the store of information contained in the StreamNet Library in addition to online access, phone (503-238-0667), FAX (503-235-4228), email (email@example.com), and in person at the library (729 NE Oregon St, Suite 190, Portland, OR, 97232).
6. DATA SETS ADDED TO THE DATA STORE
Two data sets were added to the StreamNet Data Store since the last newsletter.
Salmonid genetics data for Montana were updated to include 2009 data. This data set is the salmonid genetic purity data from Montana Fish, Wildlife & Parks (MFWP) and is current as of September 8, 2009.
MFWP also submitted an extensive set of fish population survey data. The data set contains population survey information from western Montana from 1961 to 2008, including all fish surveys: one time, index stream, lake netting and all other types. The data were collected by MFWP biologists, other Montana state agencies, federal agencies and scientific collector permit holders.
If you want to be added to the list of 860 people who receive occasional email notices of new data, features, and developments at the StreamNet Project, click here.
COMMENTS on the StreamNet project, its web site, its data products, or your data needs are encouraged and appreciated. Click the "Contact StreamNet" button on any page of the StreamNet web site.
ABOUT THE STREAMNET PROJECT:
StreamNet is a cooperative, multi-agency effort among the Columbia River Basin's state, tribal, and federal fisheries agencies, the Northwest Power and Conservation Council (NPCC), the Bonneville Power Administration, and the Pacific States Marine Fisheries Commission to compile fish-related data. We compile and make available on our web site information intended to be useful to fisheries managers and researchers, land managers, planners, and others. We acquire, regionally standardize, and georeference data from multiple sources on a number of topics, including fish distribution, fish abundance trends, hatchery returns, harvest levels, migration barriers, hatcheries, and dams. We provide a catalog of photographs relevant to fish species and facilities in the region. Through our "Data Publishing Service" and "Data Store" we archive and provide access to stand-alone data sets created by other entities, as well as the Pacific Northwest's 1:100,000 scale GIS streams layer. We maintain the official list of stream reaches the NPCC has recommended be protected from dam construction. We provide pre-made maps and let you make maps interactively from data in the StreamNet database to meet your needs. We continually work to update these resources, so new information becomes available several times each year. We also provide customized data-related services for participants in the NPCC's Fish and Wildlife Program.
You can learn more about StreamNet at http://old.streamnet.org/about.html. We exist in order to bring useful information to people such as you, and we welcome your questions, feedback, and suggestions. We also hope you will inform your colleagues about the resources available at StreamNet (http://old.streamnet.org).
Signed up for StreamNet News but no longer want to be? We hope you won't, but you can take your name off the list by clicking here.