MONITORING DESIGN EXAMPLE

If you are looking for a detailed example of a completed Monitoring Design Worksheet, please reference the example below. You may use the hotlinks below to navigate directly to the different steps in the worksheet.

Step 1: Develop management objectives; select additional ecosystem attributes and indicators to monitor

Step 2: Set the study area and reporting units; develop monitoring objectives.

Step 3: Select criteria for stratifying the study area (as appropriate)

Step 4: Select and document supplemental monitoring methods; estimate sample sizes; set sampling frequency; develop implementation rules

Step 5: Collect and evaluate available data to determine sampling sufficiency and the validity of the strata (if available)

Step 6: Apply stratification and select statistically valid monitoring locations

Step 7: Data Management Plans


Monitoring Design Worksheet EXAMPLE: West Desert District, Utah

Step 1: Develop management objectives; select additional ecosystem attributes and indicators to monitor

Step 1a: Develop management objectives or goals related to resource condition and resource trend

Field office management objectives are presented in the State Land Health Standards (LHS), Resource Management Plan (RMP) and the Sage Grouse RMP Amendment. All highlight the importance of healthy ecosystems, including vegetation, soil, water, and wildlife. In addition, RMP goals highlight the importance of monitoring for improving understanding of ecosystem functioning and carrying out adaptive management.

The following represents a synthesis of ecosystem management objectives from the LHS, RMP, and Sage Grouse RMP Amendment:

  • “Upland” soils exhibit infiltration and permeability rates appropriate for the soil type, climate, landform, and geologic processes. Adequate soil infiltration and permeability allows for the accumulation of soil moisture necessary for optimal plant growth and vigor and minimizes surface runoff. (LHS101; RMP)
  • Riparian systems function properly and have the ability to recover from major disturbance such as fire, severe grazing, or 100-year floods. Riparian vegetation captures sediment and provides forage, habitat, and biodiversity. Water quality is improved or maintained. Stable soils store and release water slowly. (LHS102; RMP; Sage Grouse Plan Amendment)
  • Healthy, productive plant and animal communities of native and other desirable species are maintained at viable population levels commensurate with the species and the habitat’s potential. Plants and animals at both the community and population level are productive, resilient, diverse, vigorous, and able to reproduce and sustain natural fluctuations and ecological processes. (LHS103; RMP). Emphasis on sagebrush biome (RMP; LHS104; Sage Grouse Plan Amendment)
  • Special status, threatened, and endangered species (federal and State), and other plants and animals officially designated by the Bureau of Land Management (BLM) and their habitats are maintained or enhanced by sustaining healthy, native plant and animal communities. (LHS104). Emphasis on greater sage grouse (RMP; Sage Grouse Plan Amendment)
  • The water quality of streams and rivers located on or influenced by BLM lands will achieve or exceed state water quality standards. Water quality standards include the designated beneficial uses, numeric criteria, narrative criteria, and anti-degradation requirements set forth under State law as found in Rule 317-2 in the Utah Administrative Law, and as required by Section 303(c) of the Clean Water Act. (LHS105; RMP)

Step 1b: Select additional ecosystem attributes and indicators to monitor

Information about populations of threatened and endangered species is also necessary but should be gained through partnership with the state wildlife agency.

The BLM AIM terrestrial and lotic core indicators (TN440TR 1735-1TR 1735-2) are relevant to all of the above objectives (e.g., Terrestrial and Lotic Indicator Tables). At terrestrial plots, we will also monitor sagebrush shape, distance to the nearest sagebrush patch, and the distance to Pinon-Juniper trees or other tall structures to meet the requirements of the Sage Grouse Habitat Assessment Framework (HAF). E. coli samples will also be collected from stream reaches that are heavily impacted by cattle grazing or that are immediately downstream of urban areas.

Step 2: Set the study area and reporting units; develop monitoring objectives.

Step 2a: Set the study area, reporting units, define the target population, document the geospatial layers used to describe these areas, and select the existing sample designs to be used for revisits.

The study area for both lotic and terrestrial monitoring efforts is all BLM lands and perennial streams and rivers within the West Desert District boundary (Figure 1). The target population for terrestrial monitoring includes accessible BLM terrestrial ecosystems as defined by the national Surface Management Agency layer and verified in the field. The target population for lotic ecosystems includes streams and rivers defined as perennial by the medium resolution NHD that are verified in the field to have water at a minimum of 5 transects. Reporting units for this monitoring effort tie back to the monitoring objectives and include: the Field Office areas and sage grouse habitat areas (PHMA and GHMA). If designs stratified simply by field office do not produce enough sample points to report on sage grouse habitat, we may intensify monitoring efforts in those areas.

The geospatial data layers used to define the study area and reporting units included:

  • BLM field office boundaries
  • BLM land ownership: Surface Management Agency (SMA) layer published July 2015
  • Sage Grouse Habitat Info: PHMA, GHMA, Focal Areas and Population Areas
  • National Hydrography Dataset (NHD): medium resolution version 2.0

 Several previously sampled terrestrial design will be incorporated into this design for revisits. These include the 2016-2020 Land Use Plan design in the field office, a 2017 sage-grouse habitat intensification design and 12 targeted plots within the Field office. The geospatial layers used to create these designs are documented below. This includes point locations, stratification polygons and sample frames. Additional non-revisit plots and new revisit plots will be spatially balanced around existing sampled plot locations. There are no previously sampled lotic points and the new design will start to revisit points in the second monitoring cycle.

Step 2b: Develop monitoring objectives related to resource condition and resource trend

Monitoring objectives were identified by adding quantitative benchmarks associated with the terrestrial and lotic indicators that are related to each management goal (i.e. Terrestrial and Lotic Indicator Tables). These benchmarks communicate the indicator values that must be achieved across a specific percentage of the landscape/resource to show that conditions are acceptable (meeting objectives) vs. unacceptable (not meeting objectives).  For example, the first monitoring objective in table shows that soil aggregate stability should be greater than 4 across 70% of the landscape in order for the management goal to be achieved. Unacceptable conditions could trigger a change in management. Indicators were chosen for each Land Health Standard using Appendix 1 in Tech note 453. Benchmark values were gleaned from policy, research, and professional judgment.

Step 3: Select criteria for stratifying the study area (as appropriate)

In order to reduce complexity of the terrestrial design, stratification will be reduced to 2 strata: priority areas for sage-grouse management and non-habitat areas. Points will be allocated disproportionately so that twice the number of points per acre will be focused on sage-grouse habitat areas.

The geospatial data layers used to define these strata were derived from GHMA and PHMA layers described in the Sage-grouse RMP amendment as well as modelled habitat based on vegetation cover types  (See Fig 4).

Step 4: Select and document supplemental monitoring methods; estimate sample sizes; set sampling frequency; develop implementation rules

Step 4a: Review and document supplemental monitoring methods (if required)

Terrestrial – Supplemental methods –Terrestrial monitoring indicators and methods can be found in BLM Tech Note 440 and the Monitoring Manual for Grassland, Shrubland and Savanna Ecosystems (MacKinnon et al. 2011; Herrick et al. 2015). The core terrestrial indicators are sufficient for evaluating most of the terrestrial management and monitoring objectives, as discussed in Steps 1 and 2. However, several supplemental indicators were identified that were not addressed by the core indicators:  sagebrush shape, distance to nearest sagebrush patch and distance to nearest juniper/tall structure. These supplemental indicators inform sage grouse habitat questions as part of the Sage Grouse Habitat Assessment Framework (Stiver et al. 2015). Distances to nearest sagebrush patch and distance to nearest juniper/tall structure can be measured using GIS with minimal additional field time, especially with the help of good notes taken by the field crew (Stiver et al. 2015). The Field Office GIS staff will capture this information in an Excel spreadsheet following the field season. A standard method for describing sagebrush shape, consistent with the HAF is available in the National Resource Inventory (NRI) protocol (National Resources Inventory 2016). This information will be recorded every time a sagebrush plant is hit while doing Line Point Intercept, and electronically captured using Survey123. Supplemental training for field crews and field office staff will be made available to ensure that these methods are implemented successfully.

Lotic – The lotic core indicators will be sufficient for evaluating most of the lotic management goals and monitoring objectives. However, the Utah Standards of Rangeland Health require that the BLM assess whether streams are meeting State water quality standards for e. coli. Since e. coli exceedances are only likely to occur in streams that are impacted by grazing, e. coli samples will only be collected at streams that are heavily used by cattle. E. coli samples will be submitted to the Utah Department of Environmental Quality, Division of Water Resources for analysis. The Aquatic Ecologist in the West Desert District will train the field crew on e. coli sample collection methods.

Step 4b: Estimate sample sizes (Completed by National AIM Team)

Terrestrial – Sample sizes were determined for each stratum based on field crew capacity and the final proportion of acres represented by each stratum (Sample Design Table).

Within the broader District, a decision was made to intensify monitoring within sagebrush-dominated strata (mountain big sagebrush and Wyoming big sagebrush) to address sage grouse habitat management objectives. Sampling intensity was reduced in non-sage-grouse habitat areas.

One field crew can collect approximately 50 points in a monitoring season, so we intend to sample 100 plots per field season, for 5 years. Thus, we are planning to hire and run two three-person field crews to collect terrestrial monitoring data for each of the 5 years. We plan to revisit 80% of terrestrial points on a five-year rotating basis in order to estimate trend.  

Lotic – To balance personnel capacity, statistical power, budget etc., we worked with NAMC/NOC to select a sample size of 50 stream reaches for the district. We anticipate that a sample size of 50 will allow us to estimate the proportion of stream km in a given condition category with 80% confidence. Supplemental points can be added to increase the precision and accuracy of estimates as needed.

There were no river km on BLM managed lands in the West Desert District, therefore we will only monitor small and large streams. Proportional allocation of points to small and large streams would have resulted in fewer than 10 points on large streams which seemed like an insufficient sample size, so we increased the point allocations in the large stream category to obtain a larger sample size and decreased the number of points allocated to small streams to keep the total number of sample points to the desired number of 50 points for the district.

In our area, one lotic field crew can collect data at approximately 25-30 reaches in a year. Thus to accomplish the desired sample size of 50 points, we plan to hire one, 2-person crew for the next two years.

The objectives for trend monitoring will be determined after baseline conditions are established. Specifically, follow up monitoring will be focused on any indicators that raise red flags. The temporal scale that we will use to implement subsequent monitoring will depend on which indicators need to be monitored and the temporal scale that we expect them to change in response to natural environmental variability and/or management actions. For example, recommendations might be to assess water quality indicators on a monthly basis if exceedances are observed. In contrast, bank stability would be assessed on an annual or semi-annual time-scale.

Step 4c: Define revisit parameters

i) Set the revisit frequency and the number of years sampled per cycle

Terrestrial – We plan on sampling each year for every 5-year sampling cycle and will revisit points every 5 years.

Lotic – Due to resource and budget imitation only he first two years of each cycle will be sampled, and revisits points will be visited every 5 years.

ii) Set number of cycles and the total duration of your design

Terrestrial – This design will have 4 sampling cycles, each lasting 5 years for a total design duration of 20 years.

Lotic – This design will have 2 sampling cycles, each lasting 5 years for a total design duration of 10 years.

iii) Set the ratio of revisit points to non-revisit points in your design

In order to balance the power to detect both trend over time with the ability to capture spatial variation in terrestrial and lotic resources both terrestrial and lotic designs will plan to revisit 80% of their design points and use the remaining 20% of points for non-revisit points.

Step 4d: Develop implementation rules

Terrestrial and Lotic – We will use the standard AIM implementation rules, the Terrestrial Plot Tracking map in ArcGIS Collector, and the Lotic Design Management Spreadsheet to implement the designs and to document the fate of all design points (see aim.landscapetoolbox.org).

Additional implementation rules are that the supplemental indicators will be collected at each terrestrial plot (see step 7).

Step 5: Collect and evaluate available data to determine sampling sufficiency and the validity of the strata (if available)

Terrestrial – Terrestrial sample sufficiency analysis focused on the proportion of the area meeting a benchmark based on pre-existing data. Pilot data were available from an adjacent field office that has similar ecosystems and environmental characteristics. We looked at five different indicators: bare soil, total foliar cover, shrub cover, perennial grass cover, and perennial forb cover. In general, at most 27 samples were sufficient to estimate the proportion of the area meeting objectives for all indicators with 80% confidence and 10% margin of error. In cases where the observed proportion of the landscape meeting objectives was far away from the required proportion, fewer samples were required. Thus, the current design is sufficient to report out in any given year at the District or Field Office scale and over 5 years in the Sheeprocks Sage Grouse Population Area at these error levels. Reporting in the Rich and Box Elder SFA’s, which have smaller sample sizes in this design, will result in a higher margin of error (e.g., 15% or 20%).

Lotic – No pilot data were available so we were not able to incorporate any previously collected data into our sample sufficiency analysis and strata validity.

With the help of the NOC, we determined that our initial approach should be to collect data at 25 points and then do a sample sufficiency analysis to determine if our target sample size of 50 stream reaches will be enough to characterize conditions with enough confidence. We based this number on the worst case scenario of observing the maximum allowable variance for estimating a proportion (50%), with a 90% confidence level. This scenario will only allow one to detect degraded stream conditions when 50% (± 15%) of streams are in most degraded condition – an unacceptable amount from a management perspective. The actual variance observed at these initial 30 sample points will be used to determine the final sample size of this monitoring effort.

Step 6: Apply stratification and select statistically valid monitoring locations

Terrestrial – Monitoring locations were selected by the Jornada using the GRTS method which produces random, spatially balanced points across the landscape of interest (Stevens and Olsen 2004).  The ID team reviewed the points to make sure that they met the design criteria described in steps 1-3.  During that review, the interdisciplinary team noted that in Year 1, more points were needed to report on sage grouse habitat conditions in the Box Elder SFA and the Sheeprocks GRSG Population areas in order to satisfy immediate reporting needs. Points were “borrowed” from later years of the design (Years 2-5) in order to provide additional points to be sampled the first year (Figure 5). The design was finalized on March 22, 2016 and is stored on the local field office share point drive.

Lotic – In total 50 sample reaches were selected for potential sampling (i.e., base reaches) and over double that number as were selected as replacement reaches for failed reaches (i.e., oversample reaches = 100). All 50 sample reaches were selected for the RMP effectiveness monitoring design by the NOC. However, due to errors in the NHD layer the draft design revealed that no points had been generated in the Sheeprock Sage Grouse area. Therefore, 10 additional reaches (and 30 oversample or replacement reaches) were selected to intensify the sample design in the Sheeprock Sage Grouse Habitat Area using an R script.

The design was finalized on April 17, 2020.  More information can be found in the lotic design metadata file that is stored with the other design files on the BLM AIM office share point drive.

Step 7: Develop quality assurance and quality control (QA and QC) procedures and data management plans

Terrestrial – Data management, quality assurance, and quality control for the terrestrial core indicators will follow the standard procedures in the Terrestrial AIM Data Management Protocol 2020 available on the AIM Landscape Toolbox.

Supplemental indicators require additional data management and quality considerations. Distance to nearest sagebrush patch and distance to nearest juniper/tall structure will be captured in an Excel spreadsheet following the field season. Sagebrush shape will be electronically captured using Survey123 and Collector along with the Line Point Intercept method.  Supplemental training for field crews and field office staff will be made available after the AIM terrestrial core methods training to ensure that these methods are implemented successfully.

Lotic –  Standard procedures for lotic core indicators may be found in the Lotic Data Management and QAQC Protocol.

  1. E. coli indicator data will be managed by the district aquatic ecologist.

References:

Bureau of Land Management. 2015. AIM National Aquatic Monitoring Framework: Introducing the Framework and Indicators for Lotic Systems. Technical REference 1735-1. USDOI- BLM National Operations Center, Denver, CO.

Bureau of Land Management. 2020. AIM National Aquatic Monitoring Framework: Field Protocol for Wadeable Lotic Systems. Technical Reference 1735-2. USDOI- BLM National Operations Center, Denver, CO.

Elzinga, C.L., D.W. Salzer, and J.W. Willoughby. 2003. Measuring and Monitoring Plant Populations. BLM Technical Reference 1730-1.

Herrick, J.E., J.W. Van Zee, S.E. McCord, E.M.Courtright, J.W. Karl, and L.M. Burkett. 2015. Monitoring Manual for Grassland, Shrubland, and Savanna Ecosystems. 2nd ed. Volume I: Core Methods. USDA – ARS Jornada Experimental Range, Las Cruces, NM.

Herrick, J.E., J.W. Van Zee, K.M Havstad, L.M. Burkett, and W.G. Whitford. 2009.Monitoring Manual for Grassland, Shrubland, and Savanna Ecosystems. 2nd ed. Volume II: Design, supplementary methods, and interpretation. USDA – ARS Jornada Experimental Range, Las Cruces, NM.

National Resources Inventory. 2015. Chapter 22: Sagebrush Shape. National Resources Inventory Protocol.  <http://www.nrisurvey.org/nrcs/Grazingland/2015/instructions/R-ch22_15vf.pdf>  Accessed 7/25/2016.

Stevens, D.L., and A.R. Olsen. 2004. Spatially Balanced Sampling of Natural Resources. Journal of the American Statistical Association 99 (465): 262–278.

Stiver, S.J., E.T. Rinkes, D.E. Naugle, P.D. Makela, D.A. Nance, and J.W. Karl, eds. 2015. Sage-Grouse Habitat Assessment Framework: A Multiscale Assessment Tool. BLM Technical Reference 6710-1. BLM and Western Association of Fish and Wildlife Agencies, Denver, Colorado.

Taylor et al. 2013.  AIM-Monitoring: A component of the BLM Assessment, Inventory and Monitoring Strategy.  BLM Technical Note 445.

Comments are closed.