Next Article in Journal
Assessment and Minimization of Potential Environmental Impacts of Ground Source Heat Pump (GSHP) Systems
Next Article in Special Issue
Trophic Features, Benthic Recovery, and Dominance of the Invasive Mytilopsis Sallei in the Yundang Lagoon (Xiamen, China) Following Long-Term Restoration
Previous Article in Journal
Flood Forecasting and Warning System Structures: Procedure and Application to a Small Urban Stream in South Korea
Previous Article in Special Issue
Meiofaunal Dynamics and Heterogeneity along Salinity and Trophic Gradients in a Mediterranean Transitional System
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Balance between the Reliability of Classification and Sampling Effort: A Multi-Approach for the Water Framework Directive (WFD) Ecological Status Applied to the Venice Lagoon (Italy)

1
ISPRA (Institute for Environmental Protection and Research), Loc. Brondolo, 30015 Chioggia (Venice), Italy
2
ISPRA (Institute for Environmental Protection and Research), via Vitaliano Brancati 60, 00144 Rome, Italy
3
Department of Environmental Sciences, Informatics & Statistics, University of Venice Ca’ Foscari, via Torino 155, 30170 Ve-Mestre (Venice), Italy
4
ARPAV (Environmental Prevention and Protection Agency of Veneto Region), via Ospedale Civile 24, 35121 Padova, Italy
*
Author to whom correspondence should be addressed.
Water 2019, 11(8), 1572; https://doi.org/10.3390/w11081572
Submission received: 8 July 2019 / Revised: 24 July 2019 / Accepted: 26 July 2019 / Published: 29 July 2019
(This article belongs to the Special Issue Ecological Status Assessment of Transitional Waters)

Abstract

:
The Water Framework Directive (WFD) requires Member States to assess the ecological status of water bodies and provide an estimation of the classification confidence and precision. This study tackles the issue of the uncertainty in the classification, due to the spatial variability within each water body, proposing an analysis of the reliability of classification, using the results of macrophyte WFD monitoring in the Venice Lagoon as case study. The level of classification confidence, assessed for each water body, was also used as reference to optimize the sampling effort for the subsequent monitorings. The ecological status of macrophytes was calculated by the Macrophyte Quality Index at 114 stations located in 11 water bodies. At water body scale, the level of classification confidence ranges from 54% to 100%. After application of the multi-approach (inferential statistics, spatial analyses, and expert judgment), the optimization of the sampling effort resulted in a reduction of the number of stations from 114 to 84. The decrease of sampling effort was validated by assessing the reliability of classification after the optimization process (54–99%) and by spatial interpolation of data (Kernel standard error of 22.75%). The multi-approach proposed in this study could be easily applied to any other water body and biological quality element.

1. Introduction

The Water Framework Directive (WFD) [1] is a framework by European Commission that requires Member States to monitor each relevant biological quality element (BQE) in order to assess the ecological status of each water body (WB), which represents the classification and management unit of the WFD [2]. Macroalgae, phanerogams, macroinvertebrates, and fish faunal are the BQEs to be evaluated for the assessment of the ecological status of European transitional WBs under the WFD. In addition to BQEs, the physicochemical and hydromorphological supporting elements contribute to the ecological classification, confirming or not the classification provided by the BQEs. Biological monitoring results have to be expressed as ecological quality ratios (EQRs), by comparing sampled data with those equivalents from undisturbed or minimally disturbed reference sites. Depending on the scale of deviation from reference conditions, the EQR range is divided into five status classes: High, good, moderate, poor, and bad. The most important distinction is between good and moderate status: the first is defined as a “slight deviation from reference condition”, whilst the latter is a “moderate deviation from reference conditions”. When the quality status is less than good, Member States/River Basin District Authorities must adopt a plan of measures to improve a WB until good status is achieved [1,2].
The WFD also requires all Member States to provide information about the estimation of the confidence interval and precision attained by the monitoring system used in their classification [1] (Annex V). As the critical good/moderate boundary can require expensive remedial measures to be included in the River Basin Management Plan, it is important that water body monitoring and management organizations estimate the confidence to which an individual WB can be assigned to an ecological status class [3]. The biological, physical, and chemical data from current monitoring programs underlie large sources of uncertainty, which can be partitioned into spatial variations, temporal variations, sampling, and analytical errors, in addition to the uncertainty introduced by the classification system, especially by the reference conditions [4]. Some authors proposed assessment systems based on statistical principles to provide information on the level of confidence and precision of monitoring program results, focusing on field sampling variability and laboratory procedures and protocols [3,4,5,6,7]. Mascarò et al. [8] investigated the sources of variability associated with sampling design of a selection of macrophyte-based (both macroalgae and seagrasses) monitoring programs and observed that uncertainty is mainly affected by spatial variation. The authors consequently suggested that spatial uncertainty analyses be performed to optimize sampling strategy and to improve the reliability of classification of ecological status [8].
The MaQI (Macrophyte Quality Index) is the macrophyte index adopted by the Italian Law (Italian Ministry decree 260/2010) in agreement with the WFD requirements for ecological classification in transitional waters, and it was successfully intercalibrated in the framework of the WFD intercalibration exercise [9]. The MaQI was applied to assess the ecological status by macrophyte assemblages in the Venice Lagoon, Italy’s largest wetland and one of the most important coastal ecosystems in the whole Mediterranean basin [10,11,12]. During the first cycle of the WFD operational monitoring, 114 stations were monitored in the Venice Lagoon. The ecological status classification of the Lagoon, resulting from the above monitoring, has been adopted by Veneto Region as published as Decision n. 140/2014 in the first revision of the Management Plan of the hydrographic district of the Eastern Alps [10]. However, for subsequent assessments, due to limitations of budget, optimization of the monitoring strategy was needed. Reducing monitoring efforts is a common consequence of cuts in government spending, adopted by many countries to save money in order to face the current global crisis [13]. Therefore, the balance between sampling effort and classification confidence becomes a critical issue in implementing the WFD [14,15].
In this context, the aim of this study was first to assess the reliability of ecological status classification in transitional waters, using results from monitoring of macrophyte assemblages in the Venice Lagoon, as a case study. Then, a multi-approach method to optimize the monitoring strategies minimizing both sampling effort and risk of misclassification was proposed, based on inferential statistical principles, geostatistical analyses, and expert judgment.

2. Materials and Methods

2.1. Study Area

The Venice Lagoon is a shallow water body of about 550 km2, located in the north-eastern part of Italy (Figure 1). It has an average depth of approximately 1.1 m, and it is characterized by a variety of aquatic and terrestrial habitats, such as canals, shoals, salt-marshes and islands [16]. According to the WFD, the Venice Lagoon is a large coastal microtidal lagoon, divided into 11 natural WBs and 3 heavily modified WBs [10]. In 2011, during the first cycle of the WFD Operational Monitoring, 114 stations, spread within the 11 natural WBs of the Venice Lagoon, were sampled to assess the ecological status by macrophyte assemblages (Figure 1). The dataset analyzed during the current study is available online at Environmental prevention and protection agency of Veneto Region (ARPAV) web portal [17]. For the classification of the BQE macrophytes, the MaQI [9] was used.

2.2. Reliability of Classification at Water Body Scale

The classification of the macrophyte assemblage at WB scale was obtained by averaging the MaQI EQRs of all stations within each WB (j).
First, the confidence interval (L) was also calculated for each WB (j) by the following formula:
L j   = t N j 1 , α 2   S j N j
where t N j 1 , α 2 is the critical value of the t-student distribution for the confidence level 1−α (two tiled distribution); Sj is the standard deviation of the EQRs within each WB; Nj is the number of stations within each WB. In this study, the confidence intervals were stated at the 95% confidence level (α = 0.05).
The L value provides an overall view of the confidence of the mean EQRs, but it does not take into account the closeness of the face value to the class boundaries, being independent from the WFD classification system. Therefore, the reliability of the classification was assessed in terms of probabilities that the observed ecological status classification (sample mean) lies within the right class. The cumulative probability that the actual (population) mean value of MaQI fell in each status class was assessed by t-student distribution. Data normality was tested by the Kolmogorov–Smirnov test whilst the absence of autocorrelations was verified by variogram analyses and Moran’s test of autocorrelation. Classes were identified by the WFD boundaries reported by the Italian Ministry decree 260/2010 (high/good = 0.8, good/moderate = 0.6, moderate/poor = 0.4, poor/bad = 0.2). The confidences related to the critical boundary good/moderate were also calculated by the sum of probability of classes being lower/higher than good.
Statistics were carried out using the R software [18].

2.3. Optimization of Sampling Effort

2.3.1. Statistical Approach

The relationship between the sampling effort (N of stations) and the classification confidence (confidence interval “L” and level “α”) was investigated by the following equation applied to each WB of the Venice Lagoon:
N = t N j 1 , α 2 2   S j 2 L 2 .
Three scenarios with different L values were investigated. The first two L values were selected considering the relationship between the width of the confidence interval, the distance between the class boundaries, and the maximum error of classification. Italian normative (Italian Ministry Decree 260/2010) provides equidistant boundaries for MaQI EQR (bad/poor = 0.2; poor/moderate = 0.4; moderate/good = 0.6; good/high = 0.8), therefore the width of the classes is 0.2. As a consequence, L = 0.1 (L0.1) entails a maximum error of one ecological class at only one direction (1st scenario), whilst L = 0.2 (L0.2) entails a maximum error of one ecological class at both directions (2nd scenario).
Finally, the mean confidence interval (Lmean) was calculated as average L of all WBs and applied to each WB (3rd scenario), in order to obtain a more consistent (homogeneous) classification confidence between WBs within the Venice Lagoon.

2.3.2. Expert Judgment Criteria

Starting from the three above-mentioned statistical scenarios, a two-step expert judgment analysis was applied to define the final optimization of monitoring effort (number of stations), based on level of confidence and hydromorphological features.
First of all, a suitable L value (Lopt) was defined in order to ensure higher homogeneity between WBs with an acceptable minimum level of reliability. Accordingly, to calculate N by Equation (2) for each WB, the following rules were adopted:
(a)
If Lmean < Lj < 0.2 (i.e., maximum error of one ecological class at both directions), then Nnew = Nold;
(b)
If Lj > 0.2, then Equation (2) is calculated with Lopt = 0.2;
(c)
If Lj < Lmean, then Equation (2) is calculated with Lopt = Lmean.
The risk of misclassification in relation to the critical boundary G/M was also considered.
Finally, the whole dimension and the hydrological and morphological heterogeneity within each WB were also taken into account, to avoid an oversized number of stations in small WBs or, vice versa, an excessive reduction in large WBs. Table 1 summarizes the elements considered for each WB of the Venice Lagoon.

2.4. Validation Method

2.4.1. Reliability Assessment

First, the reliability of classification related to the critical boundary good/moderate was recalculated for each WB using the dataset obtained from the optimization process. The analyses were carried out as reported in Section 2.2 by calculating the cumulative probability of Student’s t-distribution.

2.4.2. Spatial Analyses

To estimate the error in the sampling effort reduction, spatial interpolations of the two (original and reduced) monitoring networks of the whole Venice Lagoon were performed by Kernel interpolation with barrier available in the ArcMap toolbox of ArcGIS Desktop 10.1 (http://esri.com). Barriers were represented by islands and salt-marshes (Figure 1). Exponential equations were used during the regression analysis as Kernel function, while the other parameters were optimized by default in ArcMap. Mean prediction errors and root-mean-square errors (cross-validation) were calculated to test the interpolation maps obtained. The relative error (RE) reduction was computed by the modified formula reported by [19]:
R E ( % ) = K B S E o r i g i n a l K B S E r e d u c e d K B S E o r i g i n a l × 100
where KBSEoriginal and KBSEreduced are the Kernel standard error of the MaQI network of 2011 (original) and the new one (reduced), respectively.
Finally, for each WB, the ecological classes resulted by the original network and the reduced one were also calculated by averaging the interpolated EQR values of all Kernel interpolation grid cells. The significance of the differences between the two networks were tested using Student’s t-test.

3. Results

3.1. Reliability Assessment

The probability that the actual mean value of MaQI EQRs fell within each of the five WFD classes, assessed by the Student’s t-distributions; MaQI EQRs and status classifications; confidence interval (Lj), computed by Equation (1); and the cumulative probability related to the critical boundary G/M are shown for each WB in Table 2.
The Venice Lagoon mean L value (Lmean) used for the following analyses was 0.109.
The WB ENC3 was left out from analyses because of its very small surface, its urban features, and the low number of stations (N = 3) that affected the meaning of statistical elaborations.

3.2. Optimization of Sampling Effort

The number of stations (N) resulted by the application of the statistical approach (Equation (2)) with the three scenarios (i.e., considering L = 0.1, L = 0.2, and L = Lmean) changed from 111 (2011 sampling) to 169 (L = 0.1), 54 (L = 0.2), and 147 (L = Lmean), respectively (Table 3). After emendation by the two steps of expert judgment, following criteria described in Section 2.3.2, 81 stations were proposed for future monitoring.
Briefly, no modifications of the number of stations were made to EC and ENC4 as their Lj values (0.143 and 0.179, respectively) were higher than Lmean but lower than 0.2 (rule (a)).
Rule (c) was strictly adopted at PC2, PC3, and PC4 since their L values (0.066, 0.057, and 0.049, respectively) were lower than Lmean. Accordingly, the four stations to be maintained at PC2 were selected on the basis of the presence of salt-marshes and the small canals, which characterize the WB; the three stations deleted at PC3 were chosen from those on the most southern part of the WB, where several restoration activities, such as the construction of artificial salt-marshes, are underway to replace shallow waters available just before; and finally, the three stations maintained at PC4 were those mostly located in the middle of the WB.
The other WBs needed the expert judgment as following. A small or no reduction of monitoring effort was done for ENC1, ENC2, PC1, PNC1, and PNC2 due to their dimensions (Table 1), habitat heterogeneity (Table 1 and Figure 2), and their reliability of the classification (Table 3). Accordingly, five stations with spatially redundant information were deleted at ENC1, the largest WB of the Venice Lagoon, with several canals and two Lagoon inlets (Malamocco and Chioggia) and 97.7% of probability to be good or more. No modifications were done at ENC2, due to its very small dimension and high reliability of classification (84.3% of probability to be less than good). Regarding PC1, three stations were not considered to be sufficient to correctly represent, since it consists of large expanses of salt-marshes, the Dese river mouth, and several small canals that divide it mainly into four areas. No modifications were made for PNC1, which is located between the industrial area of Porto Marghera and the city of Venice; it is quite homogenous (Lj = 0.045), but it is separated into five sections by the presence of six canals. The morphological characteristics of PNC2 are quite similar to PNC1 with the airport of Venice on the north-west side and Murano and Sant’Erasmo islands on the south-east side. Considering its high reliability of the status classification (100% less than good), one station, located in the middle of the WB, was deleted. Finally, a special approach was adopted for ENC3, which was excluded from the optimization process because no more than three stations could be sampled there, due to its very small dimension, the presence of Chioggia island in the middle of the WB, and the proximity to the Lagoon inlet of Chioggia.
After application of the optimization process, the final number of stations established for the subsequent monitoring programs of the 11 natural WBs (including 3 stations of ENC3) of the Venice Lagoon was 84 (Figure 2).

3.3. Validation Process

The classification reliabilities resulted with the reduced network and comparisons with the MaQI network of 2011 (original network) are shown for each WB in Table 4. The change in probability that the quality status calculated with the reduced network is less than good and differences with the 2011 MaQI network are also reported.
Figure 3 shows the two maps produced by Kernel interpolation with barrier for the MaQI network of 2011 and the new one, respectively. Prediction errors are reported in Table 5. From Equation (3), an RE of 22.75% resulted.
Comparisons (Student’s t-test) between status classifications of each WB before and after the reduction of sampling effort are reported in Figure 4. To test the differences, values were extrapolated from each Kernel interpolation map.

4. Discussion

In this study, an analysis of reliability of the ecological status classification resulted by monitoring macrophyte assemblages according to the WFD in the Venice Lagoon was proposed and discussed in relation to monitoring effort review.
Previous theoretical studies proposed mixed models to estimate uncertainties in monitoring data, considering numerous different sources of variation that could affect an indicator, from the uncertainty related to sampling and analysis, to spatial and temporal variations and their interactions. However, when real data were considered, if some sources of uncertainty were small, they were disregarded by analysis [20,21,22,23,24,25,26]. In the current study, temporal variations were not considered, as the application of the MaQI index foresees to merge both spring and autumnal data collected in the year of monitoring, avoiding contribution from intra-annual variations to uncertainty [9]. Uncertainties associated with sampling and analysis methodology were excluded as the same laboratory staff was involved in the whole campaign at all activities, strictly following national protocols. Accordingly, only spatial variations were considered, also taking into account the practical need to reduce monitoring effort. However, when uncertainty is estimated from a larger dataset, pooling observations from multiple ecosystems with similar characteristics, with several spatial, temporal, and analytical method variations, it might be desirable to quantify every component at different scales [3,22]. In addition, as soon as data from subsequent monitoring cycles are available, inter-annual variability may also be assessed [7,24,25,26].
In the current study, the reliability of classification was assessed in terms of probabilities that the observed ecological status classification (mean value at WB scale) lies inside the right class, i.e., inside the class assigned from the index. Spatial variations were estimated by the confidence interval: higher values resulted at ENC2, a small WB characterized by high hydromorphological, and pressure gradient from Lido inlet to Venice island. Lower values were mostly observed at polyhaline WBs (annual mean of salinity < 30), such as PC1, PC2, and PC3, which are mainly characterized by lower internal ecological variability. By Student’s t-distribution, the probability that the actual mean value of MaQI EQRs of each WB fell within each one of the five WFD classes ranged between 53.9% and 99.6%. However, it should be considered that the confidence interval itself is not sufficient to determine the risk of misclassification. The uncertainty is in fact determined both by the width of the confidence interval and by the proximity of the mean to the class boundary and in particular to the critical threshold good/moderate. Anyway, considering the critical good/moderate boundary, which is important for making decision about measures by governments, results highlighted a satisfactory reliability of the WFD MaQI classification of 2011 (83–100%).
From results of the estimation of confidence, it was possible to investigate where a reduction of the monitoring network effort could be allowed, avoiding excessively increasing the risk of misclassification. Recent studies proposed, for monitoring programs assessing status of WBs, to identify the optimal allocation of samples in time and space, through the quantification of the different uncertainty components affecting monitoring data [22,23]. As reported above, in this study, the main factors affecting the reliability of MaQI results were spatial variations, therefore changes focused only on the number and location of sampling stations.
Again, statistical principles offer relatively simple and suitable tools to address the optimization of sampling effort, providing a quantitative and objective assessment of the impact of sampling strategy on the risk of misclassification. On the other hand, results of statistical analysis require a careful analysis before their application and the operative choice is likely to benefit from including a final revision by expert judgment. Indeed, this study highlighted as the purely statistical approach, based on the amplitude of the interval of confidence, could lead to not-applicable or meaningless results. For instance, according to the first scenario (L = 0.1), to reduce the L value of the WB ENC2 from 0.27 to 0.1, the number of stations should increase from 7 to 51. Considering that the sampleable area of ENC2 is about 10 km2, it means five stations per km2, an effort unachievable in the framework of Institutional monitoring and far away from the concept of “optimization”. Under scenario L = 0.1, more than one station per km2 would be also required within WB ENC4, and similar issues of incoherence, in case of the strictly application of statistical approach, are observed in the scenario L = Lmean. Conversely, the application of the second scenario (L = 0.2) resulted in very little restriction for some large WBs, especially those with lower standard deviations. For instance, under this scenario, the number of stations within the WB ENC1 decreased from 26 to 8 (1 station for 13.5 km2). All these evaluations are obviously linked to real data. However, there could be contexts where statistical results are confirmed even after expert judgment.
Accordingly, a revision process by expert judgment is essential. Intrinsically, the expert judgment is difficult to standardize and it introduces subjectivity into the evaluation. Therefore, it is crucial to guarantee maximum transparency on the followed criteria and later provide an objective estimation (validation) of the impact of the choices. In this study, the expert judgment followed the criteria described in Section 2.3.2 and Section 3.2, and it aims (i) to homogenize the reliability of classification between WBs, (ii) to ensure for all WBs a minimum efficient reliability, (iii) to ensure a high reliability of the status classification regarding the critical boundary good/moderate, and (iv) to consider other particular elements of each WB such as dimensions, and hydrological and morphological characteristics.
To ensure the validation process, spatial interpolation of data was performed. Geostatistical techniques are based on the hypothesis that nearer observations are more similar to one another than to distant observations, and therefore allow you not only to insert new points where knowledge is more approximate, but also to eliminate others in those where they are redundant [27]. Furthermore, mathematical variogram models could assess the reductions of sampling effort by interpolations. Previous attempts to validate optimal locations of monitoring networks were performed adopting specific variogram models, such as in ordinary Kriging or Bayesian maximum entropy, depending on characteristics of their study areas [19,28]. The Venice Lagoon is a complex transitional area characterized by a composite mosaic of canals, salt-marshes, mud and sand intertidal flats, shoals, man-made structures, and islands [29,30]. Accordingly, spatial interpolations of the MaQI EQRs were performed by applying Kernel interpolation with barrier. The choice of this model, rather than others, was made in order to obtain interpolations of data which reflect the morphology of the Venice Lagoon, therefore with the presence of breaklines. Cross-validation results of both interpolations confirmed the right choice of the model, as mean prediction errors tended to be zero and quite small root-mean-square errors were observed. Moreover, both mean prediction errors resulted positive, which indicated that both models slightly overestimated the data [31], with relatively better results in the MaQI network of 2011 rather than in that reduced. To quantify the relative error of the reduced MaQI network, standard errors of the two interpolations were related by the formula of [19] modified using Kernel standard errors instead of Kriging.
In summary, results of the monitoring effort review of the WFD MaQI network of the Venice Lagoon showed a relative error of 22.7%, which can be considered acceptable taking into account the total reduction of stations of 26.3%. To evaluate the optimization process, Adhikary et al. [19] reported values below 30% as acceptable as considering the zero trend as a criterion. In order to obtain a more objective assessment, we performed a further check to validate the optimization process. As the aim of this study was also to avoid risk of misclassification, we extrapolated, both from the Kernel interpolation map of the original and the reduced networks, the EQR values of each WB. Then, results of each WB were tested by Student’s t-test to verify that the reduction had no significantly modified from the original network. All comparisons did not significantly differ, except for PC1, PC3, and PNC1. Moreover, the classification results were not affected by the optimization process at all WBs.

5. Conclusions

From the statistical analyses, it appears that the first results of the WFD status classes of the Venice Lagoon obtained by macrophyte assemblages produced a satisfactory reliability and provided useful information about estimation of the confidence, which can be useful to management organizations to optimize resources for remedial measure adoption. Results also allowed proposing a reduction of the monitoring sampling effort, which definitely affects river basin management costs. For this purpose, a suitable multi-approach method based on inferential statistics, spatial analyses, and expert judgment was applied in this study, in order to review the sampling effort with the aim at ensuring and keeping on a high reliability of the status classification. Following the approaches described in this study, an increasing role of expert judgment could be observed: from a clear and strictly statistical approach based on L values a priori defined by ecological class amplitude, to a mixed method where Lopt was a posteriori defined for each WB, and resulting stations further emendated taking into account the site-specific characteristics. However, this study showed that a strictly statistical approach is obviously objective and standardized, but it could be unachievable with realistic data, since some results could lead to a waste of resource or vice versa to an excessive reduction of information. For these reasons, to optimize the monitoring effort, the inferential statistics were applied as a guideline, with the implementation of criteria arisen from expert knowledge of the area and the problem. Moreover, a robust process of validation was also proposed and adopted which definitively ensure on spatial reductions and reliability of information.
Apart from the complex nature of the Venice Lagoon, the multi-approach proposed in this study could also be applied to any other water body to assess the WFD classification reliability, and to optimize the monitoring effort to any other area.

Author Contributions

Conceptualization, R.B.B., P.P., F.C., and A.B.; methodology, F.C., A.B.; formal analysis, F.C., A.B., and E.P.; investigation, A.S.; resources, R.B.B., A.S., P.P. and M.G.; data curation, A.S., F.C., A.B., and M.N.; writing—original draft preparation, F.C.; writing—review and editing, A.B., R.B.B., A.S., and P.P.; visualization, F.C.; supervision, R.B.B.; project administration, R.B.B., M.G., and P.P.; funding acquisition, M.G., P.P., and R.B.B.

Funding

This work was supported by ARPAV in the framework of the Mo.V.Eco Project, funded by Veneto Region; contract of 31/01/2013 from the general agreement between ISPRA and ARPAV of 27/04/2012.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Water Framework Directive, European Union (WFD E.U.). Establishing a Framework for Community Action in the Field of Water Policy; Directive 2000/60/EC of the European Parliament and of the Council of 23 October 2000; EU: Brussels, Belgium, 2000. [Google Scholar]
  2. Arle, J.; Mohaupt, V.; Kirst, I. Monitoring of Surface Waters in Germany under the Water Framework Directive—A Review of Approaches, Methods and Results. Water 2016, 8, 217. [Google Scholar] [CrossRef]
  3. Clarke, R.T. Estimating confidence of European WFD ecological status class and WISER Bioassessment Uncertainty Guidance Software (WISERBUGS). Hydrobiologia 2013, 704, 39–56. [Google Scholar] [CrossRef]
  4. Carstensen, J. Statistical principles for ecological status classification of Water Framework Directive monitoring data. Mar. Pollut. Bull. 2007, 55, 3–15. [Google Scholar] [CrossRef] [PubMed]
  5. Clarke, R.T.; Hering, D. Errors and Uncertainty in Bioassessment Methods—Major Results and Conclusions from the STAR Project and their Application Using STARBUGS. In The Ecological Status of European Rivers: Evaluation and Intercalibration of Assessment Methods; Springer: Berlin/Heidelberg, Germany, 2006; Volume 188, pp. 433–439. [Google Scholar]
  6. Sundermann, A.; Pauls, S.U.; Clarke, R.T.; Haase, P. Within-stream variability of benthic invertebrate samples and EU Water Framework Directive assessment results. Fund Appl. Limnol. 2010, 173, 21–34. [Google Scholar] [CrossRef]
  7. Pasquaud, S.; Brind’Amour, A.; Berthelé, O.; Girardin, M.; Elie, P.; Boët, P.; Lepage, M. Impact of the sampling protocol in assessing ecological trends in an estuarine ecosystem: The empirical example of the Gironde estuary. Ecol. Indic. 2012, 15, 18–29. [Google Scholar] [CrossRef] [Green Version]
  8. Mascaró, O.; Alcoverro, T.; Dencheva, K.; Díez, I.; Gorostiaga, J.M.; Krause-Jensen, D.; Balsby, T.J.S.; Marbà, N.; Muxika, I.; Neto, J.M.; et al. Exploring the robustness of macrophyte-based classification methods to assess the ecological status of coastal and transitional ecosystems under the Water Framework Directive. Hydrobiologia 2013, 704, 279–291. [Google Scholar] [CrossRef]
  9. Sfriso, A.; Facca, C.; Bonometto, A.; Boscolo, R. Compliance of the macrophyte quality index (MaQI) with the WFD (2000/60/EC) and ecological status assessment in transitional areas: The Venice lagoon as study case. Ecol. Indic. 2014, 46, 536–547. [Google Scholar] [CrossRef]
  10. Progetto di Aggiornamento del Piano di Gestione del Distretto Idrografico delle Alpi Orientali—Secondo Ciclo di Pianificazione (2015–2021). Available online: http://www.alpiorientali.it/ (accessed on 29 July 2019).
  11. Maggi, C.; Ausili, A.; Boscolo, R.; Cacciatore, F.; Bonometto, A.; Cornello, M.; Berto, D. Sediment and biota to assess the trend monitoring of contaminants of transitional waters in the context of the Water Framework Directive: The Lagoon of Venice as a case study. TrAC Trends Anal. Chem. 2012, 36, 82–91. [Google Scholar] [CrossRef]
  12. Cacciatore, F.; Noventa, S.; Antonini, C.; Formalewicz, M.; Gion, C.; Berto, D.; Gabellini, M.; Brusà, R.B. Imposex in Nassarius nitidus (Jeffreys, 1867) as a possible investigative tool to monitor butyltin contamination according to the Water Framework Directive: A case study in the Venice Lagoon (Italy). Ecotoxicol. Environ. Saf. 2018, 148, 1078–1089. [Google Scholar] [CrossRef]
  13. Borja, Á.; Elliott, M. Marine monitoring during an economic crisis: The cure is worse than the disease. Mar. Pollut. Bull. 2013, 68, 1–3. [Google Scholar] [CrossRef] [Green Version]
  14. De Jonge, V.; Elliott, M.; Brauer, V. Marine monitoring: Its shortcomings and mismatch with the EU Water Framework Directive’s objectives. Mar. Pollut. Bull. 2006, 53, 5–19. [Google Scholar] [CrossRef] [PubMed]
  15. Jaanus, A.; Kuprijanov, I.; Kaljurand, K.; Lehtinen, S.; Enke, A. Optimization of phytoplankton monitoring in the Baltic Sea. J. Mar. Syst. 2017, 171, 65–72. [Google Scholar] [CrossRef]
  16. Umgiesser, G. Modelling the Venice Lagoon. Int. J. Salt Lake Res. 1997, 6, 175–199. [Google Scholar] [CrossRef]
  17. Environmental Prevention and Protection Agency of Veneto Region (ARPAV). Laguna di Venezia—Dati Macrofite—Anno 2011. Available online: http://www.webcitation.org/78gb8RPtp (accessed on 27 May 2019).
  18. R Core Team. R: A Language and Environment for Statistical Computing. Available online: https://www.R-project.org/ (accessed on 29 July 2019).
  19. Adhikary, S.K.; Yilmaz, A.G.; Muttil, N. Optimal design of rain gauge network in the Middle Yarra River catchment, Australia. Hydrol. Process. 2014, 29, 2582–2599. [Google Scholar] [CrossRef] [Green Version]
  20. Balsby, T.J.S.; Carstensen, J.; Krause-Jensen, D. Sources of uncertainty in estimation of eelgrass depth limits. Hydrobiologia 2013, 704, 311–323. [Google Scholar] [CrossRef]
  21. Dromph, K.M.; Agusti, S.; Basset, A.; Franco, J.; Henriksen, P.; Icely, J.; Lehtinen, S.; Moncheva, S.; Revilla, M.; Roselli, L.; et al. Sources of uncertainty in assessment of marine phytoplankton communities. Hydrobiologia 2013, 704, 253–264. [Google Scholar] [CrossRef]
  22. Carstensen, J.; Lindegarth, M. Confidence in ecological indicators: A framework for quantifying uncertainty components from monitoring data. Ecol. Indic. 2016, 67, 306–317. [Google Scholar] [CrossRef] [Green Version]
  23. Clarke, R.T.; Davy-Bowker, J.; Sandin, L.; Friberg, N.; Johnson, R.K.; Bis, B. Estimates and comparisons of the effects of sampling variation using ‘national’ macroinvertebrate sampling protocols on the precision of metrics used to assess ecological status. Hydrobiologia 2006, 566, 477–503. [Google Scholar] [CrossRef]
  24. De La Fuente, G.; Chiantore, M.; Gaino, F.; Asnaghi, V. Ecological status improvement over a decade along the Ligurian coast according to a macroalgae based index (CARLIT). PLoS ONE 2018, 13, e0206826. [Google Scholar] [CrossRef]
  25. Bennett, S.; Roca, G.; Romero, J.; Alcoverro, T. Ecological status of seagrass ecosystems: An uncertainty analysis of the meadow classification based on the Posidonia oceanica multivariate index (POMI). Mar. Pollut. Bull. 2011, 62, 1616–1621. [Google Scholar] [CrossRef]
  26. Torras, X.; Pinedo, S.; García, M.; Weitzmann, B.; Ballesteros, E. Environmental Quality of Catalan Coastal Waters Based on Macroalgae: The Interannual Variability of CARLIT Index and Its Ability to Detect Changes in Anthropogenic Pressures over Time. In The Handbook of Environmental Chemistry; Springer: Cham, Switzerland, 2015; pp. 183–199. [Google Scholar]
  27. Goovaerts, P. Geostatistics for Natural Resources Evaluation, Applied Geostatistics Series, 1st Edition; Oxford University Press: Oxford, UK, 1997; p. 483. [Google Scholar]
  28. Bayat, B.; Hosseini, K.; Nasseri, M.; Karami, H. Challenge of rainfall network design considering spatial versus spatiotemporal variations. J. Hydrol. 2019, 574, 990–1002. [Google Scholar] [CrossRef]
  29. Ferrarin, C.; Ghezzo, M.; Umgiesser, G.; Tagliapietra, D.; Camatti, E.; Zaggia, L.; Sarretta, A. Assessing hydrological effects of human interventions on coastal systems: numerical applications to the Venice Lagoon. Hydrol. Earth Syst. Sci. Discuss. 2012, 9, 13839–13878. [Google Scholar] [CrossRef]
  30. Scapin, L.; Zucchetta, M.; Bonometto, A.; Feola, A.; Brusà, R.B.; Sfriso, A.; Franzoi, P. Expected Shifts in Nekton Community Following Salinity Reduction: Insights into Restoration and Management of Transitional Water Habitats. Water 2019, 11, 1354. [Google Scholar] [CrossRef]
  31. Lessio, F.; Tota, F.; Alma, A. Tracking the dispersion of Scaphoideus titanus Ball (Hemiptera: Cicadellidae) from wild to cultivated grapevine: use of a novel mark–capture technique. Bull. Èntomol. Res. 2014, 104, 432–443. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The Venice Lagoon map with its morphological and hydrological characteristics, and the WFD (Water Framework Directive) MaQI (Macrophyte Quality Index [8]) classification in 2011. Names of water bodies (WBs) are indicated in uppercase bold characters; place names are in lowercase. Final assessment of each WB is labeled like for stations: blue for high, green for good, yellow for moderate, orange for poor, red for bad status classes.
Figure 1. The Venice Lagoon map with its morphological and hydrological characteristics, and the WFD (Water Framework Directive) MaQI (Macrophyte Quality Index [8]) classification in 2011. Names of water bodies (WBs) are indicated in uppercase bold characters; place names are in lowercase. Final assessment of each WB is labeled like for stations: blue for high, green for good, yellow for moderate, orange for poor, red for bad status classes.
Water 11 01572 g001
Figure 2. MaQI (Macrophyte Quality Index) network of 2011 (MaQI stations 2011) and the new network (new MaQI stations) with reduced number of stations by the multi-approach application. Crossed stations are those deleted.
Figure 2. MaQI (Macrophyte Quality Index) network of 2011 (MaQI stations 2011) and the new network (new MaQI stations) with reduced number of stations by the multi-approach application. Crossed stations are those deleted.
Water 11 01572 g002
Figure 3. Kernel interpolation maps for (a) the MaQI (Macrophyte Quality Index) network of 2011 and (b) the new one with reduced station of 2011 from 114 to 84.
Figure 3. Kernel interpolation maps for (a) the MaQI (Macrophyte Quality Index) network of 2011 and (b) the new one with reduced station of 2011 from 114 to 84.
Water 11 01572 g003
Figure 4. Box plots of water body values resulted by the two Kernel interpolation maps of the original (Orig.) and reduced (Reduc.) networks. Results of Student’s t tests are also given (n.s. = not significance, p > 0.05; * = p < 0.05; ** = 0.5 < p < 0.01; *** = 0.01 < p < 0.001). Note: blue line (first from the top) is the high/good boundary, green line (second from the top) is the good/moderate boundary, orange line (third from the top) is the moderate/poor boundary, red line (fourth from the top) is the poor/bad boundary.
Figure 4. Box plots of water body values resulted by the two Kernel interpolation maps of the original (Orig.) and reduced (Reduc.) networks. Results of Student’s t tests are also given (n.s. = not significance, p > 0.05; * = p < 0.05; ** = 0.5 < p < 0.01; *** = 0.01 < p < 0.001). Note: blue line (first from the top) is the high/good boundary, green line (second from the top) is the good/moderate boundary, orange line (third from the top) is the moderate/poor boundary, red line (fourth from the top) is the poor/bad boundary.
Water 11 01572 g004
Table 1. Dimension and hydrological and morphological characteristics considered for each water body (WB) during the optimization of the monitoring sampling effort of the Venice Lagoon.
Table 1. Dimension and hydrological and morphological characteristics considered for each water body (WB) during the optimization of the monitoring sampling effort of the Venice Lagoon.
WBWhole Dimension (km2)Hydrological and Morphological Characteristics (dimension, km2)
EC49.10salt-marshes (4.17), canals (0.54)
ENC1134.71salt-marshes (6.08), canals (20.62)
ENC220.15salt-marshes (0.34), canals (10.14)
ENC34.48canals (2.09)
ENC426.75canals (2.64)
PC127.64salt-marshes (6.44), canals (3.41)
PC250.44salt-marshes (0.87), canals (3.95)
PC310.04salt-marshes (2.28), canals (1.08)
PC421.05salt-marshes (0.81), canals (2.98)
PNC132.93salt-marshes (1.48), canals (3.17)
PNC231.53salt-marshes (3.44), canals (2.68)
Table 2. MaQI (Macrophyte Quality Index) status class results, confidence, and reliability of classification of each WB (water body) of the Venice Lagoon.
Table 2. MaQI (Macrophyte Quality Index) status class results, confidence, and reliability of classification of each WB (water body) of the Venice Lagoon.
WBMaQI EQRs (mean ± st. dev.)MaQI ClassificationClassification Confidence (Lj)Classification Reliability (%)Probability to be Less than Good (%)
BadPoorModerateGoodHigh
EC0.408 ± 0.236Moderate0.1430.4544.9953.890.67099.33
ENC10.715 ± 0.280Good0.113002.2890.956.772.28
ENC20.479 ± 0.293Moderate0.2712.2722.9459.0514.371.3784.26
ENC40.520 ± 0.250Moderate0.1790.148.0074.9916.560.3183.13
PC10.317 ± 0.071Poor0.0540.0699.560.3800100
PC20.350 ± 0.104Poor0.0660.0293.716.2700100
PC30.300 ± 0.055Poor0.0570.3399.340.3300100
PC40.307 ± 0.053Poor0.0490.0999.720.1900100
PNC10.314 ± 0.067Poor0.0450.0199.90.0900100
PNC20.270 ± 0.160Poor0.11510.0288.461.5200100
Table 3. Results of the application of the statistical approach and expert judgement criteria to optimize the sampling effort in the MaQI (Macrophyte Quality Index) monitoring program of the Venice Lagoon.
Table 3. Results of the application of the statistical approach and expert judgement criteria to optimize the sampling effort in the MaQI (Macrophyte Quality Index) monitoring program of the Venice Lagoon.
WBNoriginalStatistical ApproachExpert Judgment Criteria
NL = 0.1NL = 0.2NL = LmeanNL = LoptNnew
EC132672213 (a)13
ENC1263382826 (a)21
ENC2751134313 (b)7
ENC4103282710 (a)10
PC1933*3*3 (c)6
PC21253*44 (c)4
PC3623*3*3 (c)3
PC4723*3*3 (c)3
PNC11123*3*3 (c)5
PNC2101331110 (a)9
Total111169541478881
Keys: ‘Noriginal’ = original number of stations sampled in 2011, ‘NL = Lmean’ = number of stations resulted by Equation (2) with Lmean (0.109), ‘NL = Lopt’ = number of stations resulted by Equation (2) with a suitable L value (Lopt) deriving from rules (a), (b) and (c), ‘Nnew’ = number of stations considering also elements of Table 1, ‘3*’ = a default N of 3 was given, when the application of Equation (2) resulted as N < 2, since standard deviation tends to be zero.
Table 4. Reliability of classification of each water body (WB) of the Venice Lagoon after the optimization process (new network) and comparison with the original monitoring network results.
Table 4. Reliability of classification of each water body (WB) of the Venice Lagoon after the optimization process (new network) and comparison with the original monitoring network results.
WBNumber of StationsClassification Reliability (%)Probability to be Less than Good (%)
Reduced NetworkDifferences from the Original NetworkReduced NetworkDifferences from the Original NetworkReduced NetworkDifferences from the Original Network
EC13053.89% Moderate099.330
ENC121−586.59% Good−4.362.940.66
ENC27059.05% Moderate084.260
ENC410074.99% Moderate083.130
PC16−396.41% Poor−3.1599.98−0.02
PC24−896.35% Poor2.6499.92−0.08
PC33−389.9% Poor−9.4499.34−0.66
PC43−489.9% Poor−9.8299.34−0.66
PNC15−698.61% Poor−1.2999.99−0.01
PNC29−182.88% Poor−5.5899.99−0.01
Table 5. Regression functions and prediction errors resulted by Kernel interpolation with barrier for the MaQI network of 2011 (original network) and the new one (reduced network).
Table 5. Regression functions and prediction errors resulted by Kernel interpolation with barrier for the MaQI network of 2011 (original network) and the new one (reduced network).
Original Network (N = 114)Reduced Network (N = 84)
Mean prediction error0.0000470.005881
Root-mean-square error0.2130.189
Average standard error0.2340.190

Share and Cite

MDPI and ACS Style

Cacciatore, F.; Bonometto, A.; Paganini, E.; Sfriso, A.; Novello, M.; Parati, P.; Gabellini, M.; Boscolo Brusà, R. Balance between the Reliability of Classification and Sampling Effort: A Multi-Approach for the Water Framework Directive (WFD) Ecological Status Applied to the Venice Lagoon (Italy). Water 2019, 11, 1572. https://doi.org/10.3390/w11081572

AMA Style

Cacciatore F, Bonometto A, Paganini E, Sfriso A, Novello M, Parati P, Gabellini M, Boscolo Brusà R. Balance between the Reliability of Classification and Sampling Effort: A Multi-Approach for the Water Framework Directive (WFD) Ecological Status Applied to the Venice Lagoon (Italy). Water. 2019; 11(8):1572. https://doi.org/10.3390/w11081572

Chicago/Turabian Style

Cacciatore, Federica, Andrea Bonometto, Elisa Paganini, Adriano Sfriso, Marta Novello, Paolo Parati, Massimo Gabellini, and Rossella Boscolo Brusà. 2019. "Balance between the Reliability of Classification and Sampling Effort: A Multi-Approach for the Water Framework Directive (WFD) Ecological Status Applied to the Venice Lagoon (Italy)" Water 11, no. 8: 1572. https://doi.org/10.3390/w11081572

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop