Neal R. Haddaway

The Role of Google Scholar in Evidence Reviews and Its Applicability to Grey Literature Searching.

Google Scholar (GS), a commonly used web-based academic search engine, catalogues between 2 and 100 million records of both academic and grey literature (articles not formally published by commercial academic publishers). Google Scholar collates results from across the internet and is free to use. As a result it has received considerable attention as a method for searching for literature, particularly in searches for grey literature, as required by systematic reviews. The reliance on GS as a standalone resource has been greatly debated, however, and its efficacy in grey literature searching has not yet been investigated. Using systematic review case studies from environmental science, we investigated the utility of GS in systematic reviews and in searches for grey literature. Our findings show that GS results contain moderate amounts of grey literature, with the majority found on average at page 80. We also found that, when searched for specifically, the majority of literature identified using Web of Science was also found using GS. However, our findings showed moderate/poor overlap in results when similar search strings were used in Web of Science and GS (10–67%), and that GS missed some important literature in five of six case studies. Furthermore, a general GS search failed to find any grey literature from a case study that involved manual searching of organisations’ websites. If used in systematic reviews for grey literature, we recommend that searches of article titles focus on the first 200 to 300 results. We conclude that whilst Google Scholar can find much grey literature and specific, known studies, it should not be used alone for systematic review searches. Rather, it forms a powerful addition to other traditional search methods. In addition, we advocate the use of tools to transparently document and catalogue GS search results to maintain high levels of transparency and the ability to be updated, critical to systematic reviews.

Ecological impacts of an invasive predator explained and predicted by comparative functional responses

Forecasting the ecological impacts of invasive species is a major challenge that has seen little progress, yet the development of robust predictive approaches is essential as new invasion threats continue to emerge. A common feature of ecologically damaging invaders is their ability to rapidly exploit and deplete resources. We thus hypothesized that the ‘functional response’ (the relationship between resource density and consumption rate) of such invasive species might be of consistently greater magnitude than those of taxonomically and/or trophically similar native species. Here, we derived functional responses of the predatory Ponto-Caspian freshwater ‘bloody red’ shrimp, Hemimysis anomala, a recent and ecologically damaging invader in Europe and N. America, in comparison to the local native analogues Mysis salemaai and Mysis diluviana in Ireland and Canada, respectively. This was conducted in a novel set of experiments involving multiple prey species in each geographic location and a prey species that occurs in both regions. The predatory functional responses of the invader were generally higher than those of the comparator native species and this difference was consistent across invaded regions. Moreover, those prey species characterized by the strongest and potentially de-stabilizing Type II functional responses in our laboratory experiments were the same prey species found to be most impacted by H. anomala in the field. The impact potential of H. anomala was further indicated when it exhibited similar or higher attack rates, consistently lower prey handling times and higher maximum feeding rates compared to those of the two Mysis species, formerly known as ‘Mysis relicta’, which itself has an extensive history of foodweb disruption in lakes to which it has been introduced. Comparative functional responses thus merit further exploration as a methodology for predicting severe community-level impacts of current and future invasive species and could be entered into risk assessment protocols.

Human well-being impacts of terrestrial protected areas

BackgroundEstablishing Protected Areas (PAs) is among the most common conservation interventions. Protecting areas from the threats posed by human activity will by definition inhibit some human actions. However, adverse impacts could be balanced by maintaining ecosystem services or introducing new livelihood options. Consequently there is an ongoing debate on whether the net impact of PAs on human well-being at local or regional scales is positive or negative. We report here on a systematic review of evidence for impacts on human well-being arising from the establishment and maintenance of terrestrial PAs.MethodsFollowing an a priori protocol, systematic searches were conducted for evidence of impacts of PAs post 1992. After article title screening, the review was divided into two separate processes; a qualitative synthesis of explanations and meaning of impact and a review of quantitative evidence of impact. Abstracts and full texts were assessed using inclusion criteria and conceptual models of potential impacts. Relevant studies were critically appraised and data extracted and sorted according to type of impact reported. No quantitative synthesis was possible with the evidence available. Two narrative syntheses were produced and their outputs compared in a metasynthesis.ResultsThe qualitative evidence review mapped 306 articles and synthesised 34 that were scored as high quality. The quantitative evidence review critically appraised 79 studies and included 14 of low/medium susceptibility to bias. The meta-synthesis reveals that a range of factors can lead to reports of positive and negative impacts of PA establishment, and therefore might enable hypothesis generation regarding cause and effect relationships, but resulting hypotheses cannot be tested with the current available evidence.ConclusionsThe evidence base provides a range of possible pathways of impact, both positive and negative, of PAs on human well-being but provides very little support for decision making on how to maximise positive impacts. The nature of the research reported to date forms a diverse and fragmented body of evidence unsuitable for the purpose of informing policy formation on how to achieve win-win outcomes for biodiversity and human well-being. To better assess the impacts of PAs on human well-being we make recommendations for improving research study design and reporting.

Predatory Functional Response and Prey Choice Identify Predation Differences between Native/Invasive and Parasitised/Unparasitised Crayfish

Background Invasive predators may change the structure of invaded communities through predation and competition with native species. In Europe, the invasive signal crayfish Pacifastacus leniusculus is excluding the native white clawed crayfish Austropotamobius pallipes. Methodology and Principal Findings This study compared the predatory functional responses and prey choice of native and invasive crayfish and measured impacts of parasitism on the predatory strength of the native species. Invasive crayfish showed a higher (>10%) prey (Gammarus pulex) intake rate than (size matched) natives, reflecting a shorter (16%) prey handling time. The native crayfish also showed greater selection for crustacean prey over molluscs and bloodworm, whereas the invasive species was a more generalist predator. A. pallipes parasitised by the microsporidian parasite Thelohania contejeani showed a 30% reduction in prey intake. We suggest that this results from parasite-induced muscle damage, and this is supported by a reduced (38%) attack rate and increased (30%) prey handling time. Conclusions and Significance Our results indicate that the per capita (i.e., functional response) difference between the species may contribute to success of the invader and extinction of the native species, as well as decreased biodiversity and biomass in invaded rivers. In addition, the reduced predatory strength of parasitized natives may impair their competitive abilities, facilitating exclusion by the invader.

Making literature reviews more reliable through application of lessons from systematic reviews

Review articles can provide valuable summaries of the ever-increasing volume of primary research in conservation biology. Where findings may influence important resource-allocation decisions in policy or practice, there is a need for a high degree of reliability when reviewing evidence. However, traditional literature reviews are susceptible to a number of biases during the identification, selection, and synthesis of included studies (e.g., publication bias, selection bias, and vote counting). Systematic reviews, pioneered in medicine and translated into conservation in 2006, address these issues through a strict methodology that aims to maximize transparency, objectivity, and repeatability. Systematic reviews will always be the gold standard for reliable synthesis of evidence. However, traditional literature reviews remain popular and will continue to be valuable where systematic reviews are not feasible. Where traditional reviews are used, lessons can be taken from systematic reviews and applied to traditional reviews in order to increase their reliability. Certain key aspects of systematic review methods that can be used in a context-specific manner in traditional reviews include focusing on mitigating bias; increasing transparency, consistency, and objectivity, and critically appraising the evidence and avoiding vote counting. In situations where conducting a full systematic review is not feasible, the proposed approach to reviewing evidence in a more systematic way can substantially improve the reliability of review findings, providing a time- and resource-efficient means of maximizing the value of traditional reviews. These methods are aimed particularly at those conducting literature reviews where systematic review is not feasible, for example, for graduate students, single reviewers, or small organizations.

A methodology for systematic mapping in environmental sciences

Systematic mapping was developed in social sciences in response to a lack of empirical data when answering questions using systematic review methods, and a need for a method to describe the literature across a broad subject of interest. Systematic mapping does not attempt to answer a specific question as do systematic reviews, but instead collates, describes and catalogues available evidence (e.g. primary, secondary, theoretical, economic) relating to a topic or question of interest. The included studies can be used to identify evidence for policy-relevant questions, knowledge gaps (to help direct future primary research) and knowledge clusters (sub-sets of evidence that may be suitable for secondary research, for example systematic review). Evidence synthesis in environmental sciences faces similar challenges to those found in social sciences. Here we describe the translation of systematic mapping methodology from social sciences for use in environmental sciences. We provide the first process-based methodology for systematic maps, describing the stages involved: establishing the review team and engaging stakeholders; setting the scope and question; setting inclusion criteria for studies; scoping stage; protocol development and publication; searching for evidence; screening evidence; coding; production of a systematic map database; critical appraisal (optional); describing and visualising the findings; report production and supporting information. We discuss the similarities and differences in methodology between systematic review and systematic mapping and provide guidance for those choosing which type of synthesis is most suitable for their requirements. Furthermore, we discuss the merits and uses of systematic mapping and make recommendations for improving this evolving methodology in environmental sciences.

Evaluating effects of land management on greenhouse gas fluxes and carbon balances in boreo-temperate lowland peatland systems

BackgroundPeatlands cover 2 to 5 percent of the global land area, while storing between 30 and 50 percent of all global soil carbon (C). Peatlands constitute a substantial sink of atmospheric carbon dioxide (CO2) via photosynthesis and organic matter accumulation, but also release methane (CH4), nitrous oxide (N2O), and CO2 through respiration, all of which are powerful greenhouse gases (GHGs). Lowland peats in boreo-temperate regions may store substantial amounts of C and are subject to disproportionately high land-use pressure. Whilst evidence on the impacts of different land management practices on C cycling and GHG fluxes in lowland peats does exist, these data have yet to be synthesised. Here we report on the results of a Collaboration for Environmental Evidence (CEE) systematic review of this evidence.MethodsEvidence was collated through searches of literature databases, search engines, and organisational websites using tested search strings. Screening was performed on titles, abstracts and full texts using established inclusion criteria for population, intervention/exposure, comparator, and outcome key elements. Remaining relevant full texts were critically appraised and data extracted according to pre-defined strategies. Meta-analysis was performed where sufficient data were reported.ResultsOver 26,000 articles were identified from searches, and screening of obtainable full texts resulted in the inclusion of 93 relevant articles (110 independent studies). Critical appraisal excluded 39 studies, leaving 71 to proceed to synthesis. Results indicate that drainage increases N2O emission and the ecosystem respiration of CO2, but decreases CH4 emission. Secondly, naturally drier peats release more N2O than wetter soils. Finally, restoration increases CH4 release. Insufficient studies reported C cycling, preventing quantitative synthesis. No significant effect was identified in meta-analyses of the impact of drainage and restoration on DOC concentration.ConclusionsConsistent patterns in C concentration and GHG release across the evidence-base may exist for certain land management practices: drainage increases N2O production and CO2 from respiration; drier peats release more N2O than wetter counterparts; and restoration increases CH4 emission. We identify several problems with the evidence-base; experimental design is often inconsistent between intervention and control samples, pseudoreplication is common, and variability measures are often unreported.

A call for better reporting of conservation research data for use in meta-analyses.

It is 20 years since conservation biologists were introduced to the merits of meta-analysis by Fernandez-Duque and Valeggia (1994) in this journal. Over 600 conservation meta-analyses have since been published, and the number is increasing steadily. Meta-analysis has a longer history of use in psychology and social science (Glass 1976), and in medical literature its use predates that in conservation biology or ecology by at least a decade (Fig. 1). Meta-analysis is a powerful tool that allows similar individual studies to be combined for analysis of a much larger effective sample size. Conservation researchers work with limited resources (McCarthy et al. 2012) and large-scale well-replicated studies are often not feasible with the available, relatively short-term funding. Due to their large sample sizes, meta-analyses can identify significant relationships that were undetected in individual studies. For example, due to the absence of a metaanalysis, the efficacy of streptokinase in the treatment of myocardial infarction went undetected for 10 years. The cumulative meta-analysis of 30 years of studies on the topic identified a significant effect of streptokinase after 14 years (Lau et al. 1992). The potential loss of life resulting from this missed relationship highlights the importance of meta-analysis in informing medical policy and practice. Although ecological research is inherently more variable, the utility of meta-analysis in identifying significant relationships across small yet comparable studies is clear. Furthermore, systems may be less readily replicated in conservation than in medicine, but meta-analyses still provide an opportunity to combine studies with some replication to powerfully examine relationships across like studies.

The Role of Tourism and Recreation in the Spread of Non-Native Species: A Systematic Review and Meta-Analysis

Managing the pathways by which non-native species are introduced and spread is considered the most effective way of preventing species invasions. Tourism and outdoor recreation involve the frequent congregation of people, vehicles and vessels from geographically diverse areas. They are therefore perceived to be major pathways for the movement of non-native species, and ones that will become increasingly important with the continued growth of these sectors. However, a global assessment of the relationship between tourism activities and the introduction of non-native species–particularly in freshwater and marine environments–is lacking. We conducted a systematic review and meta-analysis to determine the impact of tourism and outdoor recreation on non-native species in terrestrial, marine and freshwater environments. Our results provide quantitative evidence that the abundance and richness of non-native species are significantly higher in sites where tourist activities take place than in control sites. The pattern was consistent across terrestrial, freshwater and marine environments; across a variety of vectors (e.g. horses, hikers, yachts); and across a range of taxonomic groups. These results highlight the need for widespread biosecurity interventions to prevent the inadvertent introduction of invasive non-native species (INNS) as the tourism and outdoor recreation sectors grow.

How Long Is Too Long in Contemporary Peer Review? Perspectives from Authors Publishing in Conservation Biology Journals

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academia as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time was six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. The majority of participants attributed lengthy review times to reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times were perceived to be greater for early career researchers and to have impact on author morale (e.g. motivation or frustration). Competition among colleagues was also of concern to respondents. Incentivizing peer-review was among the top suggested alterations to the system along with training graduate students in peer-review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study viewed the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer-review models.