Inter
Inter
Review
A Review of Sampling and Monitoring Methods for
Beneficial Arthropods in Agroecosystems
Kenneth W. McCravy
Department of Biological Sciences, Western Illinois University, 1 University Circle, Macomb, IL 61455, USA;
[email protected]; Tel.: +1-309-298-2160
Received: 12 September 2018; Accepted: 19 November 2018; Published: 23 November 2018
Keywords: sampling methodology; bee monitoring; beneficial arthropods; natural enemy monitoring;
vane traps; Malaise traps; bowl traps; pitfall traps; insect netting; epigeic arthropod sampling
1. Introduction
To sustainably use the Earth’s resources for our benefit, it is essential that we understand the
ecology of human-altered systems and the organisms that inhabit them. Agroecosystems include
agricultural activities plus living and nonliving components that interact with these activities in a
variety of ways. Beneficial arthropods, such as pollinators of crops and natural enemies of arthropod
pests and weeds, play important roles in the economic and ecological success of agroecosystems.
These arthropod-mediated ecosystem services (AMES) increase agroecosystem productivity and
sustainability by enhancing crop yields and reducing reliance on pesticides. The annual combined
value of pollination services by non-Apis bees and pest control provided by insect predators and
parasitoids has been estimated at $7.5 billion annually in the USA [1].
Land use practices can have adverse effects on these beneficial arthropods. Intensive agriculture
can negatively affect bee diversity and pollination, and there is evidence of causal connections between
decline of pollinators and decline of plants to which they are functionally linked [2]. Such adverse
effects can be mitigated if undisturbed pollinator habitat is available [3,4]. Likewise, agroecosystems
are often unfavorable environments for arthropod natural enemies of agricultural pests, but efforts
such as habitat enhancement to conserve these natural enemies can provide important control of these
pests [5]. For bees and natural enemies of insect pests, the ability to effectively assess and monitor their
abundance and diversity, and potential effects of land use practices on them, is of vital importance.
A variety of sampling methods is available, but these methods can be biased and vary widely in
performance [6–11]. Some may provide absolute estimates of abundance (density, or numbers per
unit area), but most provide relative estimates that are related to the sampling method being used
(e.g., numbers per trap per day, numbers per hour of aerial netting, etc.). In this paper I present a brief
overview of these beneficial arthropods and their importance, and some general concerns in regard
to sampling and monitoring of these organisms. I then review the major sampling and monitoring
importance, and some general concerns in regard to sampling and monitoring of these organisms. I
then review
methods the major
employed sampling
to assess theseand monitoring
organisms, and methods employed
the advantages andto assess these
limitations organisms,
of these and
methods.
Itthe advantages
is hoped that thisand limitations
paper of these
will provide methods.and
entomologists It crop
is hoped that specialists
protection this paperwith
willa provide
useful
entomologists
overview and crop
of sampling protection
methods specialists
available and with a useful overview
will encourage of sampling
awareness methods
and further available
research and
and will encourage
conservation of theseawareness
important and further research and conservation of these important arthropods.
arthropods.
2.2.Non-Apis
Non-ApisBees
Bees
The
Thetotal
totalvalue
valueofofpollination
pollinationservices
servicesworldwide
worldwidehas hasbeen
beenestimated
estimated atat$217$217billion
billion [12].
[12].
Approximately 78 to 94% of
Approximately 78 to 94% of flowering flowering plants, and most major agricultural crops, are
and most major agricultural crops, are pollinated by pollinated
by animals,
animals, withwith
beesbees being
being the predominant
the predominant pollinating
pollinating taxontaxon [1,4,13].
[1,4,13]. While managed
While managed honey bee honey
(Apis
bee
mellifera mellifera
(Apis L.) hives L.)
are hives
used inaremuch
usedofinthe
much of the
world, world, availability
availability of these hives of is
these hives
limited in is limited
many in
regions
many regions [14,15]. Honey bees are the most commonly used pollinators in
[14,15]. Honey bees are the most commonly used pollinators in large-scale commercial agriculture, large-scale commercial
agriculture,
but non-Apis butbees
non-Apis bees
(Figure 1) (Figure
are also1)important
are also important in crop pollination,
in crop pollination, especially especially
in more in more
complex
complex agroecosystems
agroecosystems and diverseand landscapes
diverse landscapes
[16]. In the [16].
USA,In non-Apis
the USA,beesnon-Apis beesalmost
comprise comprise 25%almost
of crop
25% of crop pollination,
pollination, at a value at a value estimated
estimated at $3.07
at $3.07 billion billion annually
annually [1]. High[1]. High diversity
diversity of bees canof bees can
enhance
enhance
pollinatorpollinator
functionalfunctional complimentarity
complimentarity and ensure
and ensure pollination
pollination function
function [17–19].
[17–19]. Pollination
Pollination can
can contribute to the nutritional value, shelf life, and quality of food crops
contribute to the nutritional value, shelf life, and quality of food crops as well [20,21]. as well [20,21].
Some
Somestudies
studies have
havedocumented
documented declines
declinesof non-Apis
of non-Apis beesbees
in specific geographic
in specific geographiclocations [22–24],
locations [22–
but
24],large-scale, long-term,
but large-scale, and statistically
long-term, robust monitoring
and statistically programs that
robust monitoring yield data
programs thaton population
yield data on
changes are badly
population changesneeded. To document
are badly needed. To future changesfuture
document in beechanges
diversity inand
bee evaluate
diversitytheand effectiveness
evaluate the
ofeffectiveness
mitigation efforts, reliable
of mitigation sampling
efforts, methods
reliable samplingare methods
required.are A required.
variety ofAmethods
variety ofare available
methods are
for sampling
available forbees, including
sampling passive trapping
bees, including passive and activeand
trapping netting.
active Much ofMuch
netting. our knowledge of the
of our knowledge
effectiveness of theseof
of the effectiveness methods has beenhas
these methods obtained in nonagricultural
been obtained environments.
in nonagricultural A review
environments. A of bee
review
sampling methodology
of bee sampling with a focus
methodology with aonfocus
tropical forests forests
on tropical and agroecosystems
and agroecosystems is available [25], as[25],
is available is
a as
frequently updated compendium of practical information on bee biology,
is a frequently updated compendium of practical information on bee biology, collection, collection, processing,
identification, and curation [26].
processing, identification, and curation [26].
(a) (b)
(c) (d)
Figure1.1.Some
Figure Some economically
economically important
important non-Apis
non-Apis bees: (a) (a) Blue
Blue orchard
orchard bee, Osmia lignaria
bee, Osmia lignariaSay,
Say, a
a common
commonorchard
orchardpollinator;
pollinator;(b)(b)southeastern
southeastern blueberry
blueberry bee,
bee, Habropoda
Habropoda laboriosa
laboriosa (Fabricius),
(Fabricius), an
an early
early spring
spring pollinator
pollinator of rabbit-eye
of rabbit-eye blueberry,
blueberry, Vaccinium
Vaccinium virgatum
virgatum Aiton;
Aiton; Peponapispruinosa
(c)(c)Peponapis pruinosaSay,
Say, a
a pollinator
pollinator of Cucurbitaspp.;
ofCucurbita spp.;and
and(d)(d)the
theorchid
orchidbeebee Eulaema
Eulaema mocsaryi
mocsaryi Friese,
Friese, a pollinator
a pollinator of Brazil
of Brazil nut,
nut, Bertholletia
Bertholletia excelsa
excelsa Humb.
Humb. & Bonpl.
& Bonpl. Attributions:
Attributions: (a) Robert
(a) Robert Engelhardt
Engelhardt [27];
[27]; (b) (b) Jerry
Jerry A. Payne,
A. Payne, USDA
USDA Agricultural
Agricultural Research
Research Service
Service [28];
[28]; (c) Jim(c)Cane,
Jim Cane,
USDA USDA Agricultural
Agricultural Research
Research Service
Service [29];(d)
[29]; and andM.
(d)
C.M. C. Cavalcante,
Cavalcante, F. F. Oliveira,
F. F. Oliveira, M. M. M.Maués,
M. Maués, and
and B. M.B.Freitas
M. Freitas
[30].[30].
Insects 2018, 9, 170 3 of 27
in this system [41]. However, oversampling is of less concern if the goal is to document the common
species in a community rather than compiling a comprehensive species list.
Bee communities of Michigan, USA commercial potato fields were sampled using blue vane
traps at canopy height and blue, white, and yellow bowl traps elevated 1 m and placed on circular
plastic platforms with one of each color trap [40]. Blue vane traps collected 30% more species than did
bowl traps. Blue vane traps also collected different species composition, with large-bodied Apidae
collected in relatively large numbers compared to bowl traps. However, it should be noted that in
this study the bowl traps on each platform were in close proximity to each other; in most studies
bowl traps are spaced apart in a transect. The pattern of trap deployment could affect bowl trap bee
collections. Blue vane traps may have high relative attractiveness in simple landscapes and collect
relatively large numbers of oligolectic bees, perhaps because of the greater relative attractiveness of
the UV reflectance of these traps in simple landscapes where resources are scarce [40,42,43]. Blue
vane traps were also used in combination with active netting to sample bees in sour cherry orchards
in Michigan and Pennsylvania as well as apple orchards in Pennsylvania [16]. The blue vane traps
collected an assemblage of bees distinct from that collected via active netting, and the trap collections
included primarily species that were not collected from orchard crop flowers. Several studies in a
variety of habitats have shown blue vane traps to be superior to yellow vane traps in collecting bee
abundance and species richness [6,7,41,44]. In locations where oversampling by blue vane traps is a
concern, the lower effectiveness of yellow vane traps could be an advantage, and replacement of some
blue vane traps with yellow vane traps or perhaps bowl traps might reduce excessive sample sizes.
Use of a combination of trap types and colors could also increase the proportion of the bee species
richness collected (see below).
While vane traps have been used to assess bee abundance and diversity in a variety of
environments, bowl traps are more commonly used and appear to be the method of choice for
monitoring bees at large geographic scales [45]. A protocol for monitoring insect pollinators and
detecting declines at such geographic scales using bowl traps has been proposed [46,47] and the merits
of this proposed program debated [48,49].
Bowl traps and vane traps are the most commonly used trapping methods in bee monitoring
and surveillance, but other trap types are available as well. Malaise traps (Figure 2c) are large
mesh fabric traps that are often used in collecting bees and other flying insects, which tend to move
upwards into the collection container upon contact with the trap [50]. There are several Malaise
trap designs, but the most widely used is the Townes-style Malaise trap with a black base and white
roof [51,52]. Malaise traps have frequently been used to sample various insect groups in a variety of
environments [6,53–57]. Only one of these studies focused on bees in an agricultural setting. This study
investigated bee diversity of southern Costa Rican coffee landscapes at 11 sites, including shaded coffee
farms, unshaded coffee farms, and nonagricultural sites, using Malaise traps [56]. Unshaded coffee
farms had higher bee abundance and species richness than the other two environments, and Malaise
traps collected substantial numbers of small-bodied bees, many of which had never been reported
as common in coffee farms. Although done in a very different environment, studies in Illinois, USA
restored tallgrass prairie [6] and deciduous forest [7] suggest that the results of the Costa Rica study
may be at least partially related to better relative performance of Malaise traps in open vs. shaded
environments. In the Illinois studies, Malaise traps collected by far the greatest bee abundance and
species richness of the four methods used in restored tallgrass prairie, but collected very few bees in
nearby deciduous forest, perhaps because of reduced phototactic behavior of bees in a closed canopy
environment. A significant association between Malaise trap collections and small-bodied bees has
also been found [58], supporting the observation that these traps are efficient in collecting small bees.
This could be advantageous in facilitating sampling of smaller, lesser known bees that are infrequently
collected in agroecosystems.
Because Malaise traps are probably more “passive” than bowl traps and vane traps, which
incorporate color to attract bees, it is possible that Malaise traps collect a more representative sample
Insects 2018, 9, 170 5 of 27
of the overall bee fauna at a particular location, although color and fabric mesh size have been shown
to influence collections of some insect groups such as tabanids [59] and very small hymenopterans [54].
However, Malaise traps also collect many nontarget insects, which is a drawback unless this bycatch is
put to good scientific use. While large numbers of bees can be collected with Malaise traps and sample
collection time is low once traps are set up, the typically abundant bycatch means that time spent
sorting out the bees is relatively great.
Other disadvantages of Malaise traps are cost (200+ U.S. dollars per trap) and significant set-up
time, limiting the number of traps that can be deployed. This can be a problem 5because
Insects 2018, 9, x FOR PEER REVIEW of 26
there is
evidence that Malaise trap effective trapping area is localized, with large variation among traps, at least
and sample
in tallgrass prairie collection
wheretime is low
floral once traps
resources are bees
and set up,have
the typically
a patchyabundant bycatch means
distribution [57]. that
This problem is
time spent sorting out the bees is relatively great.
compounded because Malaise traps are also time-consuming to relocate after set up. However, in many
Other disadvantages of Malaise traps are cost (200+ U.S. dollars per trap) and significant set-up
agroecosystems
time, limiting beethe distributions
number of traps maythatbecanmore uniformThis
be deployed. with
canless
be avariation in beethere
problem because collections
is among
traps, meaning
evidence that fewer traps
Malaise would
trap effectivebetrapping
required. areaStudies of spatial
is localized, variation
with large variationin Malaise
among traps,trap
at collections
of bees least in tallgrass
are needed inprairie
thesewhere floral resources
environments. and bees
Smaller, have portable
more a patchy distribution
Malaise traps[57]. This problem
such as “SLAM” traps
is compounded because Malaise traps are also time-consuming to relocate after set up. However, in
(sea, land, and air Malaise traps) may provide an acceptable alternative to traditional Malaise traps;
many agroecosystems bee distributions may be more uniform with less variation in bee collections
researchamong
on the effectiveness
traps, meaning fewer of SLAM traps
traps would be for collection
required. Studiesofofbees is variation
spatial needed in asMalaise
well. trap
Comparisons
collections of bees of Malaise
are needed traps withenvironments.
in these bowl and vane traps
Smaller, morehave notMalaise
portable been done in agroecosystems,
traps such as
“SLAM” USA
but in Illinois, traps (sea, land, and
restored air Malaise
tallgrass traps)
prairie andmaydeciduous
provide an acceptable
forest thesealternative
methods to traditional
collected somewhat
Malaise traps; research on the effectiveness of SLAM traps for collection of bees is needed as well.
distinct bee species composition, and certain species (indicator species) were significantly associated
Comparisons of Malaise traps with bowl and vane traps have not been done in agroecosystems,
with particular trap
but in Illinois, USAtypes [6,7].
restored Furthermore,
tallgrass these trap
prairie and deciduous types
forest thesevaried
methods incollected
the functional
somewhattraits of bees
collected in this tallgrass prairie [58]. Ground-level pan traps collected statistically
distinct bee species composition, and certain species (indicator species) were significantly greater numbers of
associated
with particular trap types [6,7]. Furthermore, these trap types
solitary vs. social and above- vs. below-ground nesting bees than expected. Malaise varied in the functional traits of bees
traps collected
collected in this tallgrass prairie [58]. Ground-level pan traps collected statistically greater numbers
greater numbers of polylectic vs. oligolectic bees as well as bees of shorter body length, and vane traps
of solitary vs. social and above- vs. below-ground nesting bees than expected. Malaise traps collected
collected greater
greater numbers
numbers of longer
of polylectic body length
vs. oligolectic bees
bees as wellthan expected.
as bees of shorterComparisons
body length, and of vane
the performance
of thesetraps
traps in agroecosystems,
collected greater numbers offrom longerboth
bodya length
species beesand
thantrait diversity
expected. standpoint,
Comparisons of the could yield
performance
important information of thesenot traps
only in on
agroecosystems,
variation infrom trapboth a species andbut
performance traitalso
diversity
on the standpoint,
ecology and natural
could yield important information not only on variation in trap performance but also on the ecology
history of bees in environments of varying complexity.
and natural history of bees in environments of varying complexity.
(a) (b)
(c) (d)
vegetation using a sweep net (Figure 2d, right). Targeted netting allows the researcher to preferentially
collect particular species, and to associate an individual bee with the particular flower it visits. Aerial
nets are generally constructed of a lightweight mesh fabric, whereas sweep nets are constructed of
sturdy cloth that allows the collector to sweep the net through vegetation, collecting insects that are on
the vegetation [61]. While less focused than targeted netting, sweep netting can provide information
on the bee fauna associated with a particular area of vegetation. In both types of netting, samples
can be standardized by timing the sampling period or by measuring the distance or area covered.
Active netting of bees is inexpensive, but relatively labor-intensive, and variation in collector abilities
can make comparisons among samples difficult. Targeted netting, if done thoroughly enough, can
provide a relatively complete sample of the bee fauna present, or can supplement bee samples collected
by other methods. For instance, relative to bowl traps, targeted netting can yield high numbers
of fast or high-flying bees such as Colletes, Megachile, and Melissodes [62]. However, depending on
collector experience and skills, smaller and more cryptic bees may be under-represented in targeted
netting samples.
Targeted netting in combination with bait stations is a well-known method of sampling orchid
bees (Apidae: Euglossini), a dominant bee taxon of Neotropical forests that includes pollinators of
economically important crops such as rubber trees, Hevea brasiliensis Müll. Arg., and Brazil nuts,
Bertholletia excelsa Humb. & Bonpl. (Figure 1d) [30,63–65]. Male orchid bees visit orchids and other
flowers to collect aromatic chemicals that appear to be important in species recognition and mate
choice [66]. These compounds make it possible to sample orchid bees by netting them as they approach
a bait station. Orchid bee bait stations generally consist of an absorbent material such as cotton
suspended from a string and baited with a chemical attractant. Generally, several bait stations are set
up a few meters apart, with each station being baited with a different attractant. There are dozens
of these chemical attractants [66]; some are relatively expensive, and may not be available in some
countries, necessitating international shipping which adds to the expense. Some of the more commonly
used attractants include benzyl acetate, cineole, eugenol, methyl salicylate, and vanillin. Orchid bee
attractants vary greatly in the abundance and species composition of bees attracted [66,67]. These
attractants are also used in conjunction with traps to collect orchid bees. However there is evidence
that baited traps collect lower abundance and species richness than does sampling with baits and
active netting, with trap collections biased toward larger orchid bee species in the genera Eulaema and
Eufriesea [68]. A review of these and other methodological issues related to orchid bee sampling is
available [69].
Sweep netting generally involves continuously sweeping vegetation with the net for a specific
time period, while walking a measured transect, or covering a specified area. This allows the collector
to capture relatively small or inconspicuous bees that may not be collected readily by targeted netting.
Sweep netting is a commonly used method of sampling bees in tropical locations [25], but appears to
be less frequently used in temperate regions. In temperate agroecosystems, sweep netting has been
used in conjunction with bowl traps to assess non-Apis bee abundance and diversity in canola fields
in Alberta, Canada [70–72], grasslands of agriculturally dominated landscapes in Iowa, USA [73],
and lowbush blueberry fields in Maine, USA [74]. In the studies of bees associated with canola fields,
over 20 times as many bees were collected in bowl traps as by sweep netting [72], but difficulty in
assessing relative sampling effort makes comparisons between methods problematic.
Approximately 5% of all bee and wasp species are “trap-nesting” species, that is, they establish
nest sites in tunnels in dead wood or grass stems [75]. These include species in the genera Megachile,
Osmia, Hylaeus, Trypoxylon, and Ancistrocerus, among others. These species can be sampled using
“trap-nests” constructed of wood or other materials. Trap-nests have been used in a variety of ecological
and life history studies, including a recent study of the phenology of plant flowering and solitary bee
and wasp emergence in Rocky Mountain, USA meadows [76]. Trap-nests appear to be an uncommon
approach in agroecosystems, but have been used to assess nesting frequency of trap-nesting species
in fallow and wildflower plots in agriculturally dominated areas in North-Central Florida, USA [77].
Insects 2018, 9, 170 7 of 27
Trap-nests were also used to examine effects of landscape complexity on trap-nesting Hymenoptera and
their parasites in a region dominated by intensively managed agriculture in northwestern Germany [78].
In addition to detection of trap-nesting species, interesting life history data, such as seasonality,
duration of life stages, and nest parasites can be collected using this method. The construction of
trap-nests can be labor intensive, although premade “bee houses” are commercially available and
could be useful
Insects for
2018,research.
9, x FOR PEERMold
REVIEW formation can be a problem in trap-nests, especially if an 7 ofimpervious
26
material such as glass tubing is used. Naturally occurring plant materials such as bamboo are good
The construction of trap-nests can be labor intensive, although premade “bee houses” are
for constructing trap-nests,
commercially but
available the
and variable
could diameter
be useful is aMold
for research. disadvantage.
formation can Straight-grained
be a problem in trap- pieces of
seasoned white
nests, pine haveif been
especially found tomaterial
an impervious work well forglass
such as constructing trap-nests
tubing is used. Naturally[75]. Further
occurring plant studies on
materials
the usefulness of this such as bamboo
method are good beneficial
in sampling for constructing trap-nests, but
Hymenoptera in the variable diameter
agroecosystems areisneeded.
a
disadvantage. Straight-grained pieces of seasoned white pine have been found to work well for
constructing trap-nests [75]. Further studies on the usefulness of this method in sampling beneficial
3. Natural Enemies/Pest Management
Hymenoptera in agroecosystems are needed.
The value of natural control of native agricultural pests by beneficial insects (Figure 3) has been
3. Natural Enemies/Pest Management
estimated at $4.49 billion [1]. However, agroecosystems often provide an unfavorable environment
The value of natural control of native agricultural pests by beneficial insects (Figure 3) has been
for the survival and reproduction of these beneficial organisms. Conservation biological control,
estimated at $4.49 billion [1]. However, agroecosystems often provide an unfavorable environment
the manipulation of the and
for the survival environment
reproductionto of conserve these
these beneficial beneficial
organisms. natural enemies
Conservation and enhance
biological control, the their
effectiveness, is an increasingly
manipulation important
of the environment component
to conserve theseof agricultural
beneficial naturalpest management
enemies and enhance[5]. In order to
their
effectiveness,
evaluate the is an increasingly
status of these importantand
natural enemies component of agriculturalof
the effectiveness pest management [5].
conservation In order reliable
measures,
to evaluate the status of these natural enemies and the effectiveness of conservation measures, reliable
sampling methods are needed. In this section I review methodological approaches to sampling and
sampling methods are needed. In this section I review methodological approaches to sampling and
monitoringmonitoring
these beneficial arthropods
these beneficial in agroecosystems.
arthropods in agroecosystems.
(a)
(b)
(d)
(c)
Figure natural
Figure 3. Some 3. Some natural
enemies enemies potentially
potentially important in
important ininsect
insectpest control:
pest (a) a carabid
control: beetle, beetle,
(a) a carabid
Poecilus cupreus (L.); (b) the predatory wheel bug, Arilus cristatus (L.) consuming a Japanese beetle,
Poecilus cupreus (L.); (b) the predatory wheel bug, Arilus cristatus (L.) consuming a Japanese beetle,
Popillia japonica Newman; (c) a campoplegine ichneumonid; (d) the hunting wasp Ammophila sabulosa
Popillia japonica Newman;
(L.) carrying (c) a campoplegine
a caterpillar. ichneumonid;
Attributions: (a) James Lindsey (d) the hunting
at Ecology wasp Ammophila
of Commanster sabulosa (L.)
[79]; (b) Andy
carrying a McLemore,
caterpillar. [80];Attributions: (a)and
(c) H. Dumas, [81]; James Lindsey
(d) Patrick at Ecology
Reijnders, [82]. of Commanster [79]; (b) Andy
McLemore, [80]; (c) H. Dumas, [81]; and (d) Patrick Reijnders, [82].
3.1. Sampling Natural Enemies in Epigeic Environments
3.1. Sampling Natural Enemies in Epigeic Environments
3.1.1. Pitfall Traps
3.1.1. Pitfall Traps
The most important groups of beneficial epigeic natural enemies include carabid beetles,
(Coleoptera: Carabidae) (Figure 3a), rove beetles (Coleoptera: Staphylinidae), wolf spiders (Araneae:
The most important
Lycosidae) and othergroups of spiders,
wandering beneficial epigeic (Myriopoda:
and centipedes natural enemies include
Chilopoda). Of thesecarabid
groups, beetles,
(Coleoptera: Carabidae)
carabids are the(Figure 3a), rove studied
most thoroughly beetlesand(Coleoptera: Staphylinidae),
well understood. Carabids and wolf spiders
other epigeic(Araneae:
Lycosidae) arthropods
and otherare most commonly
wandering sampled
spiders, and using pitfall traps
centipedes (Figure 4a) [83–85].
(Myriopoda: This trap type
Chilopoda). Of is the groups,
these
carabids are the most thoroughly studied and well understood. Carabids and other epigeic arthropods
are most commonly sampled using pitfall traps (Figure 4a) [83–85]. This trap type is the method of
Insects 2018, 9, 170 8 of 27
choice for carabid abundance and diversity sampling within the National Ecological Observatory
Network (NEON), a continental-scale program to increase our knowledge of the ecological impacts
of climate change, land-use patterns, and invasive species on biodiversity and ecosystem processes
in the USA [86]. Pitfall traps have been used to collect and quantify epigeic arthropods since at least
the early 1900s [87,88]. Pitfall traps consist of an open-top container buried in the ground with the
rim flush with or slightly below the substrate surface. Animals falling into the container are trapped.
There are many modifications of the basic pitfall trap design, including a funnel to prevent escape,
a cover to block rain and debris from falling into the trap, baits to target particular taxa, and drift fences
and barriers to increase captures and infer direction of movement [89,90]. Pitfall traps are sometimes
used dry to collect live specimens, but predatory species feeding on each other is often a problem [91],
so more often the trap is partially filled with a preservative to kill and maintain the trapped arthropods.
A variety of preservatives have been used, including water, brine, formalin (which is highly toxic and
generally no longer used), ethylene glycol, propylene glycol, acetic acid, alcohol, kerosene, and chloral
hydrate [85]. Because the numbers of specimens captured is dependent on their activity levels as well
as their abundance [92], pitfall trap samples are best described in terms of “activity-abundance” or
“activity-density” [84].
Most studies using pitfall traps in agroecosystems have focused on carabids. Many of these have
been done in the agriculturally important Midwestern USA [93]. One focus has been on effects of
cropping practices on beneficial arthropods. For example, pitfall traps and quadrat sampling have been
used to examine the effects of organic transition systems on carabids and other arthropods in Illinois,
USA agricultural fields [94,95]. Pitfall trapping indicated that activity levels of beneficial arthropods
were reduced in the low intensity system, but quadrat sampling showed that this environment
had the greatest density of these arthropods, suggesting that the more stable environment of the
low intensity system resulted in less arthropod movement. Predation rates on sentinel wax moth
(Galleria mellonella L.) larvae and seed removal were greatest in the low intensity system as well,
suggesting that low intensity agricultural practices were advantageous to beneficial arthropods. These
results demonstrate that a combination of sampling methods can often provide more information
and greater insight than does a single method. Pitfall traps have also been used to monitor carabid
abundances in conventional vs. reduced-risk insecticide management practices in Michigan, USA
highbush blueberry plantations [96], to assess potential effects of transgenic corn on carabid abundance
in Iowa, USA [97], and to evaluate the potential of carabids to serve as indicators of adverse
environmental effects of genetically modified crops in Europe [98].
In addition to assessments of beneficial arthropods in relation to conditions within the crop
environment, there have been several landscape-scale investigations of effects of anthropogenic land
use patterns on arthropods, based on pitfall trap sampling. Pitfall traps were used to show that
carabid community variation is associated with extent of disturbance in sites ranging from highly
disturbed pasture to cocoa (Theobroma cacao L.) plantations to successional forest and undisturbed
native forest in the Brazilian Amazon [99]. This study also identified several carabid indicator species
and suggested that carabid communities can be used to evaluate the status of Neotropical ecosystems.
Pitfall traps were also employed to compare responses of epigeic spiders and carabids to differences
in cultivated and semi-natural environments in China [100]. Results of this study indicated that the
high plant diversity and vegetation structure of semi-natural habitats significantly enhanced spider
abundance, whereas these factors were a poor predictor of carabid abundance and species richness.
Plant diversity affected the species composition of both groups. These studies illustrate the utility
of pitfall traps for investigating associations between habitat characteristics and beneficial epigeic
arthropods. However, the potential for habitat-specific effects on collections of arthropods in pitfall
traps should be considered, and if possible a combination of sampling methods should be used.
Like most trapping methods, pitfall traps are subject to certain biases, and collections can be
affected by a variety of factors. In a study of the spider community of winter wheat, species composition
and sex ratios obtained using pitfall traps differed from that obtained via density sampling using a
Insects 2018, 9, 170 9 of 27
D-Vac suction sampler (see next section). These discrepancies could be due to species-specific variation
in activity patterns, searching for mates or food, and species-specific differences in ability to escape
from the pitfall traps [101]. Challenges associated with pitfall trapping have been studied in detail for
carabids
Insects[9,102].
2018, 9, x As
FORpreviously
PEER REVIEWmentioned, arthropod activity level affects the probability of capture.
9 of 26
This may be related to another bias associated with pitfall traps—the tendency for over-representation
differences in ability to escape from the pitfall traps [101]. Challenges associated with pitfall trapping
of large-bodied species, as shown by a study in which carabid composition of pitfall trap samples was
have been studied in detail for carabids [9,102]. As previously mentioned, arthropod activity level
compared with that collected via extraction from litter using Berlese–Tullgren funnels (Figure 4b) [9].
affects the probability of capture. This may be related to another bias associated with pitfall traps—
This is
theprobably
tendencyrelated to locomotive abilities.
for over-representation Largerspecies,
of large-bodied speciesasgenerally
shown bymove a study greater distances
in which carabid than
smaller species, whereas smaller species such as Notiophilus spp., often evade
composition of pitfall trap samples was compared with that collected via extraction from litter using capture upon reaching
the lip
Berlese–Tullgren funnels (Figure 4b) [9]. This is probably related to locomotive abilities. Largerfrom
of the trap [9,102,103]. Different carabid species also have differing abilities to escape
trapsspecies
[104]. generally
Pitfall trap movecollections also vary
greater distances in relation
than to diel whereas
smaller species, activity smaller
patternsspecies
of carabids,
such as with
Notiophilus
diurnal carabids spp., often
being evade capture uponinreaching
under-represented the lip perhaps
pitfall traps, of the trapbecause
[9,102,103].
theyDifferent
can seecarabid
and avoid
species
the traps also have
[102,103]. differingdiel
However, abilities to escape
activity from traps
of particular [104]. species
carabid Pitfall trap
can collections also vary
vary in relation in
to habitat,
relation to diel activity patterns of carabids, with diurnal carabids being under-represented
with greater or lesser diurnal activity in agricultural fields than in nearby uncultivated habitat [105]. in pitfall
traps, perhaps because they can see and avoid the traps [102,103]. However, diel activity of particular
Amount and structure of vegetation can also affect carabid collections. For instance, pitfall traps
carabid species can vary in relation to habitat, with greater or lesser diurnal activity in agricultural
with vegetation removed from the surrounding area generally collect more carabids than do traps
fields than in nearby uncultivated habitat [105]. Amount and structure of vegetation can also affect
without a cleared
carabid area, although
collections. For instance,different
pitfallcarabid
traps withspecies vary in
vegetation their response
removed from thetosurrounding
different vegetation
area
structure [102]. Characteristics related to the pitfall traps themselves
generally collect more carabids than do traps without a cleared area, although different can also affect carabidcarabid
collections.
Round trapsvary
species without covers
in their tendtotodifferent
response collect greater
vegetationabundance of carabids
structure [102]. than dorelated
Characteristics covered to traps
the or
rectangular traps,
pitfall traps althoughcan
themselves there
also isaffect
somecarabid
speciescollections.
and habitat-related
Round traps variation
without [9]. Type
covers tendoftopreservative
collect
greater abundance
can influence abundance of carabids
and species than composition
do covered traps or rectangular
of collections traps,[106,107],
as well although so there is some in
consistency
comparative studies using pitfall traps is important. On the other hand, variation in species
species and habitat-related variation [9]. Type of preservative can influence abundance and pitfall trap
composition
collections relatedoftocollections as wellcan
trap variation [106,107],
be putso toconsistency
good advantagein comparative
in species studies using studies
inventory pitfall traps
because
is important. On the other hand, variation in pitfall trap collections related to trap variation can be
the traps may collect greater combined species richness [106]. A review of factors that may affect
put to good advantage in species inventory studies because the traps may collect greater combined
arthropod collections by pitfall traps is available [106].
species richness [106]. A review of factors that may affect arthropod collections by pitfall traps is
There
available is evidence
[106]. that pitfall trap samples can be related to densities of carabids [108]. Fenced
pitfall traps Therewere evaluated
is evidence for use
that pitfall trap insamples
estimatingcan bedensities
related toof epigeicof predatory
densities beetles,
carabids [108]. Fencedusing
mark-release-recapture.
pitfall traps were evaluated For seven
for use of 10 speciesdensities
in estimating studiedofrecapture rates were
epigeic predatory greater
beetles, than 70%,
using mark-
suggesting that these traps are suitable for estimating densities if trap density is sufficient [109].
release-recapture. For seven of 10 species studied recapture rates were greater than 70%, suggesting
thatstudies
Further these traps
are are suitable
needed to for estimating
evaluate densities if trapofdensity
the effectiveness pitfallistraps
sufficient [109]. Further studies
in agroecosystems and how
are needed
sampling to evaluate
is affected the effectiveness
by arthropod behavior, of pitfall
activitytraps in agroecosystems
levels, and environmental and how samplingsuch
variables is as
affected by arthropod behavior, activity levels, and environmental
vegetation structure. Studies incorporating a second sampling method that measures arthropod variables such as vegetation
structure. Studies incorporating a second sampling method that measures arthropod densities, such
densities, such as quadrat sampling and extraction of arthropods [9,95], would allow comparison
as quadrat sampling and extraction of arthropods [9,95], would allow comparison of pitfall trap
of pitfall trap samples with density estimates of epigeic arthropods. Some of these approaches to
samples with density estimates of epigeic arthropods. Some of these approaches to measuring epigeic
measuring
arthropod epigeic arthropod
densities densities
are discussed arenext
in the discussed
section.in the next section.
(b)
(a)
Figure
Figure 4. Two
4. Two common
common sampling
sampling methodsfor
methods forepigeic
epigeic arthropods:
arthropods:(a)(a)
Pitfall trap
Pitfall or Barber
trap trap trap
or Barber and and
(b) homemade
(b) homemade Berlese–Tullgren
Berlese–Tullgren funnels.Attribution:
funnels. Attribution: (a)
(a) Mnolf
Mnolf[110].
[110].
staphylinids in riparian habitats [121] and provides an estimate of density. An area of soil is isolated
with a 0.1 m2 enclosure, vegetation is examined and removed, and 2 L of water is poured into the
enclosure. Arthropods are removed, and later an additional 2 liters are added and arthropods are again
removed [112]. Studies in a variety of crop environments have shown that small carabids, staphylinids,
and Araneae can be collected via soil flooding [122–124]. In a study using three methods to sample
beneficial arthropods of agricultural fields in Austria, small carabids were predominant in soil flooding
and emergence trap samples, whereas the larger P. cupreus was predominant in pitfall traps, probably
reflecting its greater mobility [124]. However, soil flooding can be ineffective under certain soil
conditions. Blockage of the soil surface by silty mud can inhibit the emergence of arthropods, and in
dry clay soils with large cracks or other highly perforated soils, impractical amounts of water can be
required to sufficiently flood the soil [112].
Microhabitat removal and arthropod extraction involves removal of a known area of litter or
soil for later extraction of arthropods, providing an estimate of density. A variety of methods have
been used. Samples can be hand-sorted and searched for arthropods manually, or can be placed in an
apparatus for extraction [112]. The most widely used of these is the Berlese–Tullgren funnel (Figure 4b),
in which the sample is placed in a container with a mesh screen to support the sample and a funnel
that leads to a collection container below. A light bulb or other heat source is located above the sample;
the arthropods within the sample are forced downward into the collection container by the heat and
desiccating soil [115]. Many modifications and improvements have been made on the original design.
When placed in the extractor, the soil core should be inverted and kept intact; otherwise, the natural
passageways will be disrupted and the arthropods’ “escape routes” will be eliminated [125]. It has also
been noted that significant losses can occur through arthropods becoming trapped in the condensation
that forms on the sides of the container from the moisture contained in the soil core; space should be
left between the core and the sides of the container to prevent this [126].
Berlese–Tullgren funnels have been used to collect spiders from samples taken from maize, ryegrass,
and pasture [127], and beneficial predatory arthropods (spiders, carabids, and staphylinids) from samples
taken from overwintering sites within cereal fields [128]. However, the effectiveness of this method can
vary with habitat. Berlese–Tullgren funnels were found to be an ineffective method for sampling epigeic
arthropods in the sandy soils of Florida, USA bush bean plots, because of the low amount of surface
litter and large amounts of sand that fall from the sample into the collection jar [129].
Cryptozoan boards, sometimes referred to as “drop boards”, can be used to collect cryptozoans,
the “hidden animals” that shelter and hide underneath stones and logs [115,130]. These are generally
wooden boards of 0.1 m2 each that are placed on the ground. When collecting samples, the boundaries
of the board should be marked to avoid sampling outside of the covered area. The board should
be lifted and specimens collected quickly, since many of these animals move rapidly and quickly
find hiding places. An aspirator for sucking up the specimens is helpful [130]. A potentially useful
alternate method is to place a 0.1 m2 enclosure around the board (slightly greater area than the board),
with the edges pressed into the soil. Then the board is removed and specimens collected, with the
enclosure preventing escape. The specimens can be collected on site, or the litter and soil can be
collected and placed in a bag for later sorting in the lab, or perhaps extraction using Berlese–Tullgren
funnels. Another possibility might be to use a suction sampler (see above) to collect the material under
the board, although the high humidity of the microhabitat might cause clumping of the litter and so
preliminary breaking up and loosening of the material may be necessary.
Predatory macroarthropods found among the cryptozoa include carabids, centipedes,
staphylinids, dermapterans, and Araneae. The microhabitats these animals are adapted to are generally
dark, with fairly stable temperature and humidity compared to the surrounding environment [131].
These animals vary in the degree to which they are bound to this environment, and predators appear
to be less restricted to the cryptozoan microhabitat than other organisms [132]. Because it may take
some time for the microenvironment underneath a cryptozoan board to develop into an optimal one
for cryptozoan colonization, the length of time the cryptozoan boards are left in place may affect
Insects 2018, 9, 170 12 of 27
collections, and this may vary in a taxon-specific manner. Abundance and taxonomic composition of
invertebrates collected via cryptozoan boards can also vary with board size, color, and surface features
of the ground [133].
Cryptozoan boards have been used relatively infrequently in agroecosystems. In Zimbabwe,
millipedes are important in the processes of decomposition and nutrient cycling [134]; the seasonal
activity patterns of these animals has been examined in agricultural pasture and other habitats using
cryptozoan boards [135]. Cryptozoan boards were also used to sample soil surface arthropods in the
aforementioned study in Florida, USA bush bean plots. Cryptozoan boards collected less taxonomic
diversity than did pitfall traps but more than Berlese–Tullgren funnels overall. Compared to pitfall
traps, cryptozoan boards collected fewer staphylinids, spiders, parasitoid wasps, and various other
taxa; more crickets, Dermaptera, and elaterids; and similar numbers of formicids and carabids [129].
Cryptozoan boards are generally less productive than pitfall traps on a per unit time or effort basis [136].
reporting of sweep-netting samples as insects collected per unit volume of vegetation has been
developed [143] and applied to coccinellid sampling [144].
If sweep net samples obtained by different people are included in a comparative study, then efforts
should be undertaken to ensure that the samples are standardized and comparable. There are other
potential biases and sources of error associated with sweep-netting. Arthropods that tend to fall off
the vegetation or fly away as the netter approaches will be undersampled [130]. Vegetation structure
and the taxon being sampled can also affect sweep net collections. If the species being sampled is
distributed throughout the vertical range of the plants, then smaller proportions of the species will
likely be sampled from taller plants relative to shorter plants [115], and even closely related species
can differ in their susceptibility to collection by sweep net [145].
the coastal plain of Georgia, USA [158]. The effectiveness of different sticky trap colors was compared
in a study of aphelinid parasitoids of San Jose scale in apple orchards in North Carolina, USA. Trap
color had a significant effect on relative abundances of species collected. Among colored traps, traps
combined with San Jose scale sex pheromone collected significantly more Encarsia perniciosi (Tower)
than did unbaited traps, suggesting that this pheromone acts as a kairomone for this parasitoid. Black
baited traps collected significantly more E. perniciosi than did baited yellow or white traps, suggesting
an olfactory–visual interaction in host location by this species [159]. Yellow sticky traps have also
been used to monitor abundances of Cardiaspina psillids and adult parasitoids during an outbreak in
Eucalyptus woodland in Western Sydney, Australia [160].
Several studies have compared different methods of sampling parasitic hymenoptera in a
variety of habitats. Two Malaise traps and four pan traps (color not given) were used to collect
parasitic Hymenoptera in a transect in organic rice fields and a nearby protected area in the Brazilian
Atlantic Forest biome [161]. Malaise traps collected the greatest numbers of parasitoids (58% of total),
and collected 1.7 to 1.9 times the estimated species richness as did the pan traps. In rice ecosystems of
Tamil Nadu, India, sweep-netting, yellow pan traps at ground level, and yellow pan traps elevated to
the rice canopy were compared in effectiveness of sampling chalcicid and pteromalid parasitoids [162].
Sweep-netting and ground-level yellow pan traps collected the most parasitoids overall and the most
pteromalids, whereas sweep-netting collected the most chalcidids. Elevated yellow pan traps were
clearly the least effective method overall, but comparison of pan trap and sweep-netting collection effort
is difficult. Sweep-netting, yellow pan trap, and Malaise trap collections of parasitic Hymenoptera
were compared at southern India urban sites disturbed by human activities and cattle grazing. Among
platygastrids, which were identified to genus level, Malaise traps had the highest capture rate overall,
but results varied among genera [163]. For all parasitic Hymenoptera collected, each trap was effective
for particular taxa, and it was concluded that a combination of these trap types would be best for
comprehensive collections [164]. Malaise traps, yellow pan traps, and flight intercept traps were also
compared in secondary tropical deciduous forest on the Caribbean island of Dominica [165]. Yellow
pan traps collected the greatest numbers, but relatively low diversity because of the dominance of
a few species of diapriids. Malaise traps collected the greatest richness (based on morphospecies)
and diversity, while flight intercept traps collected relatively low abundance and richness. Again,
comparison of collection effort among different methods is problematic.
Aculeate wasps are also potentially important biological control agents in agroecosystems [166–168],
and several of the above trapping methods have been used to sample these wasps in a variety
of habitats. Malaise traps and sweep nets have been used to collect the crabronid Bembecinus
quinquespinosus (Say) in a study of male mating and mate location [169], and Malaise traps, sweep nets,
and pan traps were used in faunistic surveys of sphecid and crabronid wasps in Iran [170,171].
The Diptera includes many potentially important natural enemies of agricultural pests.
Tachinids (Diptera: Tachinidae) have shown potential for biological control of some agroecosystem
pests [172–175], and can be collected using a variety of methods. Tachinid specimens in the diverse
subfamily Exoristinae have been recorded as collected in North Korea using sweep net and yellow pan
traps [176]. Tachinids comprised 23% of overall parasitoid captures in Malaise traps in Georgia, USA
coastal plain loblolly pine plantations, and the tachinid Lixophaga mediocris was the most abundant
parasitoid of the loblolly pine pest Nantucket pine tip moth, Rhyacionia frustrana (Scudder), collected
by this method (72% of total) [158]. Many species of syrphid flies (Diptera: Syrphidae) are also
beneficial, the larvae as natural enemies and adults as pollinators. Syrphids were studied as landscape
indicators in agroecosystems in Italy using Malaise traps and yellow sticky traps [177]. Malaise traps
collected the greatest numbers, but some species were collected only by sticky traps, some of the latter
in large numbers. Robber flies (Diptera: Asilidae) are voracious predators that can be sampled via
targeted netting and Malaise traps [178–180]. In Illinois, USA restored tallgrass prairie and adjacent
deciduous forest, Malaise traps collected 26 species and 0.35 robber flies/trap/day; approximately
Insects 2018, 9, 170 15 of 27
85% of estimated minimum asymptotic species richness was collected [178,179]. Studies on sampling
and impacts of predatory flies and aculeate wasps in agroecosystems are needed.
on the “true” faunal composition which could serve as a point of reference with which to compare our
sampling methods. However, multiple sampling methods should increase completeness to the extent
that the results of the different methods are nonoverlapping. More research is needed on development
of novel sampling methods for beneficial arthropods and comparisons of the different methods.
Since most invertebrate monitoring programs rely heavily on lethal sampling, potential effects of
monitoring on beneficial arthropod abundance and diversity are a concern. Only a few studies have
specifically addressed effects of lethal sampling, and most of these focus on vertebrates, including
shrews [200], lizards [201], and small mammals [202]. Among beneficial arthropods, potential impacts
of lethal sampling on bees have been examined [203]. These studies have consistently found no
evidence for long-term negative impacts on these communities. Even so, researchers should try to
avoid sacrificing excessive numbers of specimens. In studies addressing beneficial arthropod diversity,
a predetermined point beyond which sampling is unnecessary can be established based on estimates of
species richness [179,204,205], although for many arthropod taxa a major challenge is the on-the-spot
specimen identifications that would be required.
It is also important to note that many sampling methods will produce incidental captures, or
“bycatch”. While this bycatch may be unimportant for the study at hand, it could contain specimens
of concern for pest management, or of research or conservation interest. For instance, pitfall trap
studies have yielded important information via incidental bee captures in coastal sage scrub habitats
of southern California [206] and in the Palouse Prairie of eastern Washington and northwestern Idaho,
USA [207]. Conversely, Malaise traps with a collection container at the base have been successfully used
in conjunction with pitfall traps to sample carabids in seasonally flooded hardwood forest canopy gaps;
use of pitfall traps alone would have resulted in a 38% reduction in species richness [208]. As these
researchers note, flight is an important dispersal mechanism in many carabid species, and macropterous
species are often predominant in disturbed habitats [209–212]. This suggests that Malaise traps or
perhaps less expensive flight interception traps could be useful in augmenting pitfall trap collections
of carabids in agroecosystems. Malaise traps can also be used to effectively sample spiders, as shown
in a study of spider diversity in peatland and wet grassland across Ireland [213]. In this study, Malaise
trap collections were to a great degree complimentary with pitfall trap collections. As these authors
observe, Malaise traps may not be suitable as a sole method of sampling spiders, but traps in use to
collect insects may also provide valuable data on the spider fauna. While the above studies were done
in nonagricultural environments, they underscore the potential for bycatch or nontarget captures to
contribute important and perhaps unexpected information. Bycatch not intended to be used can be
made available to appropriate specialists to avoid waste [214].
It should also be noted that correct identification of arthropod specimens is often much more
challenging and time-consuming than the sampling itself. Help from appropriate specialists is often
needed, and it is wise to explicitly budget for identification services. Furthermore, collected specimens
will require care and management. It is wise to construct a plan for specimen identification, data entry
and organization, and collection management before sampling begins.
As habitat destruction, climate change, and other anthropogenically-driven changes continue to
unfold, intensive agricultural practices will face new challenges. If climate change leads to increased
insect pest populations and changes in pest geographic ranges, it will be difficult to resist the temptation
to respond with even greater reliance on insecticides. However, such a response would likely contribute
to the already high rate of biodiversity loss, including loss of beneficial arthropod diversity. An
increased role for native pollinators and natural enemies in agroecosystems would be one strategy for
decreasing reliance on insecticides. However our knowledge of these beneficial arthropods is only as
good as the reliability of our sampling. Reliable sampling and monitoring methods for these beneficial
arthropods will be essential for assessing the effects of environmental disturbances and effectiveness
of conservation efforts. Hopefully this paper provides information that will prove useful in choosing
appropriate methods for assessing beneficial arthropod health and effectiveness in agricultural systems.
Insects 2018, 9, 170 17 of 27
Table 1. Beneficial arthropod sampling methods included in this paper, focus, type of estimate, relative cost and labor, and comments on advantages and limitations of
each method.
References
1. Losey, J.E.; Vaughan, M. The economic value of ecological services provided by insects. BioScience 2006, 56,
311–323. [CrossRef]
2. Biesmeijer, J.C.; Roberts, S.P.M.; Reemer, M.; Ohlemüller, R.; Edwards, M.; Peeters, T.; Schaffers, A.P.;
Potts, S.G.; Kleukers, R.; Thomas, C.D.; et al. Parallel declines in pollinators and insect-pollinated plants in
Britain and the Netherlands. Science 2006, 313, 351–354. [CrossRef] [PubMed]
3. Kremen, C. Managing ecosystem services: What do we need to know about their ecology? Ecol. Lett. 2005, 8,
468–479. [CrossRef] [PubMed]
4. Klein, A.-M.; Vaissière, B.E.; Cane, J.H.; Steffan-Dewenter, I.; Cunningham, S.A.; Kremen, C.; Tscharntke, T.
Importance of pollinators in changing landscapes for world crops. Proc. R. Soc. B 2007, 274, 303–313.
[CrossRef] [PubMed]
5. Landis, D.A.; Wratten, S.D.; Gurr, G.M. Habitat management to conserve natural enemies of arthropod pests
in agriculture. Annu. Rev. Entomol. 2000, 45, 175–201. [CrossRef] [PubMed]
6. Geroff, R.K.; Gibbs, J.; McCravy, K.W. Assessing bee (Hymenoptera: Apoidea) diversity of an Illinois
restored tallgrass prairie: Methodology and conservation considerations. J. Insect Conserv. 2014, 18, 951–964.
[CrossRef]
7. McCravy, K.W.; Ruholl, J.D. Bee (Hymenoptera: Apoidea) diversity and sampling methodology in a
Midwestern USA deciduous forest. Insects 2017, 8, 81. [CrossRef] [PubMed]
8. Sircom, J.; Jothi, G.A.; Pinksen, J. Monitoring bee populations: Are eusocial bees attracted to different colours
of pan trap than other bees? J. Insect Conserv. 2018, 22, 433–441. [CrossRef]
9. Spence, J.R.; Niemelä, J.K. Sampling carabid assemblages with pitfall traps: The madness and the method.
Can. Entomol. 1994, 126, 881–894. [CrossRef]
10. Lang, A. The pitfalls of pitfalls: A comparison of pitfall trap catches and absolute density estimates of epigeal
invertebrate predators in arable land. J. Pest Sci. 2000, 73, 99–106.
11. Purvis, G.; Fadl, A. The influence of cropping rotations and soil cultivation practice on the population
ecology of carabids (Coleoptera: Carabidae) in arable land. Pedobiologia 2002, 46, 452–474. [CrossRef]
12. Gallai, N.; Salles, J.-M.; Settele, J.; Vaissière, B.E. Economic valuation of the vulnerability of world agriculture
confronted with pollinator decline. Ecol. Econ. 2008, 68, 810–821. [CrossRef]
13. Ollerton, J.; Winfree, R.; Tarrant, S. How many flowering plants are pollinated by animals? Oikos 2011, 120,
321–326. [CrossRef]
14. Delaplane, K.S.; Mayer, D.R. Crop Pollination by Bees; CABI: Wallingford, UK, 2000; p. 352.
15. Isaacs, R.; Blaauw, B.; Williams, N.; Kwapong, P.; Lee-Mäder, E.; Vaughan, M. Farm-tailored measures to
sustain and enhance pollinator services. In Pollination Services to Agriculture: Sustaining and Enhancing a Key
Ecosystem Service; Food and Agriculture Organization of the United Nations & Routledge: New York, NY,
USA, 2016.
16. Gibbs, J.; Joshi, N.K.; Wilson, J.K.; Rothwell, N.L.; Powers, K.; Haas, M.; Gut, L.; Biddinger, D.J.; Isaacs, R.
Does passive sampling accurately reflect the bee (Apoidea: Anthophila) communities pollinating apple and
sour cherry orchards? Environ. Entomol. 2017, 46, 579–588. [CrossRef] [PubMed]
17. Albrecht, M.; Schmid, B.; Hautier, Y.; Muller, C.B. Diverse pollinator communities enhance plant reproductive
success. Proc. R. Soc. Biol. Sci. Ser. B 2012, 279, 4845–4852. [CrossRef] [PubMed]
18. Bartomeus, I.; Park, M.G.; Gibbs, J.; Danforth, B.N.; Lakso, A.N.; Winfree, R. Biodiversity ensures
plant-pollinator phenological synchrony against climate change. Ecol. Lett. 2013, 16, 1331–1338. [CrossRef]
[PubMed]
19. Fründ, J.; Dormann, C.F.; Holzschuh, A.; Tscharntke, T. Bee diversity effects on pollination depend on
functional complementarity and niche shifts. Ecology 2013, 94, 2042–2054. [CrossRef] [PubMed]
20. Brittain, C.; Kremen, C.; Garber, A.; Klein, A.-M. Pollination and plant resources change the nutritional
quality of almonds for human health. PLoS ONE 2014, 9, e90082. [CrossRef] [PubMed]
Insects 2018, 9, 170 19 of 27
21. Klatt, B.K.; Holzschuh, A.; Westphal, C.; Clough, Y.; Smit, I.; Pawelzik, E.; Tscharntke, T. Bee pollination
improves crop quality, shelf life and commercial value. Proc. R. Soc. B 2014, 281, 20132440. [CrossRef]
[PubMed]
22. Cameron, S.A.; Lozier, J.D.; Strange, J.P.; Koch, J.B.; Cordes, N.; Solter, L.F.; Griswold, T.L. Patterns of
widespread decline in North American bumble bees. Proc. Natl. Acad. Sci. USA 2011, 108, 662–667.
[CrossRef] [PubMed]
23. Bartomeus, I.; Ascher, J.S.; Gibbs, J.; Danforth, B.N.; Wagner, D.L.; Hedtke, S.M.; Winfree, R. Historical
changes in northeastern U.S. bee pollinators related to shared ecological traits. Proc. Natl. Acad. Sci. USA
2013, 110, 4656–4660. [CrossRef] [PubMed]
24. Burkle, L.A.; Marlin, J.C.; Knight, T.M. Plant-pollinator interactions over 120 years: Loss of species,
co-occurrence, and function. Science 2013, 339, 1611–1615. [CrossRef] [PubMed]
25. Prado, S.G.; Ngo, H.T.; Florez, J.A.; Collazo, J.A. Sampling bees in tropical forests and agroecosystems:
A review. J. Insect Conserv. 2017, 21, 753–770. [CrossRef]
26. Droege, S. The Very Handy Manual: How to Catch and Identify Bees and Manage a Collection. 2015.
Available online: http://bio2.elmira.edu/fieldbio/beemanual.pdf (accessed on 21 November 2018).
27. Engelhardt, R. Available online: https://en.wikipedia.org/wiki/Osmia_lignaria (accessed on 20 April 2005).
28. Payne, J.A. Available online: https://commons.wikimedia.org/wiki/File:Jerry_A._Payne_-_Habropoda_
laboriosa_female.jpg (accessed on 14 April 2003).
29. Cane, J. Available online: https://commons.wikimedia.org/wiki/File:Peponapis_pruinosaCane-12.JPG
(accessed on 28 July 2007).
30. Cavalcante, M.C.; Oliveira, F.F.; Maués, M.M.; Freitas, B.M. Pollination requirements and the foraging
behavior of potential pollinators of cultivated Brazil nut (Bertholletia excels Bonpl.) trees in central Amazon
rainforest. Psyche 2012. [CrossRef]
31. Martin, J.E.H. Collecting, Preparing, and Preserving Insects, Mites, and Spiders; Insects and arachnids of Canada
Handbook Series, Part 1; Supply and Services Canada: Hull, QC, Canada, 1977.
32. Thomas, D.B. Nontoxic antifreeze for insect traps. Entomol. News 2008, 119, 361–365. [CrossRef]
33. Tuell, J.K.; Isaacs, R. Elevated pan traps to monitor bees in flowering crop canopies. Entomol. Exp. Appl. 2009,
131, 93–98. [CrossRef]
34. Droege, S.; Tepedino, V.J.; Lebuhn, G.; Link, W.; Minckley, R.L.; Chen, Q.; Conrad, C. Spatial patterns of bee
captures in North American bowl trapping surveys. Insect Conserv. Divers. 2010, 3, 15–23. [CrossRef]
35. Richards, M.H.; Rutgers-Kelly, A.; Gibbs, J.; Vickruck, J.L.; Rehan, S.M.; Sheffield, C.S. Bee diversity in
naturalizing patches of Carolinian grasslands in southern Ontario. Can. Entomol. 2011, 143, 279–299.
[CrossRef]
36. Leong, J.M.; Thorp, R.W. Colour-coded sampling: The pan trap colour preferences of oligolectic and
nonoligolectic bees associated with a vernal pool plant. Ecol. Entomol. 1999, 24, 329–335. [CrossRef]
37. Shapiro, L.H.; Tepedino, V.J.; Minckley, R.L. Bowling for bees: Optimal sample number for “bee bowl”
sampling transects. J. Insect Conserv. 2014, 18, 1105–1113. [CrossRef]
38. Stephen, W.P.; Rao, S. Unscented color traps for non-Apis bees (Hymenoptera: Apiformes). J. Kans. Entomol. Soc.
2005, 78, 373–380. [CrossRef]
39. Kimoto, C.; DeBano, S.J.; Thorp, R.W.; Rao, S.; Stephen, W.P. Investigating temporal patterns of a native bee
community in a remnant North American bunchgrass prairie using blue vane traps. J. Insect Sci. 2012, 12,
108. [CrossRef] [PubMed]
40. Buchanan, A.L.; Gibbs, J.; Komondy, L.; Szendrei, Z. Bee community of commercial potato fields in Michigan
and Bombus impatiens visitation to neonicotinoid-treated potato plants. Insects 2017, 8, 30. [CrossRef]
[PubMed]
41. Joshi, N.K.; Leslie, T.; Rajotte, E.G.; Kammerer, M.A.; Otieno, M.; Biddinger, D.J. Comparative trapping
efficiency to characterize bee abundance, diversity, and community composition in apple orchards.
Ann. Entomol. Soc. Am. 2015, 108, 785–799. [CrossRef]
42. Mogren, C.L.; Rand, T.A.; Fausti, S.W.; Lundgren, J.G. The effects of crop intensification on the diversity of
pollinator communities. Environ. Entomol. 2016, 45, 865–872. [CrossRef] [PubMed]
43. Wheelock, M.J.; Rey, K.P.; O’Neal, M.E. Defining the insect pollinator community found in Iowa corn and
soybean fields: Implications for pollinator conservation. Environ. Entomol. 2016, 45, 1099–1106. [CrossRef]
[PubMed]
Insects 2018, 9, 170 20 of 27
44. Hall, M. Blue and yellow vane traps differ in their sampling effectiveness for wild bees in both open and
wooded habitats. Agric. For. Entomol. 2018. [CrossRef]
45. Lebuhn, G.; Connor, E.F.; Brand, M.; Colville, J.F.; Devkota, K.; Thapa, R.B.; Kasina, M.; Joshi, R.K.; Aidoo, K.;
Kwapong, P.; et al. Monitoring pollinators around the world. In Pollination Services to Agriculture: Sustaining
and Enhancing a Key Ecosystem Service; Food and Agriculture Organization of the United Nations & Routledge:
New York, NY, USA, 2016.
46. Lebuhn, G.; Droege, S.; Connor, E.F.; Gemmill-Herren, B.; Potts, S.G.; Minckley, R.L.; Griswold, T.; Jean, R.;
Kula, E.; Roubik, D.W.; et al. Detecting insect pollinator declines on regional and global scales. Conserv. Biol.
2012, 27, 113–120. [CrossRef] [PubMed]
47. Lebuhn, G.; Droege, S.; Connor, E.; Gemmill-Herren, B.; Azzu, N. Protocol to Detect and Monitor Pollinator
Communities: Guidance for Practitioners; Food and Agriculture Organization of the United Nations: Rome,
Italy, 2015; p. 54.
48. Tepedino, V.J.; Durham, S.; Cameron, S.A.; Goodell, K. Documenting bee decline or squandering scarce
resources. Conserv. Biol. 2015, 29, 280–282. [CrossRef] [PubMed]
49. Lebuhn, G.; Droege, S.; Connor, E.F.; Gemmill-Herren, B.; Potts, S.G.; Minckley, R.L.; Jean, R.P.; Kula, E.;
Roubik, D.W.; Wright, K.W.; et al. Evidence-based conservation: Reply to Tepedino et al. Conserv. Biol. 2015,
29, 283–285. [CrossRef] [PubMed]
50. Malaise, R. A new insect-trap. Entomol. Tidskr. 1937, 58, 148–160.
51. Townes, H. A light-weight Malaise trap. Entomol. News 1972, 83, 239–247.
52. Matthews, R.W.; Matthews, J.R. Malaise traps: The Townes model catches more insects. Contrib. Am. Entomol.
Inst. 1983, 20, 428–432.
53. Matthews, R.W.; Matthews, J.R. The Malaise trap: Its utility and potential for sampling insect populations.
Mich. Entomol. 1971, 4, 117–122.
54. Noyes, J.S. A study of five methods of sampling Hymenoptera (Insecta) in a tropical rainforest, with special
reference to Parasitica. J. Nat. Hist. 1989, 23, 285–298. [CrossRef]
55. Bartholomew, C.S.; Prowell, D. Pan compared to Malaise trapping for bees (Hymenoptera: Apoidea) in a
longleaf pine savanna. J. Kans. Entomol. Soc. 2005, 78, 390–392. [CrossRef]
56. Ngo, H.T.; Gibbs, J.; Griswold, T.; Packer, L. Evaluating bee (Hymenoptera: Apoidea) diversity using Malaise
traps in coffee landscapes of Costa Rica. Can. Entomol. 2013, 145, 435–453. [CrossRef]
57. McCravy, K.W.; Geroff, R.K.; Gibbs, J. Malaise trap sampling efficiency for bees (Hymenoptera: Apoidea) in
a restored tallgrass prairie. Fla. Entomol. 2016, 99, 321–323. [CrossRef]
58. McCravy, K.W.; Geroff, R.K.; Gibbs, J. Bee (Hymenoptera: Apoidea: Anthophila) functional traits in relation
to sampling methodology in a restored tallgrass prairie. Fla. Entomol. 2019, in press.
59. Roberts, R.H. Color of Malaise trap and the collection of Tabanidae. Mosq. News 1970, 30, 567–571.
60. Ceuthophilus. Available online: https://en.wikipedia.org/wiki/Malaise_trap (accessed on 29 April 2005).
61. Yi, Z.; Jinchao, F.; Dayuan, X.; Weiguo, S.; Axmacher, J.C. A comparison of terrestrial arthropod sampling
methods. J. Resour. Ecol. 2012, 3, 174–182. [CrossRef]
62. Giles, V.; Ascher, J.S. A survey of the bees of the Black Rock Forest Preserve, New York (Hymenoptera:
Apoidea). J. Hymenopt. Res. 2006, 15, 208–231.
63. Dressler, R.L. Biology of the orchid bees (Euglossini). Ann. Rev. Ecol. Syst. 1982, 13, 373–394. [CrossRef]
64. Ackerman, J.D. Specificity and mutual dependency of the orchid-euglossine bee interaction. Biol. J. Linn. Soc.
2008, 20, 301–314. [CrossRef]
65. Briggs, H.M.; Perfecto, I.; Brosi, B.J. The role of the agricultural matrix: Coffee management and euglossine
bee (Hymenoptera: Apidae: Euglossini) communities in southern Mexico. Environ. Entomol. 2013, 42,
1210–1217. [CrossRef] [PubMed]
66. Roubik, D.W.; Hanson, P.E. Orchid Bees of Tropical America: Biology and Field Guide; INBio: Santo Domingo de
Heredia, Costa Rica, 2004; p. 370.
67. McCravy, K.W.; Van Dyke, J.; Creedy, T.J.; Williams, K. Comparison of orchid bee (Hymenoptera: Apidae)
species composition collected with four chemical attractants. Fla. Entomol. 2017, 100, 528–531. [CrossRef]
68. Nemésio, A.; Vasconcelos, H.L. Effectiveness of two sampling protocols to survey orchid bees (Hymenoptera:
Apidae) in the Neotropics. J. Insect Conserv. 2014, 18, 197–202. [CrossRef]
69. Nemésio, A. Methodological concerns and challenges in ecological studies with orchid bees (Hymenoptera:
Apidae: Euglossina). Biosci. J. 2012, 28, 118–135.
Insects 2018, 9, 170 21 of 27
70. Morandin, L.A.; Winston, M.L. Wild bee abundance and seed production in conventional, organic,
and genetically modified canola. Ecol. Appl. 2005, 15, 871–881. [CrossRef]
71. Morandin, L.A.; Winston, M.L. Pollinators provide economic incentive to preserve natural land in
agroecosystems. Agric. Ecosyst. Environ. 2006, 116, 289–292. [CrossRef]
72. Morandin, L.A.; Winston, M.L.; Abbott, V.A.; Franklin, M.T. Can pastureland increase wild bee abundance
in agriculturally intense areas? Basic Appl. Ecol. 2007, 8, 117–124. [CrossRef]
73. Kwaiser, K.S.; Hendrix, S.D. Diversity and abundance of bees (Hymenoptera: Apiformes) in native and
ruderal grasslands of agriculturally dominated landscapes. Agric. Ecosyst. Environ. 2008, 124, 200–204.
[CrossRef]
74. Stubbs, C.S.; Drummond, F.A.; Allard, S.L. Bee conservation and increasing Osmia spp. in Maine lowbush
blueberry fields. Northeast. Nat. 1997, 4, 133–144. [CrossRef]
75. Krombein, K.V. Trap-Nesting Wasps and Bees: Life Histories, Nests, and Associates; Smithsonian Press:
Washington, DC, USA, 1967; p. 570.
76. Forrest, J.R.K.; Thomson, J.D. An examination of synchrony between insect emergence and flowering in
Rocky Mountain meadows. Ecol. Monogr. 2011, 81, 469–491. [CrossRef]
77. Campbell, J.W.; Smithers, C.; Irvin, A.; Kimmel, C.B.; Stanley-Stahr, C.; Daniels, J.C.; Ellis, J.D. Trap nesting
wasps and bees in agriculture: A comparison of sown wildflower and fallow plots in Florida. Insects 2017, 8,
107. [CrossRef] [PubMed]
78. Steffan-Dewenter, I. Landscape context affects trap-nesting bees, wasps, and their natural enemies.
Ecol. Entomol. 2002, 27, 631–637. [CrossRef]
79. Lindsey, J.K. Available online: https://commons.wikimedia.org/wiki/File:Poecilus.cupreus.jpg (accessed on
11 May 2004).
80. McLemore, A. Available online: https://commons.wikimedia.org/wiki/File:Wheel_Bug_%26_Prey_
Japanese_Beetle.jpg (accessed on 22 January 2009).
81. Dumas, H. Available online: https://en.wikipedia.org/wiki/Campopleginae (accessed on 16 August 2008).
82. Reijnders, P. Available online: https://www.flickr.com/photos/pdreijnders/4776385275/ (accessed on
27 June 2010).
83. Uetz, G.W.; Unzicker, J.D. Pitfall trapping in ecological studies of wandering spiders. J. Arachnol. 1976, 3,
101–111.
84. Thiele, H.-U. Carabid Beetles in Their Environments; Springer: Berlin, Germany, 1977; p. 367.
85. Woodcock, B.A. Pitfall trapping in ecological studies. In Insect Sampling in Forest Ecosystems; Blackwell
Publishing: Malden, MA, USA, 2005.
86. Hoekman, D.; LeVan, K.E.; Ball, G.E.; Browne, R.A.; Davidson, R.L.; Erwin, T.L.; Knisley, C.B.; LaBonte, J.R.;
Lundgren, J.; Maddison, D.R.; et al. Design for ground beetle abundance and diversity sampling within the
National Ecological Observatory Network. Ecosphere 2017, 8, e01744. [CrossRef]
87. Barber, H.S. Traps for cave inhabiting insects. J. Elisha Mitchell Sci. Soc. 1931, 46, 259–266.
88. Fichter, E. Apparatus for the comparison of soil surface arthropod populations. Ecology 1941, 22, 338–339.
[CrossRef]
89. Hansen, J.E.; New, T.R. Use of barrier pitfall traps to enhance inventory surveys of epigaeic Coleoptera.
J. Insect Conserv. 2005, 9, 131–136. [CrossRef]
90. Ng, K.; Barton, P.S.; Macfadyen, S.; Lindenmayer, D.B.; Driscoll, D.A. Beetle’s responses to edges in
fragmented landscapes are driven by adjacent farmland use, season and cross-habitat movement. Landsc. Ecol.
2018, 33, 109–125. [CrossRef]
91. Greenslade, P.; Greenslade, P.J.M. The use of baits and preservatives in pitfall traps. J. Aust. Entomol. Soc.
1971, 10, 253–260. [CrossRef]
92. Maelfait, J.P.; Baert, L. Contributions to the knowledge of the arachno- and entomo-fauna of different wood
habitats. Part I. Sampled habitats, theoretical study of the pitfall method, survey of the captured taxa.
Biol. Jb. Dodonaea 1975, 43, 179–196.
93. McCravy, K.W.; Lundgren, J.G. Carabid beetles (Coleoptera: Carabidae) of the Midwestern United States:
A review and synthesis of recent research. Terr. Arthropod Rev. 2011, 4, 63–94. [CrossRef]
94. Lundgren, J.G. Ground beetles as weed control agents: Effects of farm management on granivory.
Am. Entomol. 2005, 51, 224–226. [CrossRef]
Insects 2018, 9, 170 22 of 27
95. Lundgren, J.G.; Shaw, J.T.; Zaborski, E.R.; Eastman, C.E. The influence of organic transition systems on
beneficial ground-dwelling arthropods and predation of insects and weed seeds. Renew. Agric. Food Syst.
2006, 21, 227–237. [CrossRef]
96. O’Neal, M.E.; Mason, K.S.; Isaacs, R. Seasonal abundance of ground beetles in highbush blueberry
(Vaccinium corymbosum) fields and response to a reduced-risk insecticide program. Environ. Entomol. 2005,
34, 378–384. [CrossRef]
97. Lopez, M.D.; Prasifka, J.R.; Bruck, D.J.; Lewis, L.C. Utility of ground beetle species in field tests of potential
nontarget effects of Bt crops. Environ. Entomol. 2005, 34, 1317–1324. [CrossRef]
98. Lee, M.S.; Albajes, R. Monitoring carabid indicators could reveal environmental impacts of genetically
modified maize. Agric. For. Entomol. 2016, 18, 238–249. [CrossRef]
99. Cajaiba, R.L.; Périco, E.; da Silva, W.B.; Vieira, T.B.; Dalzochio, M.S.; Bastos, R.; Cabral, J.A.; Santos, M. How
informative is the response of ground beetles’ (Coleoptera: Carabidae) assemblages to anthropogenic land
use changes? Insights for ecological status assessments from a case study in the Neotropics. Sci. Total Environ.
2018, 636, 1219–1227. [CrossRef] [PubMed]
100. Li, X.; Liu, Y.; Duan, M.; Yu, Z.; Axmacher, J.C. Different response patterns of epigaeic spiders and carabid
beetles to varying environmental conditions in fields and semi-natural habitats of an intensively cultivated
agricultural landscape. Agric. Ecosyst. Environ. 2018, 264, 54–62. [CrossRef]
101. Topping, C.J.; Sunderland, K.D. Limitations to the use of pitfall traps in ecological studies exemplified by a
study of spiders in a field of winter wheat. J. Appl. Ecol. 1992, 29, 485–491. [CrossRef]
102. Greenslade, P.J.M. Pitfall trapping as a method for studying populations of Carabidae (Coleoptera).
J. Anim. Ecol. 1964, 33, 301–310. [CrossRef]
103. Van der Drift, J. Analysis of the animal community in a beech forest floor. Tijdschr. Entmol. 1951, 94, 1–168.
104. Halsall, N.B.; Wratten, S.D. The efficiency of pitfall trapping for polyphagous predatory Carabidae.
Ecol. Entomol. 1988, 13, 293–299. [CrossRef]
105. Willand, J.E.; McCravy, K.W. Variation in diel activity of ground beetles (Coleoptera: Carabidae) associated
with a soybean field and coal mine remnant. Gt. Lakes Entomol. 2006, 39, 141–148.
106. Adis, J. Problems of interpreting arthropod sampling with pitfall traps. Zool. Anz. 1979, 3/4, 177–184.
107. McCravy, K.W.; Willand, J.E. Effects of pitfall trap preservative on collections of carabid beetles (Coleoptera:
Carabidae). Gt. Lakes Entomol. 2007, 40, 154–165.
108. Baars, M.A. Catches in pitfall traps in relation to mean densities of carabid beetles. Oecologia 1979, 41, 25–46.
[CrossRef] [PubMed]
109. Holland, J.M.; Smith, S. Sampling epigeal arthropods: An evaluation of fenced pitfall traps using
mark-release-recapture and comparisons to unfenced pitfall traps in arable crops. Entomol. Exp. Appl.
1999, 91, 347–357. [CrossRef]
110. Mnolf. Available online: https://en.wikipedia.org/wiki/Pitfall_trap (accessed on 21 May 2017).
111. Dietrick, E.J. An improved backpack motor fan for suction sampling of insect populations. J. Econ. Entomol.
1961, 54, 394–395. [CrossRef]
112. Sunderland, K.D.; De Snoo, G.R.; Dinter, A.; Hance, T.; Helenius, J.; Jepson, P.; Kromp, B.; Lys, J.-A.; Samu, F.;
Sotherton, N.W.; et al. Density estimation for invertebrate predators in agroecosystems. In Arthropod Natural
Enemies in Arable Land I—Density, Spatial Heterogeneity and Dispersal; Aarhus University Press: Aarhus,
Denmark, 1995.
113. Toft, S.; Vangsgaard, C.; Goldschmidt, H. The distance method used to measure densities of web spiders
in cereal fields. In Arthropod Natural Enemies in Arable Land I—Density, Spatial Heterogeneity and Dispersal;
Aarhus University Press: Aarhus, Denmark, 1995.
114. Schmidt, M.H.; Tscharntke, T. The role of perennial habitats for Central European farmland spiders.
Agric. Ecosyst. Environ. 2005, 105, 235–242. [CrossRef]
115. Southwood, T.R.E. Ecological Methods with Particular Reference to the Study of Insect Populations, 2nd ed.;
Chapman and Hall: London, UK, 1978; p. 524.
116. Törmälä, T. Evaluation of five methods of sampling field layer arthropods, particularly the leafhopper
community, in grassland. Ann. Entomol. Fenn. 1982, 48, 1–16.
117. Marrec, R.; Badenhausser, I.; Bretagnolle, V.; Börger, L.; Roncoroni, M.; Guillon, N.; Gauffre, B. Crop
succession and habitat preferences drive the distribution and abundance of carabid beetles in an agricultural
landscape. Agric. Ecosyst. Environ. 2014, 199, 282–289. [CrossRef]
Insects 2018, 9, 170 23 of 27
118. Hanson, H.I.; Palmu, E.; Birkhofer, K.; Smith, H.G.; Hedlund, K. Agricultural land use determines the trait
composition of ground beetle communities. PLoS ONE 2016, 11, e0146329. [CrossRef] [PubMed]
119. Sarthou, J.-P.; Badoz, A.; Vaissière, B.; Chevallier, A.; Rusch, A. Local more than landscape parameters
structure natural enemy communities during their overwintering in semi-natural habitats. Agric. Ecosyst.
Environ. 2014, 194, 17–28. [CrossRef]
120. Rice, R.E.; Reynolds, H.T. Seasonal emergence and population development of the pink bollworm in southern
California. J. Econ. Entomol. 1971, 64, 1429–1432. [CrossRef]
121. Desender, K.; Segers, R. A simple device and technique for quantitative sampling of riparian beetle
populations with some carabid and staphylinid abundance estimates on different riparian habitats
(Coleoptera). Rev. Ecol. Biol. Sol. 1985, 22, 497–506.
122. Brenøe, J. Wet extraction—A method for estimating populations of Bembidion lampros (Herbst)
(Col., Carabidae). J. Appl. Entomol. 1987, 103, 124–127. [CrossRef]
123. Basedow, T.; Klinger, K.; Froese, A.; Yanes, G. Aufschwemmung mit wasser, zur schnellbestimmung der
abundanz epigäischer rauparthropoden auf äckern. Pedobiologia 1988, 32, 317–322.
124. Kromp, B.; Pflügl, C.; Hradetzky, R.; Idinger, J. Estimating beneficial arthropod densities using emergence
traps, pitfall traps and the flooding method in organic fields (Vienna, Austria). Acta Jutl. 1995, 70, 87–100.
125. Hammer, M. Studies on the oribatids and collemboles of Greenland. Medd. Grenland 1944, 141, 1–210.
126. Haarløv, N. A new modification of the Tullgren apparatus. J. Anim. Ecol. 1947, 16, 115–121. [CrossRef]
127. Alderweireldt, M. Density fluctuations of spiders on maize and Italian ryegrass fields. Meded. Fac.
Landbouwwet. Rijksuniv. Gent 1987, 52, 273–282.
128. Chiverton, P.A. The creation of within-field overwintering sites for natural enemies of cereal aphids.
In Proceedings of the 1989 Brighton Crop Protection Conference—Weeds; Department for Environment, Food and
Rural Affairs: London, UK, 1989; pp. 1093–1096.
129. Gill, H.K.; McSorley, R. Methods for sampling soil surface arthropods in bush beans: Which one is the best?
Proc. Fla. State Hortic. Soc. 2012, 125, 192–195.
130. Brower, J.E.; Zar, J.H.; von Ende, C.N. Field and Laboratory Methods for General Ecology, 4th ed.;
WCB/McGraw-Hill: Boston, MA, USA, 1998; p. 273.
131. Cloudsley-Thompson, J.L. Evolution and Adaptation of Terrestrial Arthropods; Springer: Berlin, Germany, 1988;
p. 141.
132. Cole, L.C. A study of the cryptozoa of an Illinois woodland. Ecol. Monogr. 1946, 16, 49–86. [CrossRef]
133. Jenson, P. Changes in cryptozoan numbers due to systematic variation of covering boards. Ecology 1968, 49,
409–418. [CrossRef]
134. Dangerfield, J.M.; Telford, S.R. Are millipedes important for soil fertility. Zimb. Sci. News 1989, 23, 66–68.
135. Dangerfield, J.M.; Telford, S.R. Seasonal activity patterns of julid millipedes in Zimbabwe. J. Trop. Ecol. 1991,
7, 281–285. [CrossRef]
136. Gill, H.K.; McSorley, R.; Buss, L. The Insect Community on the Soil Surface; ENY-859 (IN876); Florida
Cooperative Extension Service: Gainesville, FL, USA, 2011; p. 7.
137. Nyffeler, M. Field Studies on the Ecological Role of the Spiders as Insect Predators in Agroecosystems
(Abandoned Grassland, Meadows, and Cereal Fields). Ph.D. Thesis, Swiss Federal Institute of Technology,
Zurich, Switzerland, 1982.
138. Chambers, R.J.; Adams, T.H.L. Quantification of the impact of hoverflies (Diptera: Syrphidae) on cereal
aphids in winter wheat: An analysis of field populations. J. Appl. Ecol. 1986, 23, 895–904. [CrossRef]
139. Elliott, N.C.; Kieckhefer, R.W.; Kauffman, W.C. Estimating adult coccinellid populations in wheat fields by
removal, sweep net, and visual count sampling. Can. Entomol. 1991, 123, 13–22. [CrossRef]
140. Duffey, E. Comparative sampling methods for grassland spiders. Bull. Br. Arachnol. Soc. 1974, 3, 34–37.
141. Greenstone, M.H. Spiders in wheat: First quantitative data for North America. BioControl 2001, 46, 439–454.
[CrossRef]
142. Nasir, S.; Akram, W.; Zahid, F.M.; Ahmed, F.; Hussain, S.M.; Nasir, I. Effect of crop type and production
systems (conventional and organic agriculture) on the density of rove beetles (Staphylinidae: Coleoptera) in
the Punjab, Pakistan. J. Kans. Entomol. Soc. 2015, 88, 1–9. [CrossRef]
143. Tonkyn, D.W. The formula for the volume sampled by a sweep net. Ann. Entomol. Soc. Am. 1980, 73, 452–454.
[CrossRef]
Insects 2018, 9, 170 24 of 27
144. Burgio, G.; Ferrari, R.; Boriani, L.; Pozzati, M.; van Lenteren, J. The role of ecological infrastructures on
Coccinellidae (Coleoptera) and other predators in weedy field margins within northern Italy agroecosystems.
Bull. Insect. 2006, 59, 59–67.
145. Heikinheimo, O.; Raatikainen, M. Comparison of suction and netting methods in population investigations
concerning the fauna of grass leys and cereal fields, particularly in those concerning the leafhopper,
Calligypona pellucida (F.). Valt. Maatalourk. Julk. Helsingfors. 1962, 191, 31.
146. Pruess, K.P.; Lal Saxena, K.M.; Koinzan, S. Quantitative estimation of alfalfa insect populations by removal
sweeping. Environ. Entomol. 1977, 6, 705–708. [CrossRef]
147. Dewar, A.M.; Dean, G.J.; Cannon, R. Assessment of methods for estimating the numbers of aphids
(Hemiptera: Aphididae) in cereals. Bull. Entomol. Res. 1982, 72, 675–685. [CrossRef]
148. Hand, S.C. The capture efficiency of the Dietrick vacuum insect net for aphids on grasses and cereals.
Ann. Appl. Biol. 1986, 108, 233–241. [CrossRef]
149. Elliott, N.C.; Tao, F.L.; Fuentes-Granados, R.; Giles, K.L.; Elliott, D.T.; Greenstone, M.H.; Shufran, K.A.;
Royer, T.A. D-vac sampling for predatory arthropods in winter wheat. Biol. Control 2006, 38, 325–330.
[CrossRef]
150. Duffey, E. The efficiency of the Dietrick vacuum sampler (D-VAC) for invertebrate population studies in
different types of grassland. Bull. Ecol. 1980, 11, 421–431.
151. Sunderland, K.D.; Topping, C.J. Estimating population densities of spiders in cereals. In Arthropod Natural
Enemies in Arable Land I—Density, Spatial Heterogeneity and Dispersal; Aarhus University Press: Aarhus,
Denmark, 1995.
152. Buffington, M.L.; Redak, R.A. A comparison of vacuum sampling versus sweep-netting for arthropod
biodiversity measurements in California coastal sage scrub. J. Insect Conserv. 1998, 2, 99–106. [CrossRef]
153. Rudd, W.G.; Jensen, R.L. Sweep net and ground cloth sampling for insects in soybeans. J. Econ. Entomol.
1977, 70, 301–304. [CrossRef]
154. Lord, F.T. Sampling predator populations on apple trees in Nova Scotia. Can. Entomol. 1965, 97, 287–298.
[CrossRef]
155. Masetti, A.; Magagnoli, S.; Lami, F.; Lanzoni, A.; Burgio, G. Long term changes in the communities of native
ladybirds in Northern Italy: Impact of the invasive species Harmonia axyridis (Pallas). BioConrol 2018, 63,
665–675. [CrossRef]
156. Richards, O.W.; Waloff, N. A study of a natural population of Phytodecta olivacea (Forster) (Coleoptera,
Chrysomeloidea). Phil. Trans. R. Soc. B 1961, 244, 204–257. [CrossRef]
157. Bakowski, M.; Piekarska-Boniecka, H.; Dolańska-Niedbala, E. Monitoring of the red-belted clearwing moth,
Synanthedon myopaeformis, and its parasitoid Liotryphon crassiseta in apple orchards in yellow Moericke traps.
J. Insect Sci. 2013, 13. [CrossRef] [PubMed]
158. McCravy, K.W.; Berisford, C.W. Effects of vegetation control on parasitoids of the Nantucket pine tip moth,
Rhyacionia frustrana (Lepidoptera: Tortricidae). Fla. Entomol. 2001, 84, 282–287. [CrossRef]
159. McClain, D.C.; Rock, G.C.; Woolley, J.B. Influence of trap color and San Jose scale (Homoptera: Diaspididae)
pheromone on sticky trap catches of 10 aphelinid parasitoids (Hymenoptera). Environ. Entomol. 1990, 19,
926–931. [CrossRef]
160. Hall, A.A.G.; Johnson, S.N.; Cook, J.M.; Riegler, M. High nymphal host density and mortality negatively
impact parasitoid complex during an insect herbivore outbreak. Insect Sci. 2017. [CrossRef] [PubMed]
161. Da Silva, G.D.; Jahnke, S.M.; Ferreira, M.L.G. Hymenoptera parasitoids in protected area of Atlantic Forest
biomes and organic rice field: Compared assemblages. Rev. Colomb. Entomol. 2016, 42, 110–117.
162. Daniel, J.A.; Ramaraju, K. A study of three methods of sampling Chalcididae and Pteromalidae in major rice
ecosystems of Tamil Nadu. J. Exp. Zool. India 2017, 20, 1037–1041.
163. Shweta, M.; Rajmohana, K. A comparison of efficiencies of sweep net, yellow pan trap and Malaise trap in
sampling Platygastridae (Hymenoptera: Insecta). J. Exp. Zool. India 2016, 19, 393–396.
164. Shweta, M.; Rajmohana, K. A comparison of sweep net, yellow pan trap and malaise trap for sampling
parasitic Hymenoptera in a backyard habitat in Kerala. Entomon 2018, 43, 33–44.
165. Wells, W.; Decker, T. A comparison of three types of insect traps for collecting non-Formicidae Hymenoptera
on the island of Dominica. Southwest. Entomol. 2006, 31, 59–68.
166. Hudson, W.G.; Frank, J.H.; Castner, J.L. Biological control of Scapteriscus spp. mole crickets (Orthoptera:
Gryllotalpidae) in Florida. Bull. Entomol. Soc. Am. 1988, 34, 192–198. [CrossRef]
Insects 2018, 9, 170 25 of 27
167. Frank, J.H.; Parkman, J.P.; Bennett, F.D. Larra bicolor (Hymenoptera: Sphecidae), a biological control agent of
Scapteriscus mole crickets (Orthoptera: Gryllotalpidae), established in northern Florida. Fla. Entomol. 1995,
78, 619–623. [CrossRef]
168. Richter, M.R. Social wasp (Hymenoptera: Vespidae) foraging behavior. Annu. Rev. Entomol. 2000, 45, 121–150.
[CrossRef] [PubMed]
169. O’Neill, K.M.; Evans, H.E. Alternative male mating tactics in Bembecinus quinquespinosus (Hymenoptera:
Sphecidae): Correlations with size and color variation. Behav. Ecol. Sociobiol. 1983, 14, 39–46. [CrossRef]
170. Ghazi-Soltani, G.; Ebrahimi, E.; Iranipour, S.; Pour Abad, R.F. Sphecid wasps from East Azarbaijan province,
Iran (Hymenoptera: Sphecidae). Munis Entomol. Zool. 2010, 5, 796–803.
171. Atbaei, M.; Fallahzadeh, M.; Ljubomirov, T. A contribution to the fauna of Crabronidae (Hymenoptera,
Apoidea) in South-Western Iran. J. Insect Biodivers. 2015, 3, 1–30. [CrossRef]
172. Moura, J.I.L.; Mariau, D.; Delabie, J.H.C. Efficacy of Paratheresia menezesi Townsend (Diptera: Tachinidae) for
natural biological control of Rhynchophorus palmarum (L.) (Coleoptera: Curculionidae). Oléagineux 1993, 48,
219–223.
173. Sands, D.P.A.; Coombs, M.T. Evaluation of the Argentinian parasitoid, Trichopoda giacomellii (Diptera:
Tachinidae), for biological control of Nezara viridula (Hemiptera: Pentatomidae) in Australia. Biol. Control
1999, 15, 19–24. [CrossRef]
174. Zhang, F.; Toepfer, S.; Riley, K.; Kuhlmann, U. Reproductive biology of Celatoria compressa (Diptera:
Tachinidae), a parasitoid of Diabrotica virgifera virgifera (Coleoptera: Chrysomelidae). Biocontrol Sci. Technol.
2004, 14, 5–16. [CrossRef]
175. Sullivan, G.T.; Karaca, I.; Ozman-Sullivan, S.K.; Kara, K. Tachinid (Diptera: Tachinidae) parasitoids of
overwintered Hyphantria cunea (Drury) (Lepidoptera: Arctiidae) pupae in hazelnut plantations in Samsun
Province, Turkey. J. Entomol. Res. Soc. 2012, 14, 21–30.
176. Draber-Mońko, A. State of knowledge of the tachinid fauna of Eastern Asia, with new data from North
Korea. Part V. Exoristinae. Fragm. Faun. 2015, 58, 79–98.
177. Burgio, G.; Sommaggio, D. Syrphids as landscape bioindicators in Italian agroecosystems. Agric. Ecosyst.
Environ. 2007, 120, 416–422. [CrossRef]
178. McCravy, K.W.; Baxa, K.A. Diversity, seasonal activity and habitat associations of robber flies (Diptera:
Asilidae) in West-Central Illinois. Am. Midl. Nat. 2011, 166, 85–97. [CrossRef]
179. McCravy, K.W. An analysis of Malaise-trap effectiveness in assessing robber fly (Diptera: Asilidae) species
richness. Northeast. Nat. 2017, 24, 15–24. [CrossRef]
180. Martin-Park, A.; Delfin-González, H.; Sosenski, P.; Reyes-Novelo, E.; Meléndez-Ramírez, V.;
Navarrete-Carballo, J.; Ibáñez-Bernal, S.; Dzul-Manzanilla, F.; González-Moreno, A.; Manrique-Saide, P.
Diversity of Tabanidae, Asilidae and Syrphidae (Diptera) in natural protected areas of Yucatan, Mexico.
J. Insect Conserv. 2018, 22, 85–97. [CrossRef]
181. Richards, O.W. The biology of the small white butterfly (Pieris rapae), with special reference to the factors
controlling its abundance. J. Anim. Ecol. 1940, 9, 243–288. [CrossRef]
182. McCravy, K.W.; Berisford, C.W. Parasitoids of the Nantucket pine tip moth (Lepidoptera: Tortricidae) in the
coastal plain of Georgia. J. Entomol. Sci. 2000, 35, 220–226. [CrossRef]
183. McCravy, K.W.; Dalusky, M.J.; Berisford, C.W. Effects of a broad spectrum and biorational insecticides on
parasitoids of the Nantucket pine tip moth (Lepidoptera: Tortricidae). J. Econ. Entomol. 2001, 94, 112–115.
[CrossRef] [PubMed]
184. McAuslane, H.M.; Johnson, F.A.; Knauft, D.A.; Colvin, D.L. Seasonal abundance and within-plant
distribution of parasitoids of Bemisia tabaci (Homoptera: Aleyrodidae) in peanuts. Environ. Entomol. 1993, 22,
1043–1050. [CrossRef]
185. Miller, C.A. A technique for assessing larval mortality caused by parasites. Can. J. Zool. 1955, 33, 5–17.
[CrossRef]
186. Evenhuis, H.H. Methods to investigate the population dynamics of aphids and aphid parasites in orchards.
Entomophaga 1962, 7, 213–220. [CrossRef]
187. Flanders, S.E. Notes on the life history and anatomy of Trichogramma. Ann. Entomol. Soc. Am. 1937, 30,
304–308. [CrossRef]
Insects 2018, 9, 170 26 of 27
188. McCravy, K.W.; Berisford, C.W. Parasitism by Trichogramma spp. (Hymenoptera: Trichogrammatidae) in
relation to Nantucket pine tip moth (Lepidoptera: Tortricidae) egg density and location. Environ. Entomol.
1998, 27, 355–359. [CrossRef]
189. Faria, C.A.; Torres, J.B.; Fernandes, A.M.V.; Farias, A.M.I. Parasitism of Tuta absoluta in tomato plants by
Trichogramma pretiosum Riley in response to host density and plant structures. Ciênc. Rural 2008, 38, 1504–1509.
[CrossRef]
190. Gingras, D.; Dutilleul, P.; Boivin, G. Effect of plant structure on host finding capacity of lepidopterous pests
of crucifers by two Trichogramma parasitoids. Biol. Control 2003, 27, 25–31. [CrossRef]
191. Tabone, E.; Bardon, C.; Desneux, N.; Wajnberg, E. Parasitism of different Trichogramma species and strains on
Plutella xylostella L. on greenhouse cauliflower. J. Pest Sci. 2010, 83, 251–256. [CrossRef]
192. Varley, M.J.; Copland, M.J.W.; Wratten, S.D.; Bowie, M.H. Parasites and predators. In Video Techniques in
Animal Ecology and Behavior; Wratten, S.D., Ed.; Chapman and Hall: London, UK, 1994; pp. 33–63.
193. Jervis, M.; Kidd, N. Insect Natural Enemies: Practical Approaches to Their Study and Evaluation; Chapman and
Hall: London, UK, 1996; p. 491.
194. Furlong, M.J. Knowing your enemies: Integrating molecular and ecological methods to assess the impact of
arthropod predators on crop pests. Insect Sci. 2015, 22, 6–19. [CrossRef] [PubMed]
195. Howe, A.; Lövei, G.L.; Nachman, G. Dummy caterpillars as a simple method to assess predation rates on
invertebrates in a tropical agroecosystem. Entomol. Exp. Appl. 2009, 131, 325–329. [CrossRef]
196. Magagnoli, S.; Masetti, A.; Depalo, L.; Sommaggio, D.; Campanelli, G.; Leteo, F.; Lövei, G.L.; Burgio, G.
Cover crop termination techniques affect ground predation within an organic vegetable rotation system:
A test with artificial caterpillars. Biol. Control 2018, 117, 109–114. [CrossRef]
197. Low, P.A.; Sam, K.; McArthur, C.; Posa, M.R.C.; Hochuli, D.F. Determining predator identity from attack
marks left in model caterpillars: Guidelines for best practice. Entomol. Exp. Appl. 2014, 152, 120–126.
[CrossRef]
198. Macfadyen, S.; Davies, A.P.; Zalucki, M.P. Assessing the impact of arthropod natural enemies on crop pests
at the field scale. Insect Sci. 2015, 22, 20–34. [CrossRef] [PubMed]
199. Zalucki, M.P.; Furlong, M.J.; Schellhorn, N.A.; Macfadyen, S.; Davies, A.P. Assessing the impact of natural
enemies in agroecosystems: Toward “real” IPM or in quest of the Holy Grail? Insect Sci. 2015, 22, 1–5.
[CrossRef] [PubMed]
200. Nicolas, V.; Barriere, P.; Colyn, M. Impact of removal pitfall trapping on the community of shrews (Mammalia:
Soricidae) in two African tropical forest sites. Mammalia 2003, 67, 133–138. [CrossRef]
201. Poe, S.; Armijo, B. Lack of effect of herpetological collecting on the population structure of a community of
Anolis (Squamata: Dactyloidae) in a disturbed habitat. Herpetol. Notes 2014, 7, 153–157.
202. Hope, A.G.; Sandercock, B.K.; Malaney, J.L. Collections of scientific specimens: Benefits for biodiversity
sciences and limited impacts on communities of small mammals. BioScience 2018, 68, 35–42. [CrossRef]
203. Gezon, Z.J.; Wyman, E.S.; Ascher, J.S.; Inouye, D.W.; Irwin, R.E. The effect of repeated, lethal sampling on
wild bee abundance and diversity. Methods Ecol. Evol. 2015, 6, 1044–1054. [CrossRef]
204. Magurran, A.E. Measuring Biological Diversity; Blackwell Publishing: Malden, MA, USA, 2004; p. 256.
205. Chao, A.; Colwell, R.K.; Lin, C.-W.; Gotelli, N.J. Sufficient sampling for asymptotic minimum species richness
estimators. Ecology 2009, 90, 1125–1133. [CrossRef] [PubMed]
206. Hung, K.-L.J.; Ascher, J.S.; Gibbs, J.; Irwin, R.E.; Bolger, D.T. Effects of fragmentation on a distinctive coastal
sage scrub bee fauna revealed through incidental captures by pitfall traps. J. Insect Conserv. 2015, 19, 175–179.
[CrossRef]
207. Hatten, T.D.; Looney, C.; Strange, J.P.; Bosque-Pérez, N.A. Bumble bee fauna of Palouse Prairie: Survey of
native bee pollinators in a fragmented ecosystem. J. Insect Sci. 2013, 13, 26. [CrossRef] [PubMed]
208. Ulyshen, M.D.; Hanula, J.L.; Horn, S. Using Malaise traps to sample ground beetles (Coleoptera: Carabidae).
Can. Entomol. 2005, 137, 251–256. [CrossRef]
209. Darlington, P.J. Carabidae of mountains and islands: Data on the evolution of isolated faunas and on atrophy
of wings. Ecol. Monogr. 1943, 13, 37–64. [CrossRef]
210. Den Boer, P.J. On the significance of dispersal power for populations of carabid beetles (Coleoptera,
Carabidae). Oecologia 1970, 4, 1–28. [CrossRef] [PubMed]
211. Cardenas, A.M.; Bach, C. The influence of environmental changes on wing development in carabids
(Col. Carabidae) in the Guadiato River basin (SW Spain). Vie Milieu 1992, 42, 277–282.
Insects 2018, 9, 170 27 of 27
212. Barber, N.A.; Lamagdeleine-Dent, K.A.; Willand, J.E.; Jones, H.P.; McCravy, K.W. Species and functional trait
re-assembly of ground beetle communities in restored grasslands. Biodivers. Conserv. 2017, 26, 3481–3498.
[CrossRef]
213. Oxbrough, A.; Gittings, T.; Kelly, T.C.; O’Halloran, J. Can Malaise traps be used to sample spiders for
biodiversity assessment? J. Insect Conserv. 2010, 14, 169–179. [CrossRef]
214. Spears, L.R.; Ramirez, R.A. Learning to love leftovers: Using by-catch to expand our knowledge of
entomology. Am. Entomol. 2015, 61, 168–173. [CrossRef]
© 2018 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).