Flying in Complex Environments: Can Insects Bind Multiple Sensory Perceptions and What Could Be the Lessons for Machine Vision?


The possibility of having flying machines in complex natural environments presents many exciting possibilities, but also technical challenges. Insects often rely on visual cues for flight and decision making, and recent work suggests that the perception of wind force through tactile sensory inputs also provides important information for flight control. However, the extent to which these respective cues might potentially be bound together in the brain to enable accurate decisions remains untested. Here we discuss recent evidence that the brain of insects possesses mechanisms that may allow for the binding of complex multisensory information, and we propose an experiment that could dissect whether insects like bees may have such a capacity. We additionally discuss areas of the bee brain that might facilitate decision making in order to provide a road map forward for future work on understanding the mechanisms of flying in complex natural environments.

Share and Cite:

Dyer, A. , Ravi, S. and Garcia, J. (2014) Flying in Complex Environments: Can Insects Bind Multiple Sensory Perceptions and What Could Be the Lessons for Machine Vision?. Journal of Software Engineering and Applications, 7, 406-412. doi: 10.4236/jsea.2014.75037.

Conflicts of Interest

The authors declare no conflicts of interest.


[1] Giurfa, M., Vorobyev, M., Kevan, P. and Menzel, R. (1996) Detection of Coloured Stimuli by Honeybees: Minimum Visual Angles and Receptor Specific Contrasts. Journal of Comparative Physiology A: Neuroethology, Sensory, Neural, and Behavioral Physiology, 178, 699-709.
[2] Vuong, Q.C. and Tarr, M.J. (2004) Rotation Direction Affects Object Recognition. Vision Research, 44, 1717-1730.
[3] Ravi, S., Crall, J.D., Fisher, A. and Combes, S.A. (2013) Rolling with the Flow: Bumblebees Flying in Unsteady Wakes. Journal of Experimental Biology, 216, 4299-4309.
[4] Dyer, A.G., Paulk, A.C. and Reser, D.H. (2011) Colour Processing in Complex Environments: Insights from the Visual System of Bees. Proceedings of the Royal Society B: Biological Sciences, 278, 952-959.
[5] Dyer, A.G., Spaethe, J. and Prack, S. (2008) Comparative Psychophysics of Bumblebee and Honeybee Colour Discrimination and Object Detection. Journal of Comparative Physiology A: Neuroethology, Sensory, Neural, and Behavioral Physiology, 194, 617-627.
[6] Dyer, A.G. and Griffiths, D.W. (2012) Seeing Near and Seeing Far; Behavioural Evidence for Dual Mechanisms of Pattern Vision in the Honeybee (Apis Mellifera). The Journal of Experimental Biology, 215, 397-404.
[7] Avarguès-Weber, A., d’Amaro, D., Metzler, M. and Dyer, A.G. (2014) Conceptualization of Relative Size by Honeybees. Frontiers in Behavioral Neuroscience, 8, 80.
[8] Avarguès-Weber, A. and Giurfa, M. (2013) Conceptual Learning by Miniature Brains. Proceedings of the Royal Society B: Biological Sciences, 280, Article ID: 20131907.
[9] Horridge, A. (2000) Seven Experiments on Pattern Vision of the Honeybee, with a Model. Vision Research, 40, 2589-2603.
[10] Avarguès-Weber, A., de Brito Sanchez, M.G., Giurfa, M. and Dyer, A.G. (2010) Aversive Reinforcement Improves Visual Discrimination Learning in Free-Flying Honeybees. PLoS ONE, 5, Article ID: e15370.
[11] Avarguès-Weber, A., Portelli, G., Benard, J., Dyer, A. and Giurfa, M. (2010) Configural Processing Enables Discrimination and Categorization of Face-Like Stimuli in Honeybees. Journal of Experimental Biology, 213, 593-601.
[12] Giurfa, M., Hammer, M., Stach, S., Stollhoff, N., Müller-Deisig, N. and Mizyrycki, C. (1999) Pattern Learning by Honeybees: Conditioning Procedure and Recognition Strategy. Animal Behaviour, 57, 315-324.
[13] Giurfa, M., Schubert, M., Reisenman, C., Gerber, B. and Lachnit, H. (2003) The Effect of Cumulative Experience on the Use of Elemental and Configural Visual Discrimination Strategies in Honeybees. Behavioural Brain Research, 145, 161-169.
[14] Stach, S., Benard, J. and Giurfa, M. (2004) Local-Feature Assembling in Visual Pattern Recognition and Generalization in Honeybees. Nature, 429, 758-761.
[15] Stach, S. and Giurfa, M. (2005) The Influence of Training Length on Generalization of Visual Feature Assemblies in Honeybees. Behavioural Brain Research, 161, 8-17.
[16] Chittka, L., Dyer, A.G., Bock, F. and Dornhaus, A. (2003) Psychophysics: Bees Trade off Foraging Speed for Accuracy. Nature, 424, 388.
[17] Quinn, P.C., Polly, J.L., Furer, M.J., Dobson, V. and Narter, D.B. (2002) Young Infants’ Performance in the ObjectVariation Version of the Above-Below Categorization Task: A Result of Perceptual Distraction or Conceptual Limitation? Infancy, 3, 323-347.
[18] Spinozzi, G., Lubrano, G. and Truppa, V. (2004) Categorization of Above and Below Spatial Relations by Tufted Capuchin Monkeys (Cebus apella). Journal of Comparative Psychology, 118, 403-412.
[19] Chittka, L. and Jensen, K. (2011) Animal Cognition: Concepts from Apes to Bees. Current Biology, 21, R116-R119.
[20] Avarguès-Weber, A., Dyer, A.G., Combe, M. and Giurfa, M. (2012) Simultaneous Mastering of Two Abstract Concepts by the Miniature Brain of Bees. Proceedings of the National Academy of Sciences of the United States of America, 109, 7481-7486.
[21] Chittka, L. and Dyer, A. (2012) Cognition: Your Face Looks Familiar. Nature, 481, 154-155.
[22] Chittka, L. and Niven, J. (2009) Are Bigger Brains Better? Current Biology, 19, R995-R1008.
[23] Vicens, N. and Bosch, J. (2000) Weather-Dependent Pollinator Activity in an Apple Orchard, with Special Reference to Osmia cornuta and Apis mellifera (Hymenoptera: Megachilidae and Apidae). Environmental Entomology, 29, 413420.
[24] Stull, R.B. (1988) An Introduction to Boundary Layer Meteorology. Springer, Berlin.
[25] Combes, S.A. and Dudley, R. (2009) Turbulence-Driven Instabilities Limit Insect Flight Performance. Proceedings of the National Academy of Sciences of the United States of America, 106, 9105-9108.
[26] Watkins, S., Milbank, J., Loxton, B.J. and Melbourne, W.H. (2006) Atmospheric Winds and Their Implications for Microair Vehicles. AIAA Journal, 44, 2591-2600.
[27] Luu, T., Cheung, A., Ball, D. and Srinivasan, M.V. (2011) Honeybee Flight: A Novel ‘Streamlining’ Response. Journal of Experimental Biology, 214, 2215-2225.
[28] Ortega-Jimenez, V.M., Greeter, J.S.M., Mittal, R. and Hedrick, T.L. (2013) Hawkmoth Flight Stability in Turbulent Vortex Streets. Journal of Experimental Biology, 216, 4567-4579.
[29] Dyer, A.G. (2007) Windy Condition Affected Colour Discrimination in Bumblebees (Hymenoptera: Apidae: Bombus). Entomologia Generalis, 30, 165-166.
[30] Srinivasan, M.V., Zhang, S., Altwein, M. and Tautz, J. (2000) Honeybee Navigation: Nature and Calibration of the “Odometer”. Science, 287, 851-853.
[31] Vladusich, T., Hemmi, J.M., Srinivasan, M.V. and Zeil, J. (2005) Interactions of Visual Odometry and Landmark Guidance during Food Search in Honeybees. Journal of Experimental Biology, 208, 4123-4135.
[32] Chittka, L. and Geiger, K. (1995) Can Honey Bees Count Landmarks? Animal Behaviour, 49, 159-164.
[33] Heiling, A.M., Herberstein, M.E. and Chittka, L. (2003) Pollinator Attraction: Crab-Spiders Manipulate Flower Signals. Nature, 421, 334.
[34] Fuller, S.B., Straw, A., Peek, M., Murray, R. and Dickinson, M. (2014) Flying Drosophila Stabilize Their Vision-Based Velocity Controller by Sensing Wind with Their Antennae. Proceedings of the National Academy of Sciences of the United States of America, 111, E1182-E1191.
[35] Dickinson, M.H. (2014) Death Valley, Drosophila, and the Devonian Toolkit. Annual Review of Entomology, 59, 51-72.
[36] Skorupski, P. and Chittka, L. (2010) Differences in Photoreceptor Processing Speed for Chromatic and Achromatic Vision in the Bumblebee, Bombus terrestris. Journal of Neuroscience, 30, 3896-3903.
[37] Ehmer, B. and Gronenberg, W. (2002) Segregation of Visual Input to the Mushroom Bodies in the Honeybee (Apis mellifera). Journal of Comparative Neurology, 451, 362-373.
[38] Grünewald, B. (1999) Physiological Properties and Response Modulations of Mushroom Body Feedback Neurons during Olfactory Learning in the Honeybee, Apis mellifera. Journal of Comparative Physiology A, 185, 565-576.
[39] Leonard, A. and Masek, P. (2014) Multisensory Integration of Colors and Scents: Insights from Bees and Flowers. Journal of Comparative Physiology A, Epub Ahead of Print.
[40] Niggebrugge, C., Leboulle, G., Menzel, R., Komischke, B. and de Ibarra, N.H. (2009) Fast Learning but Coarse Discrimination of Colours in Restrained Honeybees. Journal of Experimental Biology, 212, 1344-1350.
[41] Giurfa, M., Núnez, J. and Backhaus, W. (1994) Odour and Colour Information in the Foraging Choice Behaviour of the Honeybee. Journal of Comparative Physiology A, 175, 773-779.
[42] Giurfa, M., Zhang, S., Jenett, A., Menzel, R. and Srinivasan, M.V. (2001) The Concepts of “Sameness” and “Difference” in an Insect. Nature, 410, 930-933.

Copyright © 2021 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.