information theory literature review

• [email protected]
• +971 507 888 742

Information Technology Journal

• Vol 10 (3), 2011

Review Article

Generalized information theory: a review and outlook.

Received: July 01, 2010;   Accepted: August 05, 2010;   Published: December 01, 2010

How to cite this article

Introduction.

CONCLUSIONS

Acknowledgment.

• Arimoto, S., 1971. Information-theoretic considerations on estimation problems. Inform. Control, 19: 181-194. CrossRef
• Belis, M. and S. Guiasu, 1968. Qualitative-quantitative measure of information in cybernetic system. IEEE Trans. Inform. Theory, 14: 593-594.
• Burbea, J. and C.R. Rao, 1982. Entropy differential metric, distance and divergence measures in probability spaces: A unified approach. J. Multi. Anal., 12: 575-596. Direct Link
• Burbea, J. and C.R. Rao, 1982. On the convexity of some divergence measures based on entropy functions. IEEE Trans. Inform. Theory, 28: 489-495. CrossRef Direct Link
• Cherry, C., 1957. On Human Communication. MIT Press, Cambridge, MA.
• Choquet, G., 1954. Theory of capacities. Ann. Ins. Fourier, 5: 131-295. Direct Link
• De Campos, L.M., J.F. Huete and S. Moral, 1994. Probability intervals: A tool for uncertain reasoning. Int. J. Uncertainty Fuzziness Knowl. Based Syst., 2: 167-196.
• De Luca, A. and S. Termini, 1972. A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory. Inform. Control, 20: 301-312. CrossRef
• Dretske, F.I., 1981. Knowledge and the Flow of Information. MIT Press, Cambridge, MA.
• Dretske, F.I., 1983. Precis of knowledge and the flow of information. Behav. Brain Sci., 6: 55-63. CrossRef Direct Link
• Jeffreys, H., 1946. An invariant form for the prior probability in estimation problems. Proc. R. Soc. Lond. Series A Mathe. Phys. Sci., 186: 453-461. CrossRef Direct Link
• Havrda, J. and F. Charvat, 1967. Quantification method of classification processes. Concept of structural α-entropy. Kybernetika, 3: 30-30.
• Hartley, R.V.L., 1928. Transmission of information. Bell Syst. Tech. J., 7: 535-563. Direct Link
• Higashi, M. and G.J. Klir, 1982. Measures of uncertainty and information based on possibility distributions. Int. J. Gen. Syst., 9: 43-58. CrossRef Direct Link
• Higashi, M. and G.J. Klir, 1983. On the notion of distance representing information closeness: Possibility and probability distributions. Int. J. Gen. Syst., 9: 103-115. CrossRef Direct Link
• Hohle, U., 1982. Entropy with respect to plausibility measures. Proceedings of the 12th IEEE International Symposium on Multiple-Valued Logic, (MVL`82), IEEE. International, Paris, pp: 167-169.
• Halmos, P.R., 1950. Measure Theory. D. Van Nostrand, Princeton, New Jersey.
• Jumarie, G., 1986. Subjectivity, Information Systems: Introduction to a Theory of Relativistic Cybernetics. Gordon and Breech, New York, ISBN: 2881240119, pp: 356.
• Jumarie, G., 1990. Relative Information: Theories and Applications. Springer-Verlag, New York, ISBN: 354051905X, pp: 258.
• Kerridge, D.F., 1961. Inaccuaracy and Inference. J. R. Statist. Soc. Ser. B, 23: 184-194.
• Klir, G.J., 1991. Generalized information theory. Fuzzy Sets Syst., 40: 127-142. CrossRef
• Klir, G.J., 2003. An update on generalized information theory. Proceedings of the 3rd International Symposium on Imprecise Probabilities and Their Applications, (ISIPTA`03), Carleton Scientific, Lugano, Switzerland, pp: 321-334.
• Klir, G.J., 2006. Uncertainty and Information: Foundations of Generalized Information Theory. John Wiley and Sons Inc., New Jersey.
• Klir,G.J. and M.J. Wierman, 1999. Uncertainty-Based Information: Elements of Generalized Information Theory. 2nd Edn., Physica-Verlag/Springer-Verlag, Heidelberg and New York.
• Klir, G.J. and B. Yuan, 1995. Fuzzy Sets and Fuzzy Logic: Theory and Applications. 1st Edn., Prentice Hall Inc., New Jersey, USA., ISBN-13: 9780131011717, Pages: 574. Direct Link
• Kolmogorov, A.N., 1950. Foundations of the Theory of Probability. Chelsea, New York.
• Kornwachs, K. and K. Jacoby, 1996. Information: New Questions to a Multidisciplinary Concept. Academie Verlag, Berlin.
• Kullback, S. and R.A. Leibler, 1951. On information and sufficiency. Ann. Math. Statist., 22: 1-164. Direct Link
• Lu, C.G., 1993. A Generalized Information Theory. China Science and Technology University Press, Hefei.
• Nyquist, H., 1928. Certain topics in telegraph transmission theory. AIEE Trans., 47: 617-644. CrossRef
• Picard, C.F., 1979. Weighted probabilistic information measures. J. Inform. Syst. Sci., 4: 343-356.
• Renyi, A., 1961. On Measures of entropy and information. Proceedings of the 4th Berkeley Symposia Mathematics Statistics and Probability Statistics and Probability, (BSMSPSP'61), University of California Press, pp: 547-561.
• Santanna, A.P. and I.J. Taneja, 1985. Trigonometric entropies, jensen difference divergence measures and error bounds. Inform. Sci., 35: 145-156. CrossRef
• Shafer, G., 1985. Belief Functions and Possibility Measures. In: Analysis of Fuzzy Information, Bezdek, J.C. (Ed.). CRC Press, Boca Raton, FL.
• Shannon, C.E., 1948. A mathematical theory of communication. Bell Syst. Tech. J., 27: 379-423. CrossRef Direct Link
• Shannon, C.E., 1956. The bandwagon. IEEE Trans. Inform. Theor., 2: 3-3. CrossRef
• Shannon, C.E. and W. Weaver, 1963. The Mathematical Theory of Communication. University of Illinois Press, Urbana, Pages: 117.
• Sharma, B.D. and D.P. Mittal, 1975. New nonadditive measures of inaccuracy. J. Math. Sci., 10: 122-133.
• Sharma, B.D. and I.J. Taneja, 1977. Three generalized additive measures of entropy. Elec. Inform. Kybern., 13: 419-433.
• Sibson, R., 1969. Information radius. Probability Theor. Related Fields, 14: 149-160. CrossRef
• Gupta, M.M., G.N. Saridis and B.R. Gaines, 1977. Fuzzy Measures and Fuzzy Integrals: A Survey. In: Fuzzy Automata and Decision Processes, Gupta, M.M. (Eds.). North-Holland, Amsterdam and New York, pp: 89-102.
• Tanaka, H., K. Sugihara and Y. Maeda, 2004. Non-additive measures by interval probability functions. Inform. Sci., 164: 209-227. CrossRef
• Taneja, I.J., 1989. On Generalized Information Measures and their Applications. In: Advances in Imaging and Electron Physics, Hawkes, P.W. (Ed.). Academic Press, New York, pp: 327-413.
• Taneja, I.J., 1995. New Developments in Generalized Information Measures. In: Advances in Imaging and Electron Physics, Hawkes, P.W. (Edn.). Vol. 91. Academic Press, New York, pp: 37-135. CrossRef
• Taneja, I.J., 2005. On Symmetric and Nonsymmetric Divergence Measures and Their Generalizations. In: Advances in Imaging and Electron Physics, Hawkes, P.W. (Ed.). Academic Press, New York, pp: 177-250.
• Tian-Wei, W., W. Huanchen and Z. Xu, 2005. A survey of information measurement methods. Syst. Eng. Theor. Methodol. Appl., 14: 481-486. Direct Link
• Wang, Y., 2008. Analysis and betterment of shannon`s information definition. J. Inform., 27: 57-60.
• Wang, Y., 2009. Analyses on limitations of information theory. Proceedings of the International Conference on Artificial Intelligence and Computational Intelligence, November 7-8, 2009, IEEE International, Shanghai, pp: 85-88. CrossRef
• Wang, Y. and H. Wang, 2009. A generalized information system model. Proceedings of the 3rd International Conference on Genetic and Evolutionary Computing, Oct. 14-17, IEEE Computer Society, Guilin, China, pp: 154-157. CrossRef
• Wang, Y., H. Wang and J. Huang, 2009. Information fusion algorithm enhancing information completeness. Proceedings of the 3rd International Conference on Genetic and Evolutionary Computing, Oct. 14-17, Computer Society, Guilin, China, pp: 407-409. CrossRef
• Wang, Y., H. Wang and X. Tang, 2009. On the reliability of information. Proceedings of the Chinese Control and Decision Conference, June 17-19, IEEE Press, pp: 871-874. CrossRef
• Wang, Z. and G.J. Klir, 1992. Fuzzy Measure Theory. Plenum Press, New York.
• Weichselberger, K., 2000. The theory of interval-probability as a unifying concept for uncertainty. Int. J. Approximate Reasoning, 24: 149-170. CrossRef
• Weichselberger, K. and S. Pohlmann, 1990. A Methodology for Uncertainty in Knowledge-Based Systems. Springer-Verlag, New York, pp: 132.
• Yager, R.R., 1983. Entropy and specificity in a mathematical theory of evidence. Int. J. Gen. Syst., 9: 249-260. CrossRef Direct Link
• Yixin, Z., 1988. Principles of Information Science. Fujian Press, China.
• Zhong, Y., 2002. Information Science Principle. 3rd Edn., Beijing University of Posts and Telecommunications Press, Beijing, China.

Related Articles

Leave a Comment

Your email address will not be published. Required fields are marked *

Information

• Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

• Active Journals
• Find a Journal
• Proceedings Series
• For Authors
• For Reviewers
• For Editors
• For Librarians
• For Publishers
• For Societies
• For Conference Organizers
• Open Access Policy
• Institutional Open Access Program
• Special Issues Guidelines
• Editorial Process
• Research and Publication Ethics
• Article Processing Charges
• Testimonials
• Preprints.org
• SciProfiles
• Encyclopedia

Article Menu

• Subscribe SciFeed
• Recommended Articles
• PubMed/Medline
• Google Scholar
• on Google Scholar
• Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

Information theory and cognition: a review.

1. Introduction

2. information theory—a very brief introduction, 3. information transfer over neurons, 3.1. the single neuron, 3.2. multiple neurons and population codes, 4. entropy and information in cognitive tasks, 4.1. hick–hyman law, 4.2. cognitive control, 5. model-based cognition, 5.1. perceptual information processing involves processing prediction errors, 5.2. cognitive load, 6. conclusions, acknowledgments, conflicts of interest.

• Shannon, C.E. The bandwagon. IRE Trans. Inf. Theory 1956 , 2 , 3. [ Google Scholar ] [ CrossRef ]
• Cronbach, L.J. On the non-rational application of information measures in psychology. In Information Theory in Psychology: Problems and Methods ; Quasterler, H., Ed.; Free Press: New York, NY, USA, 1955; pp. 14–30. [ Google Scholar ]
• Mante, V.; Sussillo, D.; Shenoy, K.V.; Newsome, W.T. Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 2013 , 503 , 78. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Larkum, M. A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex. Trends Neurosci. 2013 , 36 , 141–151. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Koch, C.; Segev, I. The role of single neurons in information processing. Nat. Neurosci. 2000 , 3 , 1171. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Tononi, G. Integrated information theory. Scholarpedia 2015 , 10 , 4164. [ Google Scholar ] [ CrossRef ]
• Koch, C. A theory of consciousness. Sci. Am. Mind 2009 , 20 , 16–19. [ Google Scholar ] [ CrossRef ]
• Searle, J.R. Can information theory explain consciousness. In New York Review of Books ; MIT Press: Cambridge, MA, USA, 2013. [ Google Scholar ]
• Garner, W.R. The Process of Information and Structure ; Lawrence Erbaum Associates: Mahwah, NJ, USA, 1974. [ Google Scholar ]
• Buffart, H.; Leeuwenberg, E. Structural information theory. In Advances in Psychology ; Elsevier: New York, NY, USA, 1983; Volume 11, pp. 48–72. [ Google Scholar ]
• Jaeger, T.F.; Snider, N. Implicit learning and syntactic persistence: Surprisal and cumulativity. In Proceedings of the Cognitive Science Society Conference, Washington, DC, USA, 23–26 July 2008; pp. 1061–1066. [ Google Scholar ]
• Levy, R. Integrating surprisal and uncertain-input models in online sentence comprehension: Formal techniques and empirical results. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies—Volume 1, Portland, OR, USA, 19–24 June 2011; pp. 1055–1065. [ Google Scholar ]
• Frank, S. Surprisal-based comparison between a symbolic and a connectionist model of sentence processing. In Proceedings of the Annual Meeting of the Cognitive Science Society ; Cognitive Science Society: Austin, TX, USA, 2009; Volume 31. [ Google Scholar ]
• Lowder, M.W.; Choi, W.; Ferreira, F.; Henderson, J.M. Lexical predictability during natural reading: Effects of surprisal and entropy reduction. Cogn. Sci. 2018 , 42 , 1166–1183. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Wibral, M.; Lizier, J.T.; Priesemann, V. Bits from brains for biologically inspired computing. Front. Robot. AI 2015 , 2 , 5. [ Google Scholar ] [ CrossRef ]
• Wibral, M.; Priesemann, V.; Kay, J.W.; Lizier, J.T.; Phillips, W.A. Partial information decomposition as a unified approach to the specification of neural goal functions. Brain Cogn. 2017 , 112 , 25–38. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Lizier, J.T.; Bertschinger, N.; Jost, J.; Wibral, M. Information Decomposition of Target Effects from Multi-Source Interactions: Perspectives on Previous, Current and Future Work. Entropy 2018 , 20 , 307. [ Google Scholar ] [ CrossRef ]
• Dimitrov, A.G.; Lazar, A.A.; Victor, J.D. (Eds.) Special Issue on Methods of Information Theory ; Springer: Berlin, Germany, 2011; Volume 30. [ Google Scholar ]
• MacKay, D.J.; Mac Kay, D.J. Information Theory, Inference and Learning Algorithms ; Cambridge University Press: Cambridge, UK, 2003. [ Google Scholar ]
• Tribus, M. Information theory as the basis for thermostatics and thermodynamics. J. Appl. Mech. 1961 , 28 , 1–8. [ Google Scholar ] [ CrossRef ]
• Shannon, C. A mathematical theory of communication. Bell Syst. Tech. J. 1948 , 27 , 379–423. [ Google Scholar ] [ CrossRef ]
• Clark, L.; Kiang, N.S.; Thomas, E. Discharge Patterns of Single Fibers in the Cat’s Auditory Nerve ; MIT Press: Cambridge, MA, USA, 1965. [ Google Scholar ]
• Britten, K.H.; Shadlen, M.N.; Newsome, W.T.; Movshon, J.A. The analysis of visual motion: A comparison of neuronal and psychophysical performance. J. Neurosci. 1992 , 12 , 4745–4765. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Butts, D.A.; Goldman, M.S. Tuning curves, neuronal variability, and sensory coding. PLoS Biol. 2006 , 4 , e92. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Parker, A.J.; Newsome, W.T. Sense and the single neuron: Probing the physiology of perception. Annu. Rev. Neurosci. 1998 , 21 , 227–277. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Mainen, Z.F.; Sejnowski, T.J. Reliability of spike timing in neocortical neurons. Science 1995 , 268 , 1503–1506. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Ikeda, S.; Manton, J.H. Capacity of a single spiking neuron channel. Neural Comput. 2009 , 21 , 1714–1748. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Walløe, L. On the transmission of information through sensory neurons. Biophys. J. 1970 , 10 , 745–763. [ Google Scholar ] [ CrossRef ]
• Werner, G.; Mountcastle, V.B. Neural activity in mechanoreceptive cutaneous afferents: Stimulus-response relations, Weber functions, and information transmission. J. Neurophys. 1965 , 28 , 359–397. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• MacKay, D.M.; McCulloch, W.S. The limiting information capacity of a neuronal link. Bull. Math. Biophys. 1952 , 14 , 127–135. [ Google Scholar ] [ CrossRef ]
• Rapoport, A.; Horvath, W.J. The theoretical channel capacity of a single neuron as determined by various coding systems. Inf. Control 1960 , 3 , 335–350. [ Google Scholar ] [ CrossRef ]
• Stein, R.B. The information capacity of nerve cells using a frequency code. Biophys. J. 1967 , 7 , 797–826. [ Google Scholar ] [ CrossRef ]
• Borst, A.; Theunissen, F.E. Information theory and neural coding. Nat. Neurosci. 1999 , 2 , 947. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Berger, T.; Levy, W.B. A mathematical theory of energy efficient neural computation and communication. IEEE Trans. Inf. Theory 2010 , 56 , 852–874. [ Google Scholar ] [ CrossRef ]
• Berger, T.; Xing, J.; Levy, W.B. Generalized inverse Gaussian (GIG) models for energy-efficient neurons. In Proceedings of the 2013 Information Theory and Applications Workshop (ITA), San Diego, CA, USA, 10–15 February 2013. [ Google Scholar ]
• Sungkar, M.; Berger, T.; Levy, W.B. The Karush-Kuhn-Tucker conditions for a generalized inverse Gaussian neural model. Neuroscience 2017 , 2 , 6. [ Google Scholar ]
• Sungkar, M.; Berger, T.; Levy, W.B. Capacity achieving input distribution to the generalized inverse Gaussian neuron model. In Proceedings of the 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton), Monticello, IL, USA, 3–6 October 2017; pp. 860–869. [ Google Scholar ]
• Ghavami, S.; Lahouti, F.; Schwabe, L. Predictions of energy efficient Berger-Levy model neurons with constraints. BMC Neurosci. 2013 , 14 , P349. [ Google Scholar ]
• Ghavami, S.; Lahouti, F.; Schwabe, L. Information theoretic analysis of energy efficient neurons with biologically plausible constraints. In Proceedings of the 2013 International Joint Conference on Neural Networks (IJCNN), Dallas, TX, USA, 4–9 August 2013; pp. 1–8. [ Google Scholar ]
• Schulz, S.R.; Ince, R.A.; Panzeri, S. Applications of Information Theory to Analysis of Neural Data. In Encyclopedia of Computational Neuroscience ; Springer: New York, NY, USA, 2015; pp. 199–203. [ Google Scholar ] [ Green Version ]
• Rob R de Ruyter, V.S.; Lewen, G.D.; Strong, S.P.; Koberle, R.; Bialek, W. Reproducibility and variability in neural spike trains. Science 1997 , 275 , 1805–1888. [ Google Scholar ] [ CrossRef ]
• Gallistel, C. The coding question. Trends Cogn. Sci. 2017 , 21 , 498–508. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Ralston, B.N.; Flagg, L.Q.; Faggin, E.; Birmingham, J.T. Incorporating spike-rate adaptation into a rate code in mathematical and biological neurons. J. Neurophysiol. 2016 , 115 , 2501–2518. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
• Reich, D.S.; Mechler, F.; Victor, J.D. Independent and redundant information in nearby cortical neurons. Science 2001 , 294 , 2566–2568. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Abbott, L.F.; Dayan, P. The effect of correlated variability on the accuracy of a population code. Neural Comput. 1999 , 11 , 91–101. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Georgopoulos, A.P.; Kalaska, J.F.; Caminiti, R.; Massey, J.T. On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J. Neurosci. 1982 , 2 , 1527–1537. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
• Georgopoulos, A.P.; Schwartz, A.B.; Kettner, R.E. Neuronal population coding of movement direction. Science 1986 , 233 , 1416–1419. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Wessberg, J.; Stambaugh, C.R.; Kralik, J.D.; Beck, P.D.; Laubach, M.; Chapin, J.K.; Kim, J.; Biggs, S.J.; Srinivasan, M.A.; Nicolelis, M.A. Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 2000 , 408 , 361. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Lee, C.; Rohrer, W.H.; Sparks, D.L. Population coding of saccadic eye movements by neurons in the superior colliculus. Nature 1988 , 332 , 357. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Ince, R.A.; Senatore, R.; Arabzadeh, E.; Montani, F.; Diamond, M.E.; Panzeri, S. Information-theoretic methods for studying population codes. Neural Netw. 2010 , 23 , 713–727. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
• Fairhall, A.; Shea-Brown, E.; Barreiro, A. Information theoretic approaches to understanding circuit function. Curr. Opin. Neurobiol. 2012 , 22 , 653–659. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
• Ohiorhenuan, I.E.; Mechler, F.; Purpura, K.P.; Schmid, A.M.; Hu, Q.; Victor, J.D. Sparse coding and high-order correlations in fine-scale cortical networks. Nature 2010 , 466 , 617. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Hick, W.E. On the rate of gain of information. Q. J. Exp. Psychol. 1952 , 4 , 11–26. [ Google Scholar ] [ CrossRef ]
• Hyman, R. Stimulus information as a determinant of reaction time. J. Exp. Psychol. 1953 , 45 , 188. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Gallagher, R. Information Theory and Reliable Communication ; Wiley: Hoboken, NJ, USA, 1968. [ Google Scholar ]
• Simpson, J.; Huron, D. Absolute pitch as a learned phenomenon: Evidence consistent with the Hick–Hyman Law. Music Percept. Interdiscip. J. 1994 , 12 , 267–270. [ Google Scholar ] [ CrossRef ]
• Miyazaki, K. Absolute pitch identification: Effects of timbre and pitch region. Music Percept. Interdiscip. J. 1989 , 7 , 1–14. [ Google Scholar ] [ CrossRef ]
• Wu, T.; Dufford, A.J.; Egan, L.J.; Mackie, M.A.; Chen, C.; Yuan, C.; Chen, C.; Li, X.; Liu, X.; Hof, P.R.; et al. Hick–Hyman Law is Mediated by the Cognitive Control Network in the Brain. Cereb. Cortex 2018 , 28 , 2267–2282. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Cole, M.W.; Schneider, W. The cognitive control network: integrated cortical regions with dissociable functions. Neuroimage 2007 , 37 , 343–360. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Stroop, J.R. Studies of interference in serial verbal reactions. J. Exp. Psychol. 1935 , 18 , 643. [ Google Scholar ] [ CrossRef ]
• Morgan, A.L.; Brandt, J.F. An auditory Stroop effect for pitch, loudness, and time. Brain Lang. 1989 , 36 , 592–603. [ Google Scholar ] [ CrossRef ]
• Berlyne, D.E. Uncertainty and conflict: A point of contact between information-theory and behavior-theory concepts. Psychol. Rev. 1957 , 64 , 329. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Koechlin, E.; Summerfield, C. An information theoretical approach to prefrontal executive function. Trends Cogn. Sci. 2007 , 11 , 229–235. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Koechlin, E.; Ody, C.; Kouneiher, F. The architecture of cognitive control in the human prefrontal cortex. Science 2003 , 302 , 1181–1185. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Badre, D.; D’Esposito, M. Functional magnetic resonance imaging evidence for a hierarchical organization of the prefrontal cortex. J. Cogn. Neurosci. 2007 , 19 , 2082–2099. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Badre, D. Cognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes. Trends Cogn. Sci. 2008 , 12 , 193–200. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Choi, E.Y.; Drayna, G.K.; Badre, D. Evidence for a Functional Hierarchy of Association Networks. J. Cogn. Neurosci. 2018 , 20 , 722–736. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Wilson, C.R.; Gaffan, D.; Browning, P.G.; Baxter, M.G. Functional localization within the prefrontal cortex: Missing the forest for the trees? Trends Neurosci. 2010 , 33 , 533–540. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Domenech, P.; Koechlin, E. Executive control and decision-making in the prefrontal cortex. Curr. Opin. Behav. Sci. 2015 , 1 , 101–106. [ Google Scholar ] [ CrossRef ]
• Dosenbach, N.U.; Fair, D.A.; Miezin, F.M.; Cohen, A.L.; Wenger, K.K.; Dosenbach, R.A.; Fox, M.D.; Snyder, A.Z.; Vincent, J.L.; Raichle, M.E.; et al. Distinct brain networks for adaptive and stable task control in humans. Proc. Natl. Acad. Sci. USA 2007 , 104 , 11073–11078. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
• Vincent, J.L.; Kahn, I.; Snyder, A.Z.; Raichle, M.E.; Buckner, R.L. Evidence for a frontoparietal control system revealed by intrinsic functional connectivity. J. Neurophys. 2008 , 100 , 3328–3342. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Fuster, J.M. The prefrontal cortex–an update: time is of the essence. Neuron 2001 , 30 , 319–333. [ Google Scholar ] [ CrossRef ]
• Daw, N.D.; O’doherty, J.P.; Dayan, P.; Seymour, B.; Dolan, R.J. Cortical substrates for exploratory decisions in humans. Nature 2006 , 441 , 876. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Dehaene, S.; Posner, M.I.; Tucker, D.M. Localization of a neural system for error detection and compensation. Psychol. Sci. 1994 , 5 , 303–305. [ Google Scholar ] [ CrossRef ]
• Fan, J. An information theory account of cognitive control. Front. Hum. Neurosci. 2014 , 8 , 680. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Paus, T. Primate anterior cingulate cortex: where motor control, drive and cognition interface. Nat. Rev. Neurosci. 2001 , 2 , 417. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Kolling, N.; Behrens, T.; Wittmann, M.; Rushworth, M. Multiple signals in anterior cingulate cortex. Curr. Opin. Neurobiol. 2016 , 37 , 36–43. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Clark, A. Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 2013 , 36 , 181–204. [ Google Scholar ] [ PubMed ] [ Green Version ]
• Kull, K. On semiosis, Umwelt, and semiosphere. Semiotica 1998 , 120 , 299–310. [ Google Scholar ]
• Elias, P. Predictive coding—I. IRE Trans. Inf. Theory 1955 , 1 , 16–24. [ Google Scholar ] [ CrossRef ]
• Berger, T. Rate Distortion Theory: A Mathematical Basis for Data Compression ; Prentice-Hall: Englewood Cilffs, NJ, USA, 1971. [ Google Scholar ]
• Friston, K. Hierarchical models in the brain. PLoS Comput. Biol. 2008 , 4 , e1000211. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Cleeremans, A. The radical plasticity thesis: How the brain learns to be conscious. Front. Psychol. 2011 , 2 , 86. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Gregory, R.L. Perceptions as hypotheses. Philos. Trans. R. Soc. Lond. B 1980 , 290 , 181–197. [ Google Scholar ] [ CrossRef ]
• Scott, N.M.; Sera, M.D.; Georgopoulos, A.P. An information theory analysis of spatial decisions in cognitive development. Front. Neurosci. 2015 , 9 , 14. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Rao, R.P.; Ballard, D.H. Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 1999 , 2 , 79. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Heilbron, M.; Chait, M. Great expectations: Is there evidence for predictive coding in auditory cortex? Neuroscience 2017 . [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Simon, D.A.; Daw, N.D. Neural correlates of forward planning in a spatial decision task in humans. J. Neurosci. 2011 , 31 , 5526–5539. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Pickering, M.J.; Gambi, C. Predicting while comprehending language: A theory and review. Psychol. Bull. 2018 . [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Hubel, D.H.; Wiesel, T.N. Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J. Physiol. 1962 , 160 , 106–154. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Hubel, D.H.; Wiesel, T.N. Receptive field and functional architecture in two non-striate visual areas (18 and 19) of the cat. J. Neurophysiol. 1965 , 28 , 229. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Mechelli, A.; Price, C.J.; Friston, K.J.; Ishai, A. Where bottom-up meets top-down: Neuronal interactions during perception and imagery. Cereb. Cortex 2004 , 14 , 1256–1265. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Kamitani, Y.; Tong, F. Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 2005 , 8 , 679. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Berry, J.W. Ecology, perceptual development and the müller-lyer illusion. Br. J. Psychol. 1968 , 59 , 205–210. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Lee, S.H.; Blake, R.; Heeger, D.J. Traveling waves of activity in primary visual cortex during binocular rivalry. Nat. Neurosci. 2005 , 8 , 22. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Tong, F.; Meng, M.; Blake, R. Neural bases of binocular rivalry. Trends Cogn. Sci. 2006 , 10 , 502–511. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Sterzer, P.; Kleinschmidt, A.; Rees, G. The neural bases of multistable perception. Trends Cogn. Sci. 2009 , 13 , 310–318. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Hohwy, J.; Roepstorff, A.; Friston, K. Predictive coding explains binocular rivalry: An epistemological review. Cognition 2008 , 108 , 687–701. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
• Lennie, P. The cost of cortical computation. Curr. Biol. 2003 , 13 , 493–497. [ Google Scholar ] [ CrossRef ]
• Laughlin, S.B.; van Steveninck, R.R.D.R.; Anderson, J.C. The metabolic cost of neural information. Nat. Neurosci. 1998 , 1 , 36. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Zenon, A.; Solopchuk, O.; Pezzulo, G. An information-theoretic perspective on the costs of cognition. bioRxiv 2018 , 208–280. [ Google Scholar ] [ CrossRef ]
• Itti, L.; Baldi, P. Bayesian surprise attracts human attention. Vis. Res. 2009 , 49 , 1295–1306. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
• Baldi, P.; Itti, L. Of bits and wows: A Bayesian theory of surprise with applications to attention. Neural Netw. 2010 , 23 , 649–666. [ Google Scholar ] [ CrossRef ] [ PubMed ] [ Green Version ]
• Chen, L.L.; Wise, S.P. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurophys. 1995 , 73 , 1101–1121. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Monsell, S. Task switching. Trends Cogn. Sci. 2003 , 7 , 134–140. [ Google Scholar ] [ CrossRef ]
• Wylie, G.; Allport, A. Task switching and the measurement of “switch costs”. Psychol. Res. 2000 , 63 , 212–233. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Apps, M.A.; Grima, L.L.; Manohar, S.; Husain, M. The role of cognitive effort in subjective reward devaluation and risky decision-making. Sci. Rep. 2015 , 5 , 168–180. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Foley, N.C.; Kelly, S.P.; Mhatre, H.; Lopes, M.; Gottlieb, J. Parietal neurons encode expected gains in instrumental information. Proc. Natl. Acad. Sci. USA 2017 , 114 , E3315–E3323. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Ramscar, M.; Hendrix, P.; Shaoul, C.; Milin, P.; Baayen, H. The myth of cognitive decline: Non-linear dynamics of lifelong learning. Top. Cogn. Sci. 2014 , 6 , 5–42. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Borges, J.L.; Adolfo, B.C. On Exactitude in Science. 1946. In Collected Fictions ; Penguin Books: London, UK, 1998; pp. 325–326. [ Google Scholar ]
• Rissanen, J. Minimum description length principle. In Wiley StatsRef: Statistics Reference Online ; Wiley Online Library: Hoboken, NJ, USA, 2014. [ Google Scholar ]
• Lachman, R.; Lachman, J.L.; Butterfield, E.C. Cognitive Psychology and Information Processing: An Introduction ; Lawrence Erbaum Associates: Mahwah, NJ, USA, 1979. [ Google Scholar ]
• Silverstein, S.M.; Wibral, M.; Phillips, W.A. Implications of information theory for computational modeling of schizophrenia. Computat. Psychiatry 2017 , 1 , 82–101. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Elvevåg, B.; Foltz, P.W.; Rosenstein, M.; Ferrer-i Cancho, R.; De Deyne, S.; Mizraji, E.; Cohen, A. Thoughts about disordered thinking: measuring and quantifying the laws of order and disorder. Schizophr. Bull. 2017 , 43 , 509–513. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Lyall, A.E.; Savadjiev, P.; del Re, E.C.; Seitz, J.; O’Donnell, L.J.; Westin, C.F.; Mesholam-Gately, R.I.; Petryshen, T.; Wojcik, J.D.; Nestor, P.; et al. Utilizing Mutual Information Analysis to Explore the Relationship Between Gray and White Matter Structural Pathologies in Schizophrenia. Schizophr. Bull. 2018 . [ Google Scholar ] [ CrossRef ] [ PubMed ]

Click here to enlarge figure

Share and Cite

Sayood, K. Information Theory and Cognition: A Review. Entropy 2018 , 20 , 706. https://doi.org/10.3390/e20090706

Sayood K. Information Theory and Cognition: A Review. Entropy . 2018; 20(9):706. https://doi.org/10.3390/e20090706

Sayood, Khalid. 2018. "Information Theory and Cognition: A Review" Entropy 20, no. 9: 706. https://doi.org/10.3390/e20090706

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

Subscribe to receive issue release notifications and newsletters from MDPI journals

A systematic review of integrated information theory: a perspective from artificial intelligence and the cognitive sciences

• S.I.: Knowledge services: challenges and future prospects
• Published: 07 February 2023

Cite this article

• Luz Enith Guerrero 1 ,
• Luis Fernando Castillo   ORCID: orcid.org/0000-0002-2878-8229 1 ,
• Jeferson Arango-López   ORCID: orcid.org/0000-0001-8072-9130 1 &
• Fernando Moreira   ORCID: orcid.org/0000-0002-0816-1445 2  

940 Accesses

2 Citations

1 Altmetric

Explore all metrics

The study of consciousness has gained momentum in recent years by the scientific community. In this same sense, the relationship between cognitive sciences and artificial intelligence presents a fundamental theoretical framework in the study of integrated information theory (IIT) as a theory that makes its way into the knowledge of consciousness. However, there are few studies that integrate these topics and a systematic review of the literature is highly pertinent. This paper seeks to identify methods, methodologies or computational solutions using artificial intelligence and cognitive science fundamentals that can provide some kind of solution to the challenges posed by IIT.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save.

• Get 10 units per month
• Download Article/Chapter or eBook
• 1 Unit = 1 Article or 1 Chapter
• Cancel anytime

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

Is It Possible to Recognize a Philosophical Zombie and How to Do It

Emergentist Integrated Information Theory

Contextuality in the Integrated Information Theory

Explore related subjects.

• Artificial Intelligence

Data availability statement

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

These frameworks or cognitive architectures refer to the theory of mind structure, taking human consciousness, with the aim of bringing cognitive knowledge into computational models [ 1 ].

Reference [ 28 ] believe that part of the difficulty in dealing with the difficult problem of consciousness has been the way science has approached it, so the theory aims to start from the simple or primary consciousness and asks what kind of physical mechanisms could give rise to it.

Total refers to whether the IIT is used. Partial refers to whether it only uses some features or components of ITI. None refers to not using any of the theory.

Internet of Things.

Another measure of network interactions as defined by [ 93 ].

reading short documents and guiding the humanoid robot Sofia in performing a dialogue-based interaction.

Exhibiting some relationship to the global workspace awareness theory (GWT).

Patnaik LM, Kallimani JS (2017) Promises and limitations of conscious machines. In: Menon S, Nagaraj N, Binoy VV (eds) Self, culture and consciousness: interdisciplinary convergences on knowing and being. Springer Singapore, Singapore

Google Scholar  

Crick F (1995) Astonishing hypothesis: the scientific search for the soul, new york, scribner reprint edition

Penrose R (1996) Shadows of the mind: a search for the missing science of consciousness United States of America. Oxford University Press, Oxford

Chalmers DJ (1995) Facing up to the problem of consciousness. J Conscious Stud 2:19

Tononi G (2004) An information integration theory of consciousness. BMC Neurosci 5:42

Article   Google Scholar  

Oizumi M, Albantakis L, Tononi G (2014) From the phenomenology to the mechanisms of consciousness: integrated information theory 3.0. Plos Comput Biol 10(5):e1003588

Nilsson NJ (2009) The quest for artificial intelligence. Cambridge University Press

Book   Google Scholar  

Holland O, Gamez D (2009) Artificial intelligence and consciousness. In: Banks WP (ed) Encyclopedia of consciousness. Academic Press

Stephan KD, Klima G (2021) Artificial intelligence and its natural limits. AI Soc 36:9–18

Nazri A, Ghani AAA, Hafez I, Ng KY (2018) A new theoretical framework for testing consciousness in a machine. In: International conference on soft computing and data mining. Springer, pp 330–339

Kriegeskorte N, Douglas PK (2018) Cognitive computational neuroscience. Nat Neurosci 21:1148–1160

Schwartz EL (1990) Computational neuroscience. MIT press

Marte H (2020) Neurociencia computacional: el futuro de la investigación [online]. Available: https://neuro-class.com/neurociencia-computacional-el-futuro-de-la-investigacion/ Accessed 2020

Makin JG, Moses DA, Chang EF (2020) Machine translation of cortical activity to text with an encoder–decoder framework. Nat Neurosci 23(4): 575–582

Wendin G (2019) Can biological quantum networks solve np-hard problems? Adv Quantum Technol 2(7–8):1800081

Russell S, Norvig P (2020) Artificial intelligence: a modern approach, Hoboken

Liao Y, Yan M, Tang S (2021, March). The robot consciousness based on empirical knowledge. In Journal of Physics: Conference Series (Vol. 1861, No. 1, p. 012103). IOP Publishing

Buczak AL, Guven E (2015) A survey of data mining and machine learning methods for cyber security intrusion detection. IEEE Commun Surv Tutor 18(2):1153–1176

Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444

Tozzi A (2019) The multidimensional brain. Phys Life Rev 31:86–103

Gauvrit N, Zenil H, Tegnér J (2017) The information-theoretic and algorithmic approach to human, animal, and artificial cognition. Representation and reality in humans, other living organisms and intelligent machines 117–139

Kralik J, Lee JH, Rosenbloom PS, Jackson PC, Epstein SL, Romero OJ, Sanz R, Larue O, Schmidtke HR, Lee SW, Mcgreggor K (2018) Metacognition for a common model of cognition. Proc Comput Sci 145:730–739

Chandra R (2017) Towards an affective computational model for machine consciousness. In: Neural Information Processing: 24th International Conference, ICONIP 2017, Guangzhou, China, November 14–18, 2017, Proceedings, Part V 24 (pp. 897–907). Springer International Publishing

Block N (2009) Comparing the major theories of consciousness. In: The cognitive neurosciences, 4th edn. Massachusetts Institute of Technology, Cambridge.

Manzotti R (2019) A physicalist causally oriented foundation for a conscious machine based on the spread mind. In: AAAI spring symposium: towards conscious AI systems

Koch C, Tononi G (2008) Can machines be conscious? IEEE Spectr 45:55–59

Balduzzi D, Tononi G (2008) Integrated information in discrete dynamical systems: motivation and theoretical framework. Plos Comput Biol 4:e1000091

Tononi G, Koch C (2015) Consciousness: here, there and everywhere? Philos Trans R Soc Lond Ser B Biol Sci 370(1668):20140167

Tononi G, Boly M, Massimini M, Koch C (2016) Integrated information theory: from consciousness to its physical substrate. Nat Rev Neurosci 17:450–461

Paz F, Pow S (2016) A systematic mapping review of usability evaluation methods for software development process. Int J Softw Eng I Appl 10(1):165–178

Petersen K, Feldt R, Mujtaba S, Mattsson M (2008) Systematic mapping studies in software engineering. In: Proceedings of the 12th international conference on evaluation and assessment in software engineering, vol 17

Petersen K, Vakkalanka S, Kuzniarz L (2015) Guidelines for conducting systematic mapping studies in software engineering: an update. Inform Softw Technol 64:18

Kitchenham B, Brereton P (2013) A systematic review of systematic review process research in software engineering. Inf Softw Technol 55(12): 2049–2075

Franco-bedoya O, Ameller D, Costal D, Franch X (2017) Open source software ecosystems: a systematic mapping. Inform Softw Technol 91:160–185

Manikas, k. (2016) Revisiting software ecosystems research: a longitudinal literature study. J Syst Softw 117:84–103

Kitchenham B, Pearl Brereton O, Budgen D, Turner M, Bailey J, Linkman S (2009) Systematic literature reviews in software engineering – a systematic literature review. Inform Softw Technol 51:7–15

Miles MB, Huberman AM, Saldana J (2019) Qualitative data analysis: a methods sourcebook. Sage Publications

Kitchenham B, Brereton P (2013) A systematic review of systematic review process research in software engineering. Inf Softw Technol 55:2049–2075

McGreggor K (2020). An experience is a knowledge representation. Common Model of Cognition Bulletin 1(2): 420–424

Antonopoulos C, Fokas A, Bountis T (2015) Dynamical complexity in the c.elegans neural network. Eur Phys J Spec Top 225:1255–1269

Moreno RA., de Miguel AS, Espino AL (2011). Evaluation and development of consciousness in artificial cognitive systems. Ph. D. dissertation

Montes GA (2017) Non-ordinary consciousness for artificial intelligence. Springer International Publishing, pp 348–362

Friedman DA., Søvik E (2021) The ant colony as a test for scientific theories of consciousness. Synthese 198(2), 1457–1480

Reggia J, Monner D, Sylvester J (2014) The computational explanatory gap. J Conscious Stud 21(9–10):153–178

Banerjee R, Pal SK (2015) Z*-numbers: augmented z-numbers for machine-subjectivity representation. Inf Sci 323:143–217

Article   MathSciNet   Google Scholar  

Niizato T, Sakamoto K, Mototake YI, Murakami H, Tomaru T, Hoshika T, Fukushima T (2020) Finding continuity and discontinuity in fish schools via integrated information theory. PLoS ONE 15(2):e0229573

Marcolli M (2021) Topological model of neural information networks. Springer International Publishing, 623–633

Javarone MA, Gosseries O, Marinazzo D, Noirhomme Q, Bonhomme V, Laureys S, Chennu S (2020) A mean field approach to model levels of consciousness from eeg recordings. J Stat Mech Theory Exp 2020(8):083405

Article   MathSciNet   MATH   Google Scholar  

Reggia J (2013) The rise of machine consciousness: studying consciousness with computational models. Neural Netw Off J Int Neural Netw Soc 44:112–131

Iklé M, Goertzel B, Bayetta M, Sellman G, Cover C, Allgeier J, Smith R, Sowards M, Schuldberg D, Leung M, Belayneh A, Smith G, Hanson D (2019) Using tononi phi to measure consciousness of a cognitive system while reading and conversing [online]. https://ceur-ws.org/Vol-2287/paper20.pdf Accessed 2020

Popiel NJM, Khajehabdollahi S, Abeyasinghe PM, Riganello F, Nichols ES, Owen AM, Soddu A (2020) The emergence of integrated information, complexity, and ‘consciousness’ at criticality. Entropy 22:339

Farnsworth KD (2018) How oganisms gained causal independence and how it might be quantified. Biology 7:38

Kalita P, Langa JA, Soler-Toscano F (2019) Informational structures and informational fields as a prototype for the description of postulates of the integrated information theory. Entropy 21:493

Dodig-Crnkovic G, Von Haugwitz R (2017) Reality construction in cognitive agents through processes of info-computation. In: Dodig-Crnkovic G, Giovagnoli R (eds) Representation and reality in humans, other living organisms and intelligent machines. Springer International Publishing, Cham

Chapter   Google Scholar  

Reggia JA, Katz G, Huang DW (2016) What are the computational correlates of consciousness? Biol Inspir Cognit Arch 17:101–113

Arrabales R, Ledezma A, Sanchis A (2009) Strategies for measuring machine consciousness. Int J Mach Conscious 01:193–201

Aguilera M, Di Paolo EA (2021) Critical integration in neural and cognitive systems: beyond power-law scaling as the hallmark of soft assembly. Neurosci Biobehav Rev 123:230–237

Hunt T (2020) Calculating the boundaries of consciousness in general resonance theory. J Conscious Stud 27:55–80

Langer C, Ay N (2021) How morphological computation shapes integrated information in embodied agents. Frontiers in Psychol. 5385

Schneider S (2020) How to catch an ai zombie: testing for consciousness in machines. Ethics of artificial intelligence

Koch C, Tononi G (2011) A test for consciousness. Sci Am 304:44–47

Arrabales R, Ledezma A, Sanchis A (2010) ConsScale: A pragmatic scale for measuring the level of consciousness in artificial agents. J Consciousness Stud 17(3-4), 131–164

Pizzi R, Musumeci M (2017) Coding Mental States from EEG Signals and evaluating their Integreted Information Content: a Computational Intelligence Approach. Int J Circ Syst Signals Process 11(4464):464–470

Nilsen AS, Juel B, Marshall W (2019) Evaluating approximations and heuristic measures of integrated information. Entropy 21:525

Elamrani A, Yampolskiy RV (2019) Reviewing tests for machine consciousness. J Conscious Stud 26:35–64

Kanade VA (2020) A hybrid evolutionary algorithm for evolving a conscious machine. In Intelligent Systems Design and Applications: 18th International Conference on Intelligent Systems Design and Applications (ISDA 2018) held in Vellore, India, December 6-8, 2018, Volume 2 (pp. 1045–1054). Springer International Publishing

Kitazono J, Kanai R, Oizumi M (2020) Efficient search for informational cores in complex systems: application to brain networks. Neural Netw 132:232–244

Article   MATH   Google Scholar  

Virmani M, Nagaraj N (2019) A novel perturbation based compression complexity measure for networks. Heliyon 5:e01181

Barghout L (2018) Hypernym and spatial-taxon hierarchy. A cognitive informatics and fuzzy logic approach to combining linguistic and image taxonomies. In: 2018 IEEE 17th international conference on cognitive informatics and cognitive computing (ICCI* CC), pp 575–582. IEEE

Van Hateren JH (2019) A theory of consciousness: computation, algorithm, and neurobiological realization. Biol Cybern 113:357–372

Shanahan M (2015) Ascribing consciousness to artificial intelligence. arXiv preprint arXiv:1504.05696

Findlay G, Marshall W, Albantakis L, Mayner W, Koch C, Tononi G (2019). Dissociating intelligence from consciousness in artificial systems–Implications of Integrated Information Theory. In Proceedings of the 2019 Towards Conscious AI Systems Symposium, AAAI SSS19

Bedia M, Castillo L (2016) Hacia una teoría de la mente corporizada: la influencia de los mecanismos sensomotores en el desarrollo de la cognición. Ánfora 17:101–124

Montemayor C, de Barros JA, de Assis lPG, (2019) Implementation, formalization, and representation: challenges for integrated information theory. J Conscious Stud 26:107–132

Bach J (2019) The cortical conductor theory: Towards addressing consciousness in ai models. In Biologically Inspired Cognitive Architectures 2018: Proceedings of the Ninth Annual Meeting of the BICA Society (pp. 16–26). Springer International Publishing

Kelley D (2018) The independent core observer model computational theory of consciousness and the mathematical model for subjective experience. In: 2018 4th annual international conference on network and information systems for computers (ICNISC), 19–21 April 2018, pp 396–400

List C (2018) What is it like to be a group agent? Noûs 52:295–319

Schneider S, Velmans M (2017) The Blackwell Companion to Consciousness. Blackwell Publishing, 175–179

Thagard P, Stewart TC (2014) Two theories of consciousness: semantic pointer competition versus Information integration. Conscious Cognit 30:73–90

Calvo P, Baluška F, Trewavas A (2021) Integrated information as a possible basis for plant consciousness. Biochem Biophys Res Commun 564:158–165

Kleiner J (2020) Brain states matter: a reply to the unfolding argument. Conscious Cognit 85:102981

Baudot P (2019) Elements of qualitative cognition: an information topology perspective. Phys Life Rev 31:263–275

Safron A (2020) An integrated world modeling theory (iwmt) of consciousness: combining integrated information and global neuronal workspace theories with the free energy principle and active inference framework; toward solving the hard problem and characterizing agentic causation. Front Artif Intell 3:30

Mallatt J (2021) A traditional scientific perspective on the integrated information theory of consciousness. Entropy 23(6):650

Barthelmeß U, Furbach U, Schon C (2020) Consciousness and Automated Reasoning. arXiv preprint https://doi.org/10.48550/arXiv.2001.09442

Moruzzi C (2019) Ai-generated music: creativity and autonomy. pp 25–32

Barrett A, Seth AK (2011) Practical measures of integrated information for time-series data. Plos Comput Biol 7:e1001052

Hoel EP, Albantakis L, Marshall W, Tononi G (2016) Can the macro beat the micro? Integrated information across spatiotemporal scales. Neurosci of Conscious 2016(1):1–13

Marshall W, Albantakis L, Tononi G (2018) Black-boxing and cause-effect power. PLoS Comput Biol 14:e1006114

Albantakis L, Massari F, Beheler-Amass M, Tononi G (2021) A macro agent and its actions. In Top-Down Causation and Emergence (pp. 135–155). Cham: Springer International Publishing

Gamez D (2010) Information integration based predictions about the conscious states of a spiking neural network. Conscious Cogn 19:294–310

Sylvester JC, Reggia JA, Weems SA, Bunting MF (2013) Controlling working memory with learned instructions. Neural Netw 41:23–38

Aleksander I, Gamez D (2009) Iconic training and effective information: evaluating meaning in discrete neural networks. AAAI fall symposium - technical report

Karl, F. (2012). A free energy principle for biological systems. Entropy 14(11): 2100–2121

Mayner WGP, Marshall W, Albantakis L, Findlay G, Marchman R, Tononi G (2018) Pyphi: a toolbox for integrated information theory. Plos Comput Biol 14:e1006343

Tegmark, m. (2016) Improved measures of integrated information. PLoS Comput Biol 12:e1005123

Marshall W, Gomez-ramirez J, Tononi G (2016) Integrated information and state differentiation. Front Psychol 7:926

Schartner M, Seth A, Noirhomme Q, Boly M, Bruno M-A, Laureys S, Barrett A (2015) Complexity of multi-dimensional spontaneous EEG decreases during propofol induced general anaesthesia. PLoS ONE 10:e0133532

Oizumi M, Amari S, Yanagawa T, Fujii N, Tsuchiya N (2016) Measuring integrated information from the decoding perspective. PLoS Comput Biol 12:e1004654–e1004654

Oizumi, m., tsuchiya, n. & amari, s. I. (2016) Unified framework for information integration based on information geometry. Proc Natl Acad Sci 113:14817–14822

Kitazono J, Oizumi M (2018) Practical phi toolbox

Krohn, S., Ostwald, D. (2017). Computing integrated information. Neuroscience of consciousness, 3(1): 1-16.

Aguilera M, di Paolo AE (2019) Integrated information in the thermodynamic limit. Neural netw 114:136–146

Tajima S, Kanai R (2017) Integrated information and dimensionality in continuous attractor dynamics. Neurosci Conscious 2017(1):nix011

Bach J (2019) The cortical conductor theory: towards addressing consciousness in AI models. In: Biologically inspired cognitive architectures 2018

Aguilera, M. (2019). Scaling behaviour and critical phase transitions in integrated information theory. Entropy 21(12):1198. https://doi.org/10.3390/e21121198

Tononi G, Sporns O (2003) Measuring information integration. BMC Neurosci 4:31

Barrett A, Seth AK (2011) Practical measures of integrated information for time-series data. PLoS Comput Biol 7:e1001052

Download references

Author information

Authors and affiliations.

Departamento de Sistemas e Informática, Universidad de Caldas, Manizales, Colombia

Luz Enith Guerrero, Luis Fernando Castillo & Jeferson Arango-López

REMIT, IJP, Universidade Portucalense and IEETA, Universidade de Aveiro, Aveiro, Portugal

Fernando Moreira

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Fernando Moreira .

Ethics declarations

Conflict of interest.

The authors have no conflict of interest with this proposal.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Data of main authors are available in the link:

https://docs.google.com/spreadsheets/d/1A9c5QOsTL1siMXZyVin_8Va0u7WJOOeh/edit?usp=share_link&ouid=112201640395350008286&rtpof=true&sd=true

In addition, the main image is presented below with all the authors who published at least one related article.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Guerrero, L.E., Castillo, L.F., Arango-López, J. et al. A systematic review of integrated information theory: a perspective from artificial intelligence and the cognitive sciences. Neural Comput & Applic (2023). https://doi.org/10.1007/s00521-023-08328-z

Download citation

Received : 13 September 2022

Accepted : 16 January 2023

Published : 07 February 2023

DOI : https://doi.org/10.1007/s00521-023-08328-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Integrated information
• Artificial intelligence
• Consciousness
• Systematic review
• Cognitive systems

Advertisement

• Find a journal
• Publish with us
• Track your research

• Search Menu

Sign in through your institution

• Browse content in Arts and Humanities
• Browse content in Archaeology
• Anglo-Saxon and Medieval Archaeology
• Archaeological Methodology and Techniques
• Archaeology by Region
• Archaeology of Religion
• Archaeology of Trade and Exchange
• Biblical Archaeology
• Contemporary and Public Archaeology
• Environmental Archaeology
• Historical Archaeology
• History and Theory of Archaeology
• Industrial Archaeology
• Landscape Archaeology
• Mortuary Archaeology
• Prehistoric Archaeology
• Underwater Archaeology
• Zooarchaeology
• Browse content in Architecture
• Architectural Structure and Design
• History of Architecture
• Residential and Domestic Buildings
• Theory of Architecture
• Browse content in Art
• Art Subjects and Themes
• History of Art
• Industrial and Commercial Art
• Theory of Art
• Biographical Studies
• Byzantine Studies
• Browse content in Classical Studies
• Classical History
• Classical Philosophy
• Classical Mythology
• Classical Numismatics
• Classical Literature
• Classical Reception
• Classical Art and Architecture
• Classical Oratory and Rhetoric
• Greek and Roman Papyrology
• Greek and Roman Epigraphy
• Greek and Roman Law
• Greek and Roman Archaeology
• Late Antiquity
• Religion in the Ancient World
• Social History
• Digital Humanities
• Browse content in History
• Colonialism and Imperialism
• Diplomatic History
• Environmental History
• Genealogy, Heraldry, Names, and Honours
• Genocide and Ethnic Cleansing
• Historical Geography
• History by Period
• History of Emotions
• History of Agriculture
• History of Education
• History of Gender and Sexuality
• Industrial History
• Intellectual History
• International History
• Labour History
• Legal and Constitutional History
• Local and Family History
• Maritime History
• Military History
• National Liberation and Post-Colonialism
• Oral History
• Political History
• Public History
• Regional and National History
• Revolutions and Rebellions
• Slavery and Abolition of Slavery
• Social and Cultural History
• Theory, Methods, and Historiography
• Urban History
• World History
• Browse content in Language Teaching and Learning
• Language Learning (Specific Skills)
• Language Teaching Theory and Methods
• Browse content in Linguistics
• Applied Linguistics
• Cognitive Linguistics
• Computational Linguistics
• Forensic Linguistics
• Grammar, Syntax and Morphology
• Historical and Diachronic Linguistics
• History of English
• Language Evolution
• Language Reference
• Language Acquisition
• Language Variation
• Language Families
• Lexicography
• Linguistic Anthropology
• Linguistic Theories
• Linguistic Typology
• Phonetics and Phonology
• Psycholinguistics
• Sociolinguistics
• Translation and Interpretation
• Writing Systems
• Browse content in Literature
• Bibliography
• Children's Literature Studies
• Literary Studies (Romanticism)
• Literary Studies (American)
• Literary Studies (Asian)
• Literary Studies (European)
• Literary Studies (Eco-criticism)
• Literary Studies (Modernism)
• Literary Studies - World
• Literary Studies (1500 to 1800)
• Literary Studies (19th Century)
• Literary Studies (20th Century onwards)
• Literary Studies (African American Literature)
• Literary Studies (British and Irish)
• Literary Studies (Early and Medieval)
• Literary Studies (Fiction, Novelists, and Prose Writers)
• Literary Studies (Gender Studies)
• Literary Studies (Graphic Novels)
• Literary Studies (History of the Book)
• Literary Studies (Plays and Playwrights)
• Literary Studies (Poetry and Poets)
• Literary Studies (Postcolonial Literature)
• Literary Studies (Queer Studies)
• Literary Studies (Science Fiction)
• Literary Studies (Travel Literature)
• Literary Studies (War Literature)
• Literary Studies (Women's Writing)
• Literary Theory and Cultural Studies
• Mythology and Folklore
• Shakespeare Studies and Criticism
• Browse content in Media Studies
• Browse content in Music
• Applied Music
• Dance and Music
• Ethics in Music
• Ethnomusicology
• Gender and Sexuality in Music
• Medicine and Music
• Music Cultures
• Music and Media
• Music and Religion
• Music and Culture
• Music Education and Pedagogy
• Music Theory and Analysis
• Musical Scores, Lyrics, and Libretti
• Musical Structures, Styles, and Techniques
• Musicology and Music History
• Performance Practice and Studies
• Race and Ethnicity in Music
• Sound Studies
• Browse content in Performing Arts
• Browse content in Philosophy
• Aesthetics and Philosophy of Art
• Epistemology
• Feminist Philosophy
• History of Western Philosophy
• Metaphysics
• Moral Philosophy
• Non-Western Philosophy
• Philosophy of Language
• Philosophy of Mind
• Philosophy of Perception
• Philosophy of Science
• Philosophy of Action
• Philosophy of Law
• Philosophy of Religion
• Philosophy of Mathematics and Logic
• Practical Ethics
• Social and Political Philosophy
• Browse content in Religion
• Biblical Studies
• Christianity
• East Asian Religions
• History of Religion
• Judaism and Jewish Studies
• Qumran Studies
• Religion and Education
• Religion and Health
• Religion and Politics
• Religion and Science
• Religion and Law
• Religion and Art, Literature, and Music
• Religious Studies
• Browse content in Society and Culture
• Cookery, Food, and Drink
• Cultural Studies
• Customs and Traditions
• Ethical Issues and Debates
• Hobbies, Games, Arts and Crafts
• Natural world, Country Life, and Pets
• Popular Beliefs and Controversial Knowledge
• Sports and Outdoor Recreation
• Technology and Society
• Travel and Holiday
• Visual Culture
• Browse content in Law
• Arbitration
• Browse content in Company and Commercial Law
• Commercial Law
• Company Law
• Browse content in Comparative Law
• Systems of Law
• Competition Law
• Browse content in Constitutional and Administrative Law
• Government Powers
• Judicial Review
• Local Government Law
• Military and Defence Law
• Parliamentary and Legislative Practice
• Construction Law
• Contract Law
• Browse content in Criminal Law
• Criminal Procedure
• Criminal Evidence Law
• Sentencing and Punishment
• Employment and Labour Law
• Environment and Energy Law
• Browse content in Financial Law
• Banking Law
• Insolvency Law
• History of Law
• Human Rights and Immigration
• Intellectual Property Law
• Browse content in International Law
• Private International Law and Conflict of Laws
• Public International Law
• IT and Communications Law
• Jurisprudence and Philosophy of Law
• Law and Politics
• Law and Society
• Browse content in Legal System and Practice
• Courts and Procedure
• Legal Skills and Practice
• Legal System - Costs and Funding
• Primary Sources of Law
• Regulation of Legal Profession
• Medical and Healthcare Law
• Browse content in Policing
• Criminal Investigation and Detection
• Police and Security Services
• Police Procedure and Law
• Police Regional Planning
• Browse content in Property Law
• Personal Property Law
• Restitution
• Study and Revision
• Terrorism and National Security Law
• Browse content in Trusts Law
• Wills and Probate or Succession
• Browse content in Medicine and Health
• Browse content in Allied Health Professions
• Arts Therapies
• Clinical Science
• Dietetics and Nutrition
• Occupational Therapy
• Operating Department Practice
• Physiotherapy
• Radiography
• Speech and Language Therapy
• Browse content in Anaesthetics
• General Anaesthesia
• Clinical Neuroscience
• Browse content in Clinical Medicine
• Acute Medicine
• Cardiovascular Medicine
• Clinical Genetics
• Clinical Pharmacology and Therapeutics
• Dermatology
• Endocrinology and Diabetes
• Gastroenterology
• Genito-urinary Medicine
• Geriatric Medicine
• Infectious Diseases
• Medical Toxicology
• Medical Oncology
• Pain Medicine
• Palliative Medicine
• Rehabilitation Medicine
• Respiratory Medicine and Pulmonology
• Rheumatology
• Sleep Medicine
• Sports and Exercise Medicine
• Community Medical Services
• Critical Care
• Emergency Medicine
• Forensic Medicine
• Haematology
• History of Medicine
• Browse content in Medical Skills
• Clinical Skills
• Communication Skills
• Nursing Skills
• Surgical Skills
• Browse content in Medical Dentistry
• Oral and Maxillofacial Surgery
• Paediatric Dentistry
• Restorative Dentistry and Orthodontics
• Surgical Dentistry
• Medical Ethics
• Medical Statistics and Methodology
• Browse content in Neurology
• Clinical Neurophysiology
• Neuropathology
• Nursing Studies
• Browse content in Obstetrics and Gynaecology
• Gynaecology
• Occupational Medicine
• Ophthalmology
• Otolaryngology (ENT)
• Browse content in Paediatrics
• Neonatology
• Browse content in Pathology
• Chemical Pathology
• Clinical Cytogenetics and Molecular Genetics
• Histopathology
• Medical Microbiology and Virology
• Patient Education and Information
• Browse content in Pharmacology
• Psychopharmacology
• Browse content in Popular Health
• Caring for Others
• Complementary and Alternative Medicine
• Self-help and Personal Development
• Browse content in Preclinical Medicine
• Cell Biology
• Molecular Biology and Genetics
• Reproduction, Growth and Development
• Primary Care
• Professional Development in Medicine
• Browse content in Psychiatry
• Addiction Medicine
• Child and Adolescent Psychiatry
• Forensic Psychiatry
• Learning Disabilities
• Old Age Psychiatry
• Psychotherapy
• Browse content in Public Health and Epidemiology
• Epidemiology
• Public Health
• Browse content in Radiology
• Clinical Radiology
• Interventional Radiology
• Nuclear Medicine
• Radiation Oncology
• Reproductive Medicine
• Browse content in Surgery
• Cardiothoracic Surgery
• Gastro-intestinal and Colorectal Surgery
• General Surgery
• Neurosurgery
• Paediatric Surgery
• Peri-operative Care
• Plastic and Reconstructive Surgery
• Surgical Oncology
• Transplant Surgery
• Trauma and Orthopaedic Surgery
• Vascular Surgery
• Browse content in Science and Mathematics
• Browse content in Biological Sciences
• Aquatic Biology
• Biochemistry
• Bioinformatics and Computational Biology
• Developmental Biology
• Ecology and Conservation
• Evolutionary Biology
• Genetics and Genomics
• Microbiology
• Molecular and Cell Biology
• Natural History
• Plant Sciences and Forestry
• Research Methods in Life Sciences
• Structural Biology
• Systems Biology
• Zoology and Animal Sciences
• Browse content in Chemistry
• Analytical Chemistry
• Computational Chemistry
• Crystallography
• Environmental Chemistry
• Industrial Chemistry
• Inorganic Chemistry
• Materials Chemistry
• Medicinal Chemistry
• Mineralogy and Gems
• Organic Chemistry
• Physical Chemistry
• Polymer Chemistry
• Study and Communication Skills in Chemistry
• Theoretical Chemistry
• Browse content in Computer Science
• Artificial Intelligence
• Computer Architecture and Logic Design
• Game Studies
• Human-Computer Interaction
• Mathematical Theory of Computation
• Programming Languages
• Software Engineering
• Systems Analysis and Design
• Virtual Reality
• Browse content in Computing
• Business Applications
• Computer Security
• Computer Games
• Computer Networking and Communications
• Digital Lifestyle
• Graphical and Digital Media Applications
• Operating Systems
• Browse content in Earth Sciences and Geography
• Atmospheric Sciences
• Environmental Geography
• Geology and the Lithosphere
• Maps and Map-making
• Meteorology and Climatology
• Oceanography and Hydrology
• Palaeontology
• Physical Geography and Topography
• Regional Geography
• Soil Science
• Urban Geography
• Browse content in Engineering and Technology
• Agriculture and Farming
• Biological Engineering
• Civil Engineering, Surveying, and Building
• Electronics and Communications Engineering
• Energy Technology
• Engineering (General)
• Environmental Science, Engineering, and Technology
• History of Engineering and Technology
• Mechanical Engineering and Materials
• Technology of Industrial Chemistry
• Transport Technology and Trades
• Browse content in Environmental Science
• Applied Ecology (Environmental Science)
• Conservation of the Environment (Environmental Science)
• Environmental Sustainability
• Environmentalist Thought and Ideology (Environmental Science)
• Management of Land and Natural Resources (Environmental Science)
• Natural Disasters (Environmental Science)
• Nuclear Issues (Environmental Science)
• Pollution and Threats to the Environment (Environmental Science)
• Social Impact of Environmental Issues (Environmental Science)
• History of Science and Technology
• Browse content in Materials Science
• Ceramics and Glasses
• Composite Materials
• Metals, Alloying, and Corrosion
• Nanotechnology
• Browse content in Mathematics
• Applied Mathematics
• Biomathematics and Statistics
• History of Mathematics
• Mathematical Education
• Mathematical Finance
• Mathematical Analysis
• Numerical and Computational Mathematics
• Probability and Statistics
• Pure Mathematics
• Browse content in Neuroscience
• Cognition and Behavioural Neuroscience
• Development of the Nervous System
• Disorders of the Nervous System
• History of Neuroscience
• Invertebrate Neurobiology
• Molecular and Cellular Systems
• Neuroendocrinology and Autonomic Nervous System
• Neuroscientific Techniques
• Sensory and Motor Systems
• Browse content in Physics
• Astronomy and Astrophysics
• Atomic, Molecular, and Optical Physics
• Biological and Medical Physics
• Classical Mechanics
• Computational Physics
• Condensed Matter Physics
• Electromagnetism, Optics, and Acoustics
• History of Physics
• Mathematical and Statistical Physics
• Measurement Science
• Nuclear Physics
• Particles and Fields
• Plasma Physics
• Quantum Physics
• Relativity and Gravitation
• Semiconductor and Mesoscopic Physics
• Browse content in Psychology
• Affective Sciences
• Clinical Psychology
• Cognitive Psychology
• Cognitive Neuroscience
• Criminal and Forensic Psychology
• Developmental Psychology
• Educational Psychology
• Evolutionary Psychology
• Health Psychology
• History and Systems in Psychology
• Music Psychology
• Neuropsychology
• Organizational Psychology
• Psychological Assessment and Testing
• Psychology of Human-Technology Interaction
• Psychology Professional Development and Training
• Research Methods in Psychology
• Social Psychology
• Browse content in Social Sciences
• Browse content in Anthropology
• Anthropology of Religion
• Human Evolution
• Medical Anthropology
• Physical Anthropology
• Regional Anthropology
• Social and Cultural Anthropology
• Theory and Practice of Anthropology
• Browse content in Business and Management
• Business Ethics
• Business Strategy
• Business History
• Business and Technology
• Business and Government
• Business and the Environment
• Comparative Management
• Corporate Governance
• Corporate Social Responsibility
• Entrepreneurship
• Health Management
• Human Resource Management
• Industrial and Employment Relations
• Industry Studies
• Information and Communication Technologies
• International Business
• Knowledge Management
• Management and Management Techniques
• Operations Management
• Organizational Theory and Behaviour
• Pensions and Pension Management
• Public and Nonprofit Management
• Social Issues in Business and Management
• Strategic Management
• Supply Chain Management
• Browse content in Criminology and Criminal Justice
• Criminal Justice
• Criminology
• Forms of Crime
• International and Comparative Criminology
• Youth Violence and Juvenile Justice
• Development Studies
• Browse content in Economics
• Agricultural, Environmental, and Natural Resource Economics
• Asian Economics
• Behavioural Finance
• Behavioural Economics and Neuroeconomics
• Econometrics and Mathematical Economics
• Economic History
• Economic Systems
• Economic Methodology
• Economic Development and Growth
• Financial Markets
• Financial Institutions and Services
• General Economics and Teaching
• Health, Education, and Welfare
• History of Economic Thought
• International Economics
• Labour and Demographic Economics
• Law and Economics
• Macroeconomics and Monetary Economics
• Microeconomics
• Public Economics
• Urban, Rural, and Regional Economics
• Welfare Economics
• Browse content in Education
• Adult Education and Continuous Learning
• Care and Counselling of Students
• Early Childhood and Elementary Education
• Educational Equipment and Technology
• Educational Strategies and Policy
• Higher and Further Education
• Organization and Management of Education
• Philosophy and Theory of Education
• Schools Studies
• Secondary Education
• Teaching of a Specific Subject
• Teaching of Specific Groups and Special Educational Needs
• Teaching Skills and Techniques
• Browse content in Environment
• Applied Ecology (Social Science)
• Climate Change
• Conservation of the Environment (Social Science)
• Environmentalist Thought and Ideology (Social Science)
• Management of Land and Natural Resources (Social Science)
• Natural Disasters (Environment)
• Pollution and Threats to the Environment (Social Science)
• Social Impact of Environmental Issues (Social Science)
• Sustainability
• Browse content in Human Geography
• Cultural Geography
• Economic Geography
• Political Geography
• Browse content in Interdisciplinary Studies
• Communication Studies
• Museums, Libraries, and Information Sciences
• Browse content in Politics
• African Politics
• Asian Politics
• Chinese Politics
• Comparative Politics
• Conflict Politics
• Elections and Electoral Studies
• Environmental Politics
• Ethnic Politics
• European Union
• Foreign Policy
• Gender and Politics
• Human Rights and Politics
• Indian Politics
• International Relations
• International Organization (Politics)
• Irish Politics
• Latin American Politics
• Middle Eastern Politics
• Political Behaviour
• Political Economy
• Political Institutions
• Political Methodology
• Political Communication
• Political Philosophy
• Political Sociology
• Political Theory
• Politics and Law
• Politics of Development
• Public Policy
• Public Administration
• Qualitative Political Methodology
• Quantitative Political Methodology
• Regional Political Studies
• Russian Politics
• Security Studies
• State and Local Government
• UK Politics
• US Politics
• Browse content in Regional and Area Studies
• African Studies
• Asian Studies
• East Asian Studies
• Japanese Studies
• Latin American Studies
• Middle Eastern Studies
• Native American Studies
• Scottish Studies
• Browse content in Research and Information
• Research Methods
• Browse content in Social Work
• Addictions and Substance Misuse
• Adoption and Fostering
• Care of the Elderly
• Child and Adolescent Social Work
• Couple and Family Social Work
• Direct Practice and Clinical Social Work
• Emergency Services
• Human Behaviour and the Social Environment
• International and Global Issues in Social Work
• Mental and Behavioural Health
• Social Justice and Human Rights
• Social Policy and Advocacy
• Social Work and Crime and Justice
• Social Work Macro Practice
• Social Work Practice Settings
• Social Work Research and Evidence-based Practice
• Welfare and Benefit Systems
• Browse content in Sociology
• Childhood Studies
• Community Development
• Comparative and Historical Sociology
• Disability Studies
• Economic Sociology
• Gender and Sexuality
• Gerontology and Ageing
• Health, Illness, and Medicine
• Marriage and the Family
• Migration Studies
• Occupations, Professions, and Work
• Organizations
• Population and Demography
• Race and Ethnicity
• Social Theory
• Social Movements and Social Change
• Social Research and Statistics
• Social Stratification, Inequality, and Mobility
• Sociology of Religion
• Sociology of Education
• Sport and Leisure
• Urban and Rural Studies
• Browse content in Warfare and Defence
• Defence Strategy, Planning, and Research
• Land Forces and Warfare
• Military Administration
• Military Life and Institutions
• Naval Forces and Warfare
• Other Warfare and Defence Issues
• Peace Studies and Conflict Resolution
• Weapons and Equipment

• < Previous
• Next chapter >

1 Introduction to information theory

• Published: January 2009
• Cite Icon Cite
• Permissions Icon Permissions

This chapter introduces some of the basic concepts of information theory, as well as the definitions and notations of probability theory that are used throughout the book. It defines the fundamental notions of entropy, relative entropy, and mutual information. It also presents the main questions of information theory: data compression and data transmission. Finally, it offers a brief introduction to error correcting codes and Shannon's theory.

Personal account

• Sign in with email/username & password
• Get email alerts
• Save searches
• Purchase content
• Activate your purchase/trial code
• Add your ORCID iD

Institutional access

Sign in with a library card.

• Sign in with username/password
• Recommend to your librarian
• Institutional account management
• Get help with access

Access to content on Oxford Academic is often provided through institutional subscriptions and purchases. If you are a member of an institution with an active account, you may be able to access content in one of the following ways:

IP based access

Typically, access is provided across an institutional network to a range of IP addresses. This authentication occurs automatically, and it is not possible to sign out of an IP authenticated account.

Choose this option to get remote access when outside your institution. Shibboleth/Open Athens technology is used to provide single sign-on between your institution’s website and Oxford Academic.

• Click Sign in through your institution.
• Select your institution from the list provided, which will take you to your institution's website to sign in.
• When on the institution site, please use the credentials provided by your institution. Do not use an Oxford Academic personal account.
• Following successful sign in, you will be returned to Oxford Academic.

If your institution is not listed or you cannot sign in to your institution’s website, please contact your librarian or administrator.

Enter your library card number to sign in. If you cannot sign in, please contact your librarian.

Society Members

Society member access to a journal is achieved in one of the following ways:

Sign in through society site

Many societies offer single sign-on between the society website and Oxford Academic. If you see ‘Sign in through society site’ in the sign in pane within a journal:

• Click Sign in through society site.
• When on the society site, please use the credentials provided by that society. Do not use an Oxford Academic personal account.

If you do not have a society account or have forgotten your username or password, please contact your society.

Sign in using a personal account

Some societies use Oxford Academic personal accounts to provide access to their members. See below.

A personal account can be used to get email alerts, save searches, purchase content, and activate subscriptions.

Some societies use Oxford Academic personal accounts to provide access to their members.

Viewing your signed in accounts

Click the account icon in the top right to:

• View your signed in personal account and access account management features.
• View the institutional accounts that are providing access.

Signed in but can't access content

Oxford Academic is home to a wide variety of products. The institutional subscription may not cover the content that you are trying to access. If you believe you should have access to that content, please contact your librarian.

For librarians and administrators, your personal account also provides access to institutional account management. Here you will find options to view and activate subscriptions, manage institutional settings and access options, access usage statistics, and more.

Our books are available by subscription or purchase to libraries and institutions.

• About Oxford Academic
• Publish journals with us
• University press partners
• What we publish
• New features  
• Open access
• Rights and permissions
• Accessibility
• Advertising
• Media enquiries
• Oxford University Press
• Oxford Languages
• University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

• Copyright © 2024 Oxford University Press
• Cookie settings
• Cookie policy
• Privacy policy
• Legal notice

This Feature Is Available To Subscribers Only

Sign In or Create an Account

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

• UConn Library
• Literature Review: The What, Why and How-to Guide
• Introduction

Literature Review: The What, Why and How-to Guide — Introduction

• Getting Started
• How to Pick a Topic
• Strategies to Find Sources
• Evaluating Sources & Lit. Reviews
• Tips for Writing Literature Reviews
• Writing Literature Review: Useful Sites
• Citation Resources
• Other Academic Writings

What are Literature Reviews?

So, what is a literature review? "A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are. As a piece of writing, the literature review must be defined by a guiding concept (e.g., your research objective, the problem or issue you are discussing, or your argumentative thesis). It is not just a descriptive list of the material available, or a set of summaries." Taylor, D.  The literature review: A few tips on conducting it . University of Toronto Health Sciences Writing Centre.

Goals of Literature Reviews

What are the goals of creating a Literature Review?  A literature could be written to accomplish different aims:

• To develop a theory or evaluate an existing theory
• To summarize the historical or existing state of a research topic
• Identify a problem in a field of research 

Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews .  Review of General Psychology , 1 (3), 311-320.

What kinds of sources require a Literature Review?

• A research paper assigned in a course
• A thesis or dissertation
• A grant proposal
• An article intended for publication in a journal

All these instances require you to collect what has been written about your research topic so that you can demonstrate how your own research sheds new light on the topic.

Types of Literature Reviews

What kinds of literature reviews are written?

Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified. The review ends with a conclusion section which summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.

• Example : Predictors and Outcomes of U.S. Quality Maternity Leave: A Review and Conceptual Framework:  10.1177/08948453211037398  

Systematic review : "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139). Nelson, L. K. (2013). Research in Communication Sciences and Disorders . Plural Publishing.

• Example : The effect of leave policies on increasing fertility: a systematic review:  10.1057/s41599-022-01270-w

Meta-analysis : "Meta-analysis is a method of reviewing research findings in a quantitative fashion by transforming the data from individual studies into what is called an effect size and then pooling and analyzing this information. The basic goal in meta-analysis is to explain why different outcomes have occurred in different studies." (p. 197). Roberts, M. C., & Ilardi, S. S. (2003). Handbook of Research Methods in Clinical Psychology . Blackwell Publishing.

• Example : Employment Instability and Fertility in Europe: A Meta-Analysis:  10.1215/00703370-9164737

Meta-synthesis : "Qualitative meta-synthesis is a type of qualitative study that uses as data the findings from other qualitative studies linked by the same or related topic." (p.312). Zimmer, L. (2006). Qualitative meta-synthesis: A question of dialoguing with texts .  Journal of Advanced Nursing , 53 (3), 311-318.

• Example : Women’s perspectives on career successes and barriers: A qualitative meta-synthesis:  10.1177/05390184221113735

Literature Reviews in the Health Sciences

• UConn Health subject guide on systematic reviews Explanation of the different review types used in health sciences literature as well as tools to help you find the right review type
• << Previous: Getting Started
• Next: How to Pick a Topic >>
• Last Updated: Sep 21, 2022 2:16 PM
• URL: https://guides.lib.uconn.edu/literaturereview

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base

Methodology

• How to Write a Literature Review | Guide, Examples, & Templates

How to Write a Literature Review | Guide, Examples, & Templates

Published on January 2, 2023 by Shona McCombes . Revised on September 11, 2023.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research that you can later apply to your paper, thesis, or dissertation topic .

There are five key steps to writing a literature review:

• Search for relevant literature
• Evaluate sources
• Identify themes, debates, and gaps
• Outline the structure
• Write your literature review

A good literature review doesn’t just summarize sources—it analyzes, synthesizes , and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Upload your document to correct all your mistakes in minutes

Table of contents

What is the purpose of a literature review, examples of literature reviews, step 1 – search for relevant literature, step 2 – evaluate and select sources, step 3 – identify themes, debates, and gaps, step 4 – outline your literature review’s structure, step 5 – write your literature review, free lecture slides, other interesting articles, frequently asked questions, introduction.

• Quick Run-through
• Step 1 & 2

When you write a thesis , dissertation , or research paper , you will likely have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

• Demonstrate your familiarity with the topic and its scholarly context
• Develop a theoretical framework and methodology for your research
• Position your work in relation to other researchers and theorists
• Show how your research addresses a gap or contributes to a debate
• Evaluate the current state of research and demonstrate your knowledge of the scholarly debates around your topic.

Writing literature reviews is a particularly important skill if you want to apply for graduate school or pursue a career in research. We’ve written a step-by-step guide that you can follow below.

Don't submit your assignments before you do this

The academic proofreading tool has been trained on 1000s of academic texts. Making it the most accurate and reliable proofreading tool for students. Free citation check included.

Try for free

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

• Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
• Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
• Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
• Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research problem and questions .

Make a list of keywords

Start by creating a list of keywords related to your research question. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list as you discover new keywords in the process of your literature search.

• Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
• Body image, self-perception, self-esteem, mental health
• Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some useful databases to search for journals and articles include:

• Your university’s library catalogue
• Google Scholar
• Project Muse (humanities and social sciences)
• Medline (life sciences and biomedicine)
• EconLit (economics)
• Inspec (physics, engineering and computer science)

You can also use boolean operators to help narrow down your search.

Make sure to read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

You likely won’t be able to read absolutely everything that has been written on your topic, so it will be necessary to evaluate which sources are most relevant to your research question.

For each publication, ask yourself:

• What question or problem is the author addressing?
• What are the key concepts and how are they defined?
• What are the key theories, models, and methods?
• Does the research use established frameworks or take an innovative approach?
• What are the results and conclusions of the study?
• How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
• What are the strengths and weaknesses of the research?

Make sure the sources you use are credible , and make sure you read any landmark studies and major theories in your field of research.

You can use our template to summarize and evaluate sources you’re thinking about using. Click on either button below to download.

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It is important to keep track of your sources with citations to avoid plagiarism . It can be helpful to make an annotated bibliography , where you compile full citation information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

To begin organizing your literature review’s argument and structure, be sure you understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

• Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
• Themes: what questions or concepts recur across the literature?
• Debates, conflicts and contradictions: where do sources disagree?
• Pivotal publications: are there any influential theories or studies that changed the direction of the field?
• Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

• Most research has focused on young women.
• There is an increasing interest in the visual aspects of social media.
• But there is still a lack of robust research on highly visual platforms like Instagram and Snapchat—this is a gap that you could address in your own research.

There are various approaches to organizing the body of a literature review. Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarizing sources in order.

Try to analyze patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organize your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

• Look at what results have emerged in qualitative versus quantitative research
• Discuss how the topic has been approached by empirical versus theoretical scholarship
• Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text , your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, you can follow these tips:

• Summarize and synthesize: give an overview of the main points of each source and combine them into a coherent whole
• Analyze and interpret: don’t just paraphrase other researchers — add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
• Critically evaluate: mention the strengths and weaknesses of your sources
• Write in well-structured paragraphs: use transition words and topic sentences to draw connections, comparisons and contrasts

In the conclusion, you should summarize the key findings you have taken from the literature and emphasize their significance.

When you’ve finished writing and revising your literature review, don’t forget to proofread thoroughly before submitting. Not a language expert? Check out Scribbr’s professional proofreading services !

This article has been adapted into lecture slides that you can use to teach your students about writing a literature review.

Scribbr slides are free to use, customize, and distribute for educational purposes.

Open Google Slides Download PowerPoint

If you want to know more about the research process , methodology , research bias , or statistics , make sure to check out some of our other articles with explanations and examples.

• Sampling methods
• Simple random sampling
• Stratified sampling
• Cluster sampling
• Likert scales
• Reproducibility

 Statistics

• Null hypothesis
• Statistical power
• Probability distribution
• Effect size
• Poisson distribution

Research bias

• Optimism bias
• Cognitive bias
• Implicit bias
• Hawthorne effect
• Anchoring bias
• Explicit bias

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a thesis, dissertation , or research paper , in order to situate your work in relation to existing knowledge.

There are several reasons to conduct a literature review at the beginning of a research project:

• To familiarize yourself with the current state of knowledge on your topic
• To ensure that you’re not just repeating what others have already done
• To identify gaps in knowledge and unresolved problems that your research can address
• To develop your theoretical framework and methodology
• To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your thesis or dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

A literature review is a survey of credible sources on a topic, often used in dissertations , theses, and research papers . Literature reviews give an overview of knowledge on a subject, helping you identify relevant theories and methods, as well as gaps in existing research. Literature reviews are set up similarly to other  academic texts , with an introduction , a main body, and a conclusion .

An  annotated bibliography is a list of  source references that has a short description (called an annotation ) for each of the sources. It is often assigned as part of the research process for a  paper .  

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

McCombes, S. (2023, September 11). How to Write a Literature Review | Guide, Examples, & Templates. Scribbr. Retrieved August 21, 2024, from https://www.scribbr.com/dissertation/literature-review/

Is this article helpful?

Shona McCombes

Other students also liked, what is a theoretical framework | guide to organizing, what is a research methodology | steps & tips, how to write a research proposal | examples & templates, get unlimited documents corrected.

✔ Free APA citation check included ✔ Unlimited document corrections ✔ Specialized in correcting academic texts

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• PLoS Comput Biol
• v.9(7); 2013 Jul

Ten Simple Rules for Writing a Literature Review

Marco pautasso.

1 Centre for Functional and Evolutionary Ecology (CEFE), CNRS, Montpellier, France

2 Centre for Biodiversity Synthesis and Analysis (CESAB), FRB, Aix-en-Provence, France

Literature reviews are in great demand in most scientific fields. Their need stems from the ever-increasing output of scientific publications [1] . For example, compared to 1991, in 2008 three, eight, and forty times more papers were indexed in Web of Science on malaria, obesity, and biodiversity, respectively [2] . Given such mountains of papers, scientists cannot be expected to examine in detail every single new paper relevant to their interests [3] . Thus, it is both advantageous and necessary to rely on regular summaries of the recent literature. Although recognition for scientists mainly comes from primary research, timely literature reviews can lead to new synthetic insights and are often widely read [4] . For such summaries to be useful, however, they need to be compiled in a professional way [5] .

When starting from scratch, reviewing the literature can require a titanic amount of work. That is why researchers who have spent their career working on a certain research issue are in a perfect position to review that literature. Some graduate schools are now offering courses in reviewing the literature, given that most research students start their project by producing an overview of what has already been done on their research issue [6] . However, it is likely that most scientists have not thought in detail about how to approach and carry out a literature review.

Reviewing the literature requires the ability to juggle multiple tasks, from finding and evaluating relevant material to synthesising information from various sources, from critical thinking to paraphrasing, evaluating, and citation skills [7] . In this contribution, I share ten simple rules I learned working on about 25 literature reviews as a PhD and postdoctoral student. Ideas and insights also come from discussions with coauthors and colleagues, as well as feedback from reviewers and editors.

Rule 1: Define a Topic and Audience

How to choose which topic to review? There are so many issues in contemporary science that you could spend a lifetime of attending conferences and reading the literature just pondering what to review. On the one hand, if you take several years to choose, several other people may have had the same idea in the meantime. On the other hand, only a well-considered topic is likely to lead to a brilliant literature review [8] . The topic must at least be:

• interesting to you (ideally, you should have come across a series of recent papers related to your line of work that call for a critical summary),
• an important aspect of the field (so that many readers will be interested in the review and there will be enough material to write it), and
• a well-defined issue (otherwise you could potentially include thousands of publications, which would make the review unhelpful).

Ideas for potential reviews may come from papers providing lists of key research questions to be answered [9] , but also from serendipitous moments during desultory reading and discussions. In addition to choosing your topic, you should also select a target audience. In many cases, the topic (e.g., web services in computational biology) will automatically define an audience (e.g., computational biologists), but that same topic may also be of interest to neighbouring fields (e.g., computer science, biology, etc.).

Rule 2: Search and Re-search the Literature

After having chosen your topic and audience, start by checking the literature and downloading relevant papers. Five pieces of advice here:

• keep track of the search items you use (so that your search can be replicated [10] ),
• keep a list of papers whose pdfs you cannot access immediately (so as to retrieve them later with alternative strategies),
• use a paper management system (e.g., Mendeley, Papers, Qiqqa, Sente),
• define early in the process some criteria for exclusion of irrelevant papers (these criteria can then be described in the review to help define its scope), and
• do not just look for research papers in the area you wish to review, but also seek previous reviews.

The chances are high that someone will already have published a literature review ( Figure 1 ), if not exactly on the issue you are planning to tackle, at least on a related topic. If there are already a few or several reviews of the literature on your issue, my advice is not to give up, but to carry on with your own literature review,

The bottom-right situation (many literature reviews but few research papers) is not just a theoretical situation; it applies, for example, to the study of the impacts of climate change on plant diseases, where there appear to be more literature reviews than research studies [33] .

• discussing in your review the approaches, limitations, and conclusions of past reviews,
• trying to find a new angle that has not been covered adequately in the previous reviews, and
• incorporating new material that has inevitably accumulated since their appearance.

When searching the literature for pertinent papers and reviews, the usual rules apply:

• be thorough,
• use different keywords and database sources (e.g., DBLP, Google Scholar, ISI Proceedings, JSTOR Search, Medline, Scopus, Web of Science), and
• look at who has cited past relevant papers and book chapters.

Rule 3: Take Notes While Reading

If you read the papers first, and only afterwards start writing the review, you will need a very good memory to remember who wrote what, and what your impressions and associations were while reading each single paper. My advice is, while reading, to start writing down interesting pieces of information, insights about how to organize the review, and thoughts on what to write. This way, by the time you have read the literature you selected, you will already have a rough draft of the review.

Of course, this draft will still need much rewriting, restructuring, and rethinking to obtain a text with a coherent argument [11] , but you will have avoided the danger posed by staring at a blank document. Be careful when taking notes to use quotation marks if you are provisionally copying verbatim from the literature. It is advisable then to reformulate such quotes with your own words in the final draft. It is important to be careful in noting the references already at this stage, so as to avoid misattributions. Using referencing software from the very beginning of your endeavour will save you time.

Rule 4: Choose the Type of Review You Wish to Write

After having taken notes while reading the literature, you will have a rough idea of the amount of material available for the review. This is probably a good time to decide whether to go for a mini- or a full review. Some journals are now favouring the publication of rather short reviews focusing on the last few years, with a limit on the number of words and citations. A mini-review is not necessarily a minor review: it may well attract more attention from busy readers, although it will inevitably simplify some issues and leave out some relevant material due to space limitations. A full review will have the advantage of more freedom to cover in detail the complexities of a particular scientific development, but may then be left in the pile of the very important papers “to be read” by readers with little time to spare for major monographs.

There is probably a continuum between mini- and full reviews. The same point applies to the dichotomy of descriptive vs. integrative reviews. While descriptive reviews focus on the methodology, findings, and interpretation of each reviewed study, integrative reviews attempt to find common ideas and concepts from the reviewed material [12] . A similar distinction exists between narrative and systematic reviews: while narrative reviews are qualitative, systematic reviews attempt to test a hypothesis based on the published evidence, which is gathered using a predefined protocol to reduce bias [13] , [14] . When systematic reviews analyse quantitative results in a quantitative way, they become meta-analyses. The choice between different review types will have to be made on a case-by-case basis, depending not just on the nature of the material found and the preferences of the target journal(s), but also on the time available to write the review and the number of coauthors [15] .

Rule 5: Keep the Review Focused, but Make It of Broad Interest

Whether your plan is to write a mini- or a full review, it is good advice to keep it focused 16 , 17 . Including material just for the sake of it can easily lead to reviews that are trying to do too many things at once. The need to keep a review focused can be problematic for interdisciplinary reviews, where the aim is to bridge the gap between fields [18] . If you are writing a review on, for example, how epidemiological approaches are used in modelling the spread of ideas, you may be inclined to include material from both parent fields, epidemiology and the study of cultural diffusion. This may be necessary to some extent, but in this case a focused review would only deal in detail with those studies at the interface between epidemiology and the spread of ideas.

While focus is an important feature of a successful review, this requirement has to be balanced with the need to make the review relevant to a broad audience. This square may be circled by discussing the wider implications of the reviewed topic for other disciplines.

Rule 6: Be Critical and Consistent

Reviewing the literature is not stamp collecting. A good review does not just summarize the literature, but discusses it critically, identifies methodological problems, and points out research gaps [19] . After having read a review of the literature, a reader should have a rough idea of:

• the major achievements in the reviewed field,
• the main areas of debate, and
• the outstanding research questions.

It is challenging to achieve a successful review on all these fronts. A solution can be to involve a set of complementary coauthors: some people are excellent at mapping what has been achieved, some others are very good at identifying dark clouds on the horizon, and some have instead a knack at predicting where solutions are going to come from. If your journal club has exactly this sort of team, then you should definitely write a review of the literature! In addition to critical thinking, a literature review needs consistency, for example in the choice of passive vs. active voice and present vs. past tense.

Rule 7: Find a Logical Structure

Like a well-baked cake, a good review has a number of telling features: it is worth the reader's time, timely, systematic, well written, focused, and critical. It also needs a good structure. With reviews, the usual subdivision of research papers into introduction, methods, results, and discussion does not work or is rarely used. However, a general introduction of the context and, toward the end, a recapitulation of the main points covered and take-home messages make sense also in the case of reviews. For systematic reviews, there is a trend towards including information about how the literature was searched (database, keywords, time limits) [20] .

How can you organize the flow of the main body of the review so that the reader will be drawn into and guided through it? It is generally helpful to draw a conceptual scheme of the review, e.g., with mind-mapping techniques. Such diagrams can help recognize a logical way to order and link the various sections of a review [21] . This is the case not just at the writing stage, but also for readers if the diagram is included in the review as a figure. A careful selection of diagrams and figures relevant to the reviewed topic can be very helpful to structure the text too [22] .

Rule 8: Make Use of Feedback

Reviews of the literature are normally peer-reviewed in the same way as research papers, and rightly so [23] . As a rule, incorporating feedback from reviewers greatly helps improve a review draft. Having read the review with a fresh mind, reviewers may spot inaccuracies, inconsistencies, and ambiguities that had not been noticed by the writers due to rereading the typescript too many times. It is however advisable to reread the draft one more time before submission, as a last-minute correction of typos, leaps, and muddled sentences may enable the reviewers to focus on providing advice on the content rather than the form.

Feedback is vital to writing a good review, and should be sought from a variety of colleagues, so as to obtain a diversity of views on the draft. This may lead in some cases to conflicting views on the merits of the paper, and on how to improve it, but such a situation is better than the absence of feedback. A diversity of feedback perspectives on a literature review can help identify where the consensus view stands in the landscape of the current scientific understanding of an issue [24] .

Rule 9: Include Your Own Relevant Research, but Be Objective

In many cases, reviewers of the literature will have published studies relevant to the review they are writing. This could create a conflict of interest: how can reviewers report objectively on their own work [25] ? Some scientists may be overly enthusiastic about what they have published, and thus risk giving too much importance to their own findings in the review. However, bias could also occur in the other direction: some scientists may be unduly dismissive of their own achievements, so that they will tend to downplay their contribution (if any) to a field when reviewing it.

In general, a review of the literature should neither be a public relations brochure nor an exercise in competitive self-denial. If a reviewer is up to the job of producing a well-organized and methodical review, which flows well and provides a service to the readership, then it should be possible to be objective in reviewing one's own relevant findings. In reviews written by multiple authors, this may be achieved by assigning the review of the results of a coauthor to different coauthors.

Rule 10: Be Up-to-Date, but Do Not Forget Older Studies

Given the progressive acceleration in the publication of scientific papers, today's reviews of the literature need awareness not just of the overall direction and achievements of a field of inquiry, but also of the latest studies, so as not to become out-of-date before they have been published. Ideally, a literature review should not identify as a major research gap an issue that has just been addressed in a series of papers in press (the same applies, of course, to older, overlooked studies (“sleeping beauties” [26] )). This implies that literature reviewers would do well to keep an eye on electronic lists of papers in press, given that it can take months before these appear in scientific databases. Some reviews declare that they have scanned the literature up to a certain point in time, but given that peer review can be a rather lengthy process, a full search for newly appeared literature at the revision stage may be worthwhile. Assessing the contribution of papers that have just appeared is particularly challenging, because there is little perspective with which to gauge their significance and impact on further research and society.

Inevitably, new papers on the reviewed topic (including independently written literature reviews) will appear from all quarters after the review has been published, so that there may soon be the need for an updated review. But this is the nature of science [27] – [32] . I wish everybody good luck with writing a review of the literature.

Acknowledgments

Many thanks to M. Barbosa, K. Dehnen-Schmutz, T. Döring, D. Fontaneto, M. Garbelotto, O. Holdenrieder, M. Jeger, D. Lonsdale, A. MacLeod, P. Mills, M. Moslonka-Lefebvre, G. Stancanelli, P. Weisberg, and X. Xu for insights and discussions, and to P. Bourne, T. Matoni, and D. Smith for helpful comments on a previous draft.

Funding Statement

This work was funded by the French Foundation for Research on Biodiversity (FRB) through its Centre for Synthesis and Analysis of Biodiversity data (CESAB), as part of the NETSEED research project. The funders had no role in the preparation of the manuscript.