1,987 publications from this institution
Computational models of visual attention in artificial intelligence and robotics have been inspired by the concept of a saliency map. These models account for the mutual information between the (current) visual information and its estimated causes. However, they fail to consider the circular causality between perception and action. In other words, they do not consider where to sample next, given current beliefs. Here, we reclaim salience as an active inference process that relies on two basic principles: uncertainty minimization and rhythmic scheduling. For this, we make a distinction between attention and salience. Briefly, we associate attention with precision control, i.e., the confidence with which beliefs can be updated given sampled sensory data, and salience with uncertainty minimization that underwrites the selection of future sensory data. Using this, we propose a new account of attention based on rhythmic precision-modulation and discuss its potential in robotics, providing numerical experiments that showcase its advantages for state and noise estimation, system identification and action selection for informative path planning.
In this, the first of three papers, the nature of, and motivation for, neuronal transients is described in relation to characterizing brain dynamics. This paper deals with some basic aspects of neuronal dynamics, interactions, coupling and implicit neuronal codes. The second paper develops neuronal transients and nonlinear coupling in the context of dynamic instability and complexity, and suggests that instability or lability is necessary for adaptive self–organization. The final paper addresses the role of neuronal transients through information theory and the emergence of spatio–temporal receptive fields and functional specialization. By considering the brain as an ensemble of connected dynamic systems one can show that a sufficient description of neuronal dynamics comprises neuronal activity at a particular time and its recent history. This history constitutes a neuronal transient. As such, transients represent a fundamental metric of neuronal interactions and, implicitly, a code employed in the functional integration of brain systems. The nature of transients, expressed conjointly in distinct neuronal populations, reflects the underlying coupling among populations. This coupling may be synchronous (and possibly oscillatory) or asynchronous. A critical distinction between synchronous and asynchronous coupling is that the former is essentially linear and the latter is nonlinear. The nonlinear nature of asynchronous coupling enables the rich, context–sensitive interactions that characterize real brain dynamics, suggesting that it plays a role in functional integration that may be as important as synchronous interactions. The distinction between linear and nonlinear coupling has fundamental implications for the analysis and characterization of neuronal interactions, most of which are predicated on linear (synchronous) coupling (e.g. crosscorrelograms and coherence). Using neuromagnetic data it is shown that nonlinear (asynchronous) coupling is, in fact, more abundant and can be more significant than synchronous coupling.
This article reviews a free-energy formulation that advances Helmholtz's agenda to find principles of brain function based on conservation laws and neuronal energy. It rests on advances in statistical physics, theoretical biology and machine learning to explain a remarkable range of facts about brain structure and function. We could have just scratched the surface of what this formulation offers; for example, it is becoming clear that the Bayesian brain is just one facet of the free-energy principle and that perception is an inevitable consequence of active exchange with the environment. Furthermore, one can see easily how constructs like memory, attention, value, reinforcement and salience might disclose their simple relationships within this framework.
Natural language syntax yields an unbounded array of hierarchically structured expressions. We claim that these are used in the service of active inference in accord with the free-energy principle (FEP). While conceptual advances alongside modelling and simulation work have attempted to connect speech segmentation and linguistic communication with the FEP, we extend this program to the underlying computations responsible for generating syntactic objects. We argue that recently proposed principles of economy in language design—such as “minimal search” criteria from theoretical syntax—adhere to the FEP. This affords a greater degree of explanatory power to the FEP—with respect to higher language functions—and offers linguistics a grounding in first principles with respect to computability. We show how both tree-geometric depth and a Kolmogorov complexity estimate (recruiting a Lempel–Ziv compression algorithm) can be used to accurately predict legal operations on syntactic workspaces, directly in line with formulations of variational free energy minimization. This is used to motivate a general principle of language design that we term Turing–Chomsky Compression (TCC). We use TCC to align concerns of linguists with the normative account of self-organization furnished by the FEP, by marshalling evidence from theoretical linguistics and psycholinguistics to ground core principles of efficient syntactic computation within active inference.
The ability to plan ahead efficiently is key for both living organisms and artificial systems. Model-based planning and prospection are widely studied in cognitive neuroscience and artificial intelligence (AI), but from different perspectives--and with different desiderata in mind (biological realism versus scalability) that are difficult to reconcile. Here, we introduce a novel method to plan in POMDPs--Active Inference Tree Search (AcT)--that combines the normative character and biological realism of a leading planning theory in neuroscience (Active Inference) and the scalability of tree search methods in AI. This unification enhances both approaches. On the one hand, tree searches enable the biologically grounded, first principle method of active inference to be applied to large-scale problems. On the other hand, active inference provides a principled solution to the exploration-exploitation dilemma, which is often addressed heuristically in tree search methods. Our simulations show that AcT successfully navigates binary trees that are challenging for sampling-based methods, problems that require adaptive exploration, and the large POMDP problem 'RockSample'--in which AcT reproduces state-of-the-art POMDP solutions. Furthermore, we illustrate how AcT can be used to simulate neurophysiological responses (e.g., in the hippocampus and prefrontal cortex) of humans and other animals that solve large planning problems. These numerical analyses show that Active Tree Search is a principled realisation of neuroscientific and AI planning theories, which offer both biological realism and scalability.
The temporal dynamics of evoked brain responses are normally characterized using electrophysiological techniques but the positron emission tomography study presented here revealed a temporal aspect of reading by correlating the duration a word remained in the visual field with evoked haemodynamic response. Three distinct types of effects were observed: in visual processing areas, there were linear increases in activity with duration suggesting that visual processing endures throughout the time the stimulus remains in the visual field. In right hemisphere areas, there were monotonic decreases in activity with increased duration which we relate to decreased attention for longer stimulus durations. In left hemisphere word processing areas there were inverted U–shaped dependencies between activity and word duration indicating that, after 400–600 ms, activity in word processing areas is progressively reduced if the word remains in the visual field. We conclude that these inverted U effects in left hemisphere language areas reflect the temporal dynamics of visual word processing and we highlight the implication of these effects for the design of activation studies involving reading.
Context-sensitive and activity-dependent fluctuations in connectivity underlie functional integration in the brain and have been studied widely in terms of synaptic plasticity, learning and condition-specific (e.g., attentional) modulations of synaptic efficacy. This dynamic aspect of brain connectivity has recently attracted a lot of attention in the resting state fMRI community. To explain dynamic functional connectivity in terms of directed effective connectivity among brain regions, we introduce a novel method to identify dynamic effective connectivity using spectral dynamic causal modelling (spDCM). We used parametric empirical Bayes (PEB) to model fluctuations in directed coupling over consecutive windows of resting state fMRI time series. Hierarchical PEB can model random effects on connectivity parameters at the second (between-window) level given connectivity estimates from the first (within-window) level. In this work, we used a discrete cosine transform basis set or eigenvariates (i.e., expression of principal components) to model fluctuations in effective connectivity over windows. We evaluated the ensuing dynamic effective connectivity in terms of the consistency of baseline connectivity within default mode network (DMN), using the resting state fMRI from Human Connectome Project (HCP). To model group-level baseline and dynamic effective connectivity for DMN, we extended the PEB approach by conducting a multilevel PEB analysis of between-session and between-subject group effects. Model comparison clearly spoke to dynamic fluctuations in effective connectivity - and the dynamic functional connectivity these changes explain. Furthermore, baseline effective connectivity was consistent across independent sessions - and notably more consistent than estimates based upon conventional models. This work illustrates the advantage of hierarchical modelling with spDCM, in characterizing the dynamics of effective connectivity.
Aim of Investigation: Heritability is measured with twins studies, where the correlation of monozygotic (MZ, identical) and dizygotic (DZ, fraternal) twins indicates shared variation due to common environmental and/or genetic influences. The simplest estimate of narrow-sense (additive genetic) heritability is Falconer's estimate (Falconer, 1996). Another estimate comes from a components-of-variance approach, where a structured covariance model expresses the shared genetic and environmental effects (Neale, 1998). This approach has much greater flexibility and can be more powerful (Christian, 1995). While best practice in statistical genetics is to use the components-of-variance/SEM approach, Falconer's method is still widely used in imaging genetics studies. The purpose of this work is to demonstrate the poor performance of Falconer's method and demonstrate the limitations of even the best-practice approch at typical sample sizes.
