Publications

Meta-Representational Predictive Coding: Biomimetic Self-Supervised Learning

Self-supervised learning has become an increasingly important paradigm in the domain of machine intelligence. Furthermore, evidence for self-supervised adaptation, such as contrastive formulations, has emerged in recent computational neuroscience and brain-inspired research. Nevertheless, current work on self-supervised learning relies on biologically implausible credit assignment -- in the form of backpropagation of errors -- and feedforward inference, typically a forward-locked pass. Predictive coding, in its mechanistic form, offers a biologically plausible means to sidestep these backprop-specific limitations. However, unsupervised predictive coding rests on learning a generative model of raw pixel input (akin to ``generative AI'' approaches), which entails predicting a potentially high dimensional input; on the other hand, supervised predictive coding, which learns a mapping between inputs to target labels, requires human annotation, and thus incurs the drawbacks of supervised learning. In this work, we present a scheme for self-supervised learning within a neurobiologically plausible framework that appeals to the free energy principle, constructing a new form of predictive coding that we call meta-representational predictive coding (MPC). MPC sidesteps the need for learning a generative model of sensory input (e.g., pixel-level features) by learning to predict representations of sensory input across parallel streams, resulting in an encoder-only learning and inference scheme. This formulation rests on active inference (in the form of sensory glimpsing) to drive the learning of representations, i.e., the representational dynamics are driven by sequences of decisions made by the model to sample informative portions of its sensorium.

The Active Inference Approach to Ecological Perception: General Information Dynamics for Natural and Artificial Embodied Cognition

The emerging neurocomputational vision of humans as embodied, ecologically embedded, social agents – who shape and are shaped by their environment – offers a golden opportunity to revisit and revise ideas about the physical and information-theoretic underpinnings of life, mind, and consciousness itself. In particular, the active inference framework (AIF) makes it possible to bridge connections from computational neuroscience and robotics/AI to ecological psychology and phenomenology, revealing common underpinnings and overcoming key limitations. AIF opposes the mechanistic to the reductive, while staying fully grounded in a naturalistic and information theoretic foundation, using the principle of free energy minimization. The latter provides a theoretical basis for a unified treatment of particles, organisms, and interactive machines, spanning from the inorganic to organic, non-life to life, and natural to artificial agents. We provide a brief introduction to AIF, then explore its implications for evolutionary theory, ecological psychology, embodied phenomenology, and robotics/AI research. We conclude the paper by considering implications for machine consciousness.

Agentic rulebooks using active inference: an artificial intelligence application for environmental sustainability

Artificial intelligence (AI) is increasingly proposed as a solution to environmental sustainability challenges, with applications aimed at optimizing resource utilization and energy consumption. However, AI technologies also have significant negative environmental impacts. This duality underscores the need to critically evaluate AI's role in sustainable practices. One example of AI's application in sustainability is the Occupant Controlled Smart Thermostat (OCST). These systems optimize indoor temperature management by responding to dynamic signals, such as energy price fluctuations, which reflect power grid stress. Accordingly, regulatory frameworks have mandated performance standards for such technologies to ensure effective demand responsiveness. While OCSTs are effective in managing energy demand through predefined norms like price signals, their current designs often fail to accommodate the complex interplay of conflicting priorities, such as user comfort and grid optimization, particularly in uncertain climatic conditions. For instance, extreme weather events can amplify energy demands and user needs, necessitating a more context sensitive approach. This adaptability requires OCSTs to dynamically shift between multiple normative constraints (i.e., norms), such as prioritizing userdefined temperature settings over price-based energy restrictions when contextually appropriate. In this paper, we propose an innovative approach that combines the theory of active inference from theoretical neuroscience and robotics with a rulebook formalism to enhance the decision-making capabilities of autonomous AI agents. Using simulation studies, we demonstrate how these AI agents can resolve conflicts among norms under environmental uncertainty. A minimal use case is presented, where an OCST must decide whether to warm a room based on two conflicting rules: a “price” rule that restricts energy use above a cost threshold and a “need” rule that prioritizes maintaining the user's desired temperature. Our findings illustrate the potential for advanced AI-driven OCST systems to navigate conflicting norms, enabling more resilient and user-centered solutions to sustainable energy challenges.

Analysing brain images: principles and overview

Therapeutic Alliance as Active Inference: The Role of Therapeutic Touch and Synchrony

Recognizing and aligning individuals' unique adaptive beliefs or "priors" through cooperative communication is critical to establishing a therapeutic relationship and alliance. Using active inference, we present an empirical integrative account of the biobehavioral mechanisms that underwrite therapeutic relationships. A significant mode of establishing cooperative alliances-and potential synchrony relationships-is through ostensive cues generated by repetitive coupling during dynamic touch. Established models speak to the unique role of affectionate touch in developing communication, interpersonal interactions, and a wide variety of therapeutic benefits for patients of all ages; both neurophysiologically and behaviorally. The purpose of this article is to argue for the importance of therapeutic touch in establishing a therapeutic alliance and, ultimately, synchrony between practitioner and patient. We briefly overview the importance and role of therapeutic alliance in prosocial and clinical interactions. We then discuss how cooperative communication and mental state alignment-in intentional communication-are accomplished using active inference. We argue that alignment through active inference facilitates synchrony and communication. The ensuing account is extended to include the role of (C-) tactile afferents in realizing the beneficial effect of therapeutic synchrony. We conclude by proposing a method for synchronizing the effects of touch using the concept of active inference.

Erratum to ‘Dynamic effective connectivity’ [Neuroimage, 207 (2020) 116453]

Knowing when to stop: Aberrant precision and evidence accumulation in schizophrenia

Predictive coding and active inference formulations of the dysconnection hypothesis suggest that subjects with schizophrenia (SZ) hold unduly precise prior beliefs to compensate for a failure of sensory attenuation. This implies that SZ subjects should both initiate responses prematurely during evidence-accumulation tasks and fail to inhibit their responses at long stop-signal delays. SZ and healthy control subjects were asked to report the timing of billiards-ball collisions and were occasionally required to withhold their responses. SZ subjects showed larger temporal estimation errors, which were associated with premature responses and decreased response inhibition. To account for these effects, we used hierarchical (Bayesian) drift-diffusion models (HDDM) and model selection procedures to adjudicate among four hypotheses. HDDM revealed that the precision of prior beliefs (i.e., starting point) rather than increased sensory precision (i.e., drift rate) drove premature responses and impaired response inhibition in patients with SZ. From the perspective of active inference, we suggest that premature predictions in SZ are responses that, heuristically, are traded off against accuracy to ensure action execution. On the basis of previous work, we suggest that the right insular cortex might mediate this trade-off.

Integrating variational approaches to pattern formation into a deeper physics

Motor practice and neurophysiological adaptation in the cerebellum: a positron tomography study

We have used positron tomography (PET) to demonstrate that some parts of the motor system exhibit physiological adaptation during the repeated performance of a simple motor task, but others do not. In contrast to the primary sensori-motor cortex, the cerebellum exhibits a decrease in physiological activation (increases in regional blood flow during performance) with practice. A new application of factorial experimental design to PET activation studies was used to make these measurements in four normal males. This design allowed adaptation to be examined by testing for an interaction between regional cerebral blood flow (rCBF) increases brought about by a motor task and the number of trials (time). These findings are interpreted as the neurophysiological correlates of synaptic changes in the cerebellum associated with motor learning in man.

Erratum: Signal-, set- and movement-related activity in the human brain: An event-related fMRI study (Cerebral Cortex (January/February 1999) 9:1 (35- 49

Dynamic causal modelling of fluctuating connectivity in resting-state EEG

Functional and effective connectivity are known to change systematically over time. These changes might be explained by several factors, including intrinsic fluctuations in activity-dependent neuronal coupling and contextual factors, like experimental condition and time. Furthermore, contextual effects may be subject-specific or conserved over subjects. To characterize fluctuations in effective connectivity, we used dynamic causal modelling (DCM) of cross spectral responses over 1- min of electroencephalogram (EEG) recordings during rest, divided into 1-sec windows. We focused on two intrinsic networks: the default mode and the saliency network. DCM was applied to estimate connectivity in each time-window for both networks. Fluctuations in DCM connectivity parameters were assessed using hierarchical parametric empirical Bayes (PEB). Within-subject, between-window effects were modelled with a second-level linear model with temporal basis functions as regressors. This procedure was conducted for every subject separately. Bayesian model reduction was then used to assess which (combination of) temporal basis functions best explain dynamic connectivity over windows. A third (between-subject) level model was used to infer which dynamic connectivity parameters are conserved over subjects. Our results indicate that connectivity fluctuations in the default mode network and to a lesser extent the saliency network comprised both subject-specific components and a common component. For both networks, connections to higher order regions appear to monotonically increase during the 1- min period. These results not only establish the predictive validity of dynamic connectivity estimates – in virtue of detecting systematic changes over subjects – they also suggest a network-specific dissociation in the relative contribution of fluctuations in connectivity that depend upon experimental context. We envisage these procedures could be useful for characterizing brain state transitions that may be explained by their cognitive or neuropathological underpinnings.

Effective connectivity: Influence, causality and biophysical modeling

This is the final paper in a Comments and Controversies series dedicated to "The identification of interacting networks in the brain using fMRI: Model selection, causality and deconvolution". We argue that discovering effective connectivity depends critically on state-space models with biophysically informed observation and state equations. These models have to be endowed with priors on unknown parameters and afford checks for model Identifiability. We consider the similarities and differences among Dynamic Causal Modeling, Granger Causal Modeling and other approaches. We establish links between past and current statistical causal modeling, in terms of Bayesian dependency graphs and Wiener–Akaike–Granger–Schweder influence measures. We show that some of the challenges faced in this field have promising solutions and speculate on future developments.

Controlled Optimism: Reply to Sun and Firestone on the Dark Room Problem

Bayesian fusion and multimodal DCM for EEG and fMRI

This paper asks whether integrating multimodal EEG and fMRI data offers a better characterisation of functional brain architectures than either modality alone. This evaluation rests upon a dynamic causal model that generates both EEG and fMRI data from the same neuronal dynamics. We introduce the use of Bayesian fusion to provide informative (empirical) neuronal priors - derived from dynamic causal modelling (DCM) of EEG data - for subsequent DCM of fMRI data. To illustrate this procedure, we generated synthetic EEG and fMRI timeseries for a mismatch negativity (or auditory oddball) paradigm, using biologically plausible model parameters (i.e., posterior expectations from a DCM of empirical, open access, EEG data). Using model inversion, we found that Bayesian fusion provided a substantial improvement in marginal likelihood or model evidence, indicating a more efficient estimation of model parameters, in relation to inverting fMRI data alone. We quantified the benefits of multimodal fusion with the information gain pertaining to neuronal and haemodynamic parameters - as measured by the Kullback-Leibler divergence between their prior and posterior densities. Remarkably, this analysis suggested that EEG data can improve estimates of haemodynamic parameters; thereby furnishing proof-of-principle that Bayesian fusion of EEG and fMRI is necessary to resolve conditional dependencies between neuronal and haemodynamic estimators. These results suggest that Bayesian fusion may offer a useful approach that exploits the complementary temporal (EEG) and spatial (fMRI) precision of different data modalities. We envisage the procedure could be applied to any multimodal dataset that can be explained by a DCM with a common neuronal parameterisation.

Neural masses and fields in dynamic causal modeling

REVIEW article Front. Comput. Neurosci., 28 May 2013 https://doi.org/10.3389/fncom.2013.00057

Brain Computations in Schizophrenia

ID 202 – Characterising seizures in anti-NMDA-receptor encephalitis with Dynamic Causal Modelling

How and why consciousness arises: Some considerations from physics and physiology

We offer a scientific approach to the philosophical ‘hard problem’ of consciousness, as formulated by David Chalmers in this journal. Our treatment is based upon two recent insights concerning (1) the endogenous nature of consciousness and (2) the minimal thermodynamic conditions for being alive. We suggest that a combination of these insights specifies sufficient conditions for attributing feeling to being.