University of California, Berkeley — Publications

Modeling Changes in Probabilistic Reinforcement Learning during Adolescence

Preprint

Abstract In the real world, many relationships between events are uncertain and probabilistic. Uncertainty is also likely to be a more common feature of daily experience for youth because they have less experience to draw from than adults. Some studies suggests probabilistic learning may be inefficient in youth compared to adults [1], while others suggest it may be more efficient in youth that are in mid adolescence [2, 3]. Here we used a probabilistic reinforcement learning task to test how youth age 8-17 (N = 187) and adults age 18-30 (N = 110) learn about stable probabilistic contingencies. Performance increased with age through early-twenties, then stabilized. Using hierarchical Bayesian methods to fit computational reinforcement learning models, we show that all participants’ performance was better explained by models in which negative outcomes had minimal to no impact on learning. The performance increase over age was driven by 1) an increase in learning rate (i.e. decrease in integration time horizon); 2) a decrease in noisy/exploratory choices. In mid-adolescence age 13-15, salivary testosterone and learning rate were positively related. We discuss our findings in the context of other studies and hypotheses about adolescent brain development. Author summary Adolescence is a time of great uncertainty. It is also a critical time for brain development, learning, and decision making in social and educational domains. There are currently contradictory findings about learning in adolescence. We sought to better isolate how learning from stable probabilistic contingencies changes during adolescence with a task that previously showed interesting results in adolescents. We collected a relatively large sample size (297 participants) across a wide age range (8-30), to trace the adolescent developmental trajectory of learning under stable but uncertain conditions. We found that age in our sample was positively associated with higher learning rates and lower choice exploration. Within narrow age bins, we found that higher saliva testosterone levels were associated with higher learning rates in participants age 13-15 years. These findings can help us better isolate the trajectory of maturation of core learning and decision making processes during adolescence.

Liyu Xia, Sarah L. Master, Maria K. Eckstein et al. 2020

Publications

CCDC 1578778: Experimental Crystal Structure Determination

Faculty Opinions recommendation of Decrease in winter respiration explains 25% of the annual northern forest carbon sink enhancement over the last 30 years.

Approaches for handling high-dimensional cluster expansions of ionic systems

Electrochemical corrosion behavior and passivation mechanism of tantalum in simulated human body fluid environment

Resistance-curve toughening in ductile/brittle layered structures: Behavior in Nb/Nb3Al laminates

CCDC 901603: Experimental Crystal Structure Determination

Polymer‐Induced Heteronucleation for the Discovery of New Extended Solids

Outlook: Is the Universe a Computer?

Studies of fischer-Tropsch synthesis over a fused iron catalyst

CCDC 2175410: Experimental Crystal Structure Determination

40Ar/39Ar and U-Pb evidence for late proterozoic (Grenville-age) continental crust in north-central Cuba and regional tectonic implications

Chaos from phase-locked loops

Impact of Rice Grown on Surface Energy Balance in the Sacramento-San Joaquin Delta and the Sacramento Valley

Towards sharing water better with near real-time maps on evaporative water use by crops and natural vegetation

Modeling Changes in Probabilistic Reinforcement Learning during Adolescence

Catalytic properties of Pt cluster-decorated CeO2 nanostructures

Supernova 1989B in NGC 3627

Approaches to catalyst discovery. New carbon–heteroatom and carbon–carbon bond formation

MEMRISTOR HAMILTONIAN CIRCUITS

On Determining Wood Thermal Diffusivity and Probe Spacing for Sap Flow Measurements using In-Situ Heat Response Curves