Analytical Connectionism

School on Analytical Connectionism — 2024 —

Flatiron Institute · New York City │ 26 Aug – 5 Sep 2024
Flatiron Institute
Fig. 1.Flatiron Institute, host venue, 26 Aug – 5 Sep 2024.
Dates
26 Aug – 5 Sep2024
Speakers
11 lecturers
Location
Flatiron Institute
1

Overview

Analytical Connectionism is a 2-week summer course on analytical tools, including methods from statistical physics and probability theory, for probing neural network models of higher-level cognition. The course brings together neuroscience, psychology and machine-learning communities, and introduces attendees to analytical methods for neural network analysis and connectionist theories of higher-level cognition and psychology.

Connectionism, a theoretical approach in cognitive science, uses neural network models to simulate a wide range of phenomena, including perception, memory, decision-making, language, and cognitive control. However, most connectionist models remain, to a certain extent, black boxes, and we lack a mathematical understanding of their behaviours. Recent progress in machine learning theory has provided novel analytical tools that have advanced our mathematical understanding of deep neural networks, and have the potential to help make these “black boxes” more transparent.

This course will introduce:

  • mathematical methods for neural network analysis, providing a solid overview of the analytical tools available to understand neural network models;
  • key connectionist models with links to experimental observations, which provide targets for analytical results.

During the course, you will:

  • attend lectures given by leading researchers on theoretical methods and applications, key connectionist models, and experimental observations;
  • participate in tutorials, Q&A sessions, and panel discussions;
  • take part in networking activities such as poster sessions;
  • work in groups on a novel research project, mentored by the course organisers and lecturers.

The 2024 edition of the Analytical Connectionism summer school will focus on using analytical models to study connectionism and its application to cognition. Topics will include developmental psychology, particularly how cognitive functions evolve, and memory, both from neurobiological and cognitive neuroscience perspectives. The course will also explore large language models (LLMs) and their relation to language processing, alongside discussions in computational neuroscience on sensory processing and decision-making. Together, these areas will provide a thorough understanding of cognition through analytical and computational approaches.

2

Dates

All deadlines anywhere on earth (AoE)
MilestoneDate
Applications open 1 Apr 2024
Application deadline 17 May 2024
Outcome communicated 3 Jun 2024
Deadline to accept admission 17 Jun 2024
School begins26 Aug 2024
3

Schedule

Lecture Presentations Social Idle All timesNew York City · EST
Week 1
26–30 Aug 2024
Time Mon Tue Wed Thu Fri
08:45 Welcome
09:00–10:30 Lecture Linda Smith Lecture Jonathan Cohen Lecture Cengiz Pehlevan Lecture Linda Smith Lecture Jonathan Cohen
10:30–11:00 break
11:00–12:30 Lecture Linda Smith Lecture Jonathan Cohen Lecture Cengiz Pehlevan Tutorial Declan Campbell Lecture Cengiz Pehlevan
12:30–14:00 lunch
14:00–15:30 Lecture Cengiz Pehlevan Lecture Linda Smith Lecture Jonathan Cohen Tutorial Blake Bordelon Organiser presentations
15:30–16:00 break
16:00–17:30 Lecture Jonathan Cohen Lecture Cengiz Pehlevan Lecture Linda Smith Poster session Organiser presentations
17:30 Get together
Week 2
2–6 Sep 2024
Time Mon Tue Wed Thu Fri
09:00–10:30 Lecture André Fenton Lecture Eero Simoncelli Lecture Adele Goldberg Hackathon Hackathon
10:30–11:00 break
11:00–12:30 Lecture André Fenton Lecture Eero Simoncelli Lecture Mitya Chklovskii Hackathon Hackathon
12:30–14:00 lunch
14:00–15:30 Lecture Kyunghyun Cho Lecture Tatiana Engel Project organisation Hackathon Project presentations
15:30–16:00 break
16:00–17:30 Lecture Kyunghyun Cho Lecture Tatiana Engel Project organisation Hackathon
18:00– Social dinner
4

Lecturers

5

Participants

List 33 participants
Name
Anushri Arora
Veronica Chelu
Catherine Chen
Nathan Cloos
Dota Dong
Alessandro Favero
Zachary Friedenberger
Dongyu Gong
Katya Ivshina
Ali Karami
Ganesh Kumar
Po-Chen Kuo
Alisa Leshchenko
Ji-An Li
Jing Li
Adam Manoogian
Conor McGrory
Claudia Merger
Abdel Mfougouon Njupoun
Asit Pal
Shawn Rhoads
Akif Erdem Sagtekin
Mildred Salgado-Menez
Valentin Schmutz
Lindsay Smith
Ilia Sucholutsky
Imran Thobani
Tobias Thomas
Bin Wang
Mia Whitefield
Huadong Xiong
Shujun Xiong
Zihan Zhang
Posters 27 posters
A New Look at Low Rank Recurrent Neural Networks Anushri Arora
Dual receptor model of serotonergic psychedelics Veronica Chelu
Representations of Semantic Relations in the Human Brain Catherine Chen
Differentiable Optimization of Similarity Scores Between Models and Brains Nathan Cloos
Multimodal Video Transformers Partially Align with Multimodal Grounding and Compositionality in the Brain Dota Dong
Hierarchies and Compositionality in Diffusion Models Alessandro Favero
Dendritic excitability controls overdispersion Zachary Friedenberger
Fundamental Limits in the Working Memory Capacity of Large Language Models Dongyu Gong
Investigation of Numerosity Representation in Convolution Neural Networks Ali Karami
Place Field Reirganization as State Representation Learning to Improve Policy Convergence Ganesh Kumar
Uncovering the Computation of Dynamic Foraging with Actor-Critic Recurrent Neural Networks Po-Chen Kuo
Specialization in a minimal task-trained network Alisa Leshchenko
Deep Learning without Weight Symmetry Ji-An Li
Dynamic self-efficacy as a computational mechanism of mania emergence Jing Li
Contextual Inference Underlies Decision Making in Schizophrenia: An Active Inference Model Adam Manoogian
Learning Interacting Theories from Data Claudia Merger
Multistage Recurrent Circuit Model IMplementing Normalization Asit Pal
Distinct effects of depression and social anxiety on social craving computations Shawn Rhoads
Emergent excitatory/inhibitory balance in neural networks during task training Akif Erdem Sagtekin
Characterization of neural correlates of Macaca mulatta hippocampus in a visual metronome task Mildred Salgado-Menez
High-dimensional neuronal activity from low-dimensional population dynamics:an exactly solvable model Valentin Schmutz
Learning Continous Chaotic Attractors with a reservoir Computer Lindsay Smith
Modeling Dataset bias in machine-learned theories of economic decision-making Tobias Thomas
Desegregation of Neuronal Predictive Processing Bin Wang
The Generalisability and Flexibility of Representations Across Learning in Humans and Neural Networks Mia Whitefield
Counting Intersections on Smooth Manifolds Bounds External Memory in Deterministic Network Activity Shujun Xiong
Axonal Dendritic Overlap Recurrent Neural Network Zihan Zhang
6

Organisers

7

Practicalities

Target audience

This course is appropriate for graduate students, postdoctoral fellows and early-career faculty in a number of fields, including psychology, neuroscience, physics, computer science, and mathematics. Attendees are expected to have a strong background in one of these disciplines and to have made some effort to introduce themselves to a complementary discipline.

The course is limited to just under 40 attendees, who will be chosen to balance the representation of different fields. In circumstances where all other things are equal, priority will be given to applicants from populations underrepresented in the scientific workforce as defined by NIH, including but not limited to racially underrepresented individuals, women, individuals with disabilities, and individuals from disadvantaged backgrounds.

Course fees

There are no course fees, but attendees are expected to cover their own travel, visa expenses, and any meals not offered by the summer school. (Morning and afternoon coffee breaks and lunch will be provided Monday to Friday.) Accommodation in NYC for students not living in NYC and the surrounding areas will be provided by the school.

Travel grants inclusive of the above named personal expenses will be offered to individuals whose participation furthers the goal to promote diversity in systems and computational neuroscience, in particular among populations underrepresented in the scientific workforce as defined by NIH.