An official website of the United States government
Here's how you know
Official websites use .mil
A
.mil
website belongs to an official U.S. Department of Defense organization in the United States.
Secure .mil websites use HTTPS
A
lock (
lock
)
or
https://
means you’ve safely connected to the .mil website. Share sensitive information only on official, secure websites.
Skip to main content (Press Enter).
Toggle navigation
75th U.S. Army Reserve Innovation Command
Make Ready!
75th U.S. Army Reserve Innovation Command
Search
Search 75th U.S. Army Reserve Innovation Command:
Search
Search 75th U.S. Army Reserve Innovation Command:
Search
Home
About
Leadership
Mission & Vision
Where We Innovate
News
MAJ Rubins Award
Talent Management
Civilian Partnerships
Innovation Support Request
Contact Us
Home
Test Page
Playlist:
Search Results
Video by Kevin D Schmidt
Player Embed Code:
Download
Embed
Share
Nikolaus Kriegeskorte - Comparing models by their predictions of representational geometries and topologies
Air Force Research Laboratory
May 10, 2024 | 01:23:26
Description: In this edition of QuEST, we will have an extended session with Niko Kriegeskorte on geometric analyses of brain representations
Abstract:
Understanding the brain-computational mechanisms underlying cognitive functions requires that we implement our theories in task-performing models and adjudicate among these models on the basis of their predictions of brain representations and behavioral responses. Previous studies have characterized brain representations by their representational geometry, which is defined by the representational dissimilarity matrix (RDM), a summary statistic that abstracts from the roles of individual neurons (or responses channels) and characterizes the discriminability of stimuli. The talk will cover (1) recent methodological advances implemented in Python in the open-source RSA3 toolbox that support unbiased estimation of representational distances and model-comparative statistical inference that generalizes simultaneously to the populations of subjects and stimuli from which the experimental subjects and stimuli have been sampled, and (2) topological representational similarity analysis (tRSA), an extension of representational similarity analysis (RSA) that uses a family of geo-topological summary statistics that generalizes the RDM to characterize the topology while de-emphasizing the geometry. Results show that topology-sensitive characterizations of population codes are robust to noise and interindividual variability and maintain excellent sensitivity to the unique representational signatures of different neural network layers and brain regions.
Key Moments and Questions in the video include:
Focus on methods development
RSA3 Toolbox: github.com/rsagroup/rsatoolbox
Representational Similarity Analysis version 3
Representational Similarity Analysis
Studying vision
Activity patterns as representations of the stimuli
Neural network model
Representational geometry, representational dissimilarity matrix
Euclidean distance
Representational dissimilarity matrix (RDM)
RDM estimator
Distance from noisy data are positively biased
Two true response patterns
Noisy response patterns
Removing Bias
Square Mahalanobis distance
Crossnobis distance estimator
RDM Comparator
Accounting for dependency among dissimilarity estimates by whitening
Dissimilarity estimation error covariance
Whitened Pearson RDM correlation
Whitened cosine RDM similarity
Topological RSA
Representational geodesics matrix (RGDM)
Turning an RDM into a weighted graph
Distance matrix
Geo-topological matrices
Adjacency matrix
Family of geo-topological distance transforms
Identifying subject’s brain regions
Identifying which layer of a neural network generated the data
RDM estimator
Biased distance estimators
Euclidean distance
Pearson correlation distance
Mahalanobis distance
Poisson-KL estimator
Unbiased:
Crossnobis estimator
Linear-discriminant t
Crossvalidated Poisson-KL estimator
Choosing a combination of RDM estimator and RDM comparator
Flexible RDM models
Data RDM
Selection model
Weighted component model
Manifold model
Fitting and testing in cross validation
Model evaluation
RSA3: new capabilities
More
Tags
quest
AFRL
Air Force Research Laboratory
Artificial Intelligence
consciousness
ACT3
More
Up Next
01:01:58
Kabrisky Memorial Lecture 2025
01:00:53
Michael Robinson - Topological Features in Large Language Models (and beyond?)
01:16:50
QuEST (2024-06-07) Benjamin Kuipers - Drinking From the Firehose of Experience
01:00:41
QuEST (2024-05-24 Joseph Houpt - Mathematical Psychology
Now Playing
Nikolaus Kriegeskorte - Comparing models by their predictions of representational geometries and topologies
01:10:36
Lila Davachi - Temporal Integration and Separation of Sequential Events in Memory
01:18:31
Dr. Yubei Chen
01:00:12
Anna Schapiro - Learning representations of specifics and generalities over time
59:49
Chris Baldassano - Studying memory in the brain with the Method of Loci
59:55
Memory Palace
01:00:41
QuEST Discussion - Memory Athletics Speed Card Methods
57:32
Tony & Michael Dottino - USA Memory Athletics Championships
01:00:07
QuEST - Creation of Flexible Memory
58:27
QuEST - Learning and Memory Conversation
01:16:00
Dr. Robert Stickgold - Sleep, Memory, and Dreams: A Unified View
More Videos