iiinova — where your digital self keeps evolving

In simulation 2, the model had to learn 12 classification tasks that varied along a ring manifold. Models with EM learned the ring. Again, models without EM suffered from excessive representation drift, which hindered learning.

… this is because encoding and retrieving TRs in EM can reduce representation drift, which facilitates learning. Without EM, “good representation” for the ongoing task is often non-unique, leading to unnecessary TR drift – change in TRs after performance converges.

In simulation 1, the model had to learn 8 sequence prediction tasks that varied along 3 independent feature dimensions. Models with EM learned to represent the 3 dims in abstract format (Bernardi 2020)...

We developed an NN model augmented with a task representation (TR) layer and an episodic memory (EM) buffer. It uses EM to retrieve and encode TRs, so when it searches for a TR online (Giallanza 2023; Hummos 2022), it can retrieve previously used TRs from EM. 1/n

The latent causes inferred by LCNet captured the ground truth event structure, and the inferred event boundaries were correlated with human judgments, as was previously found using SEM2.0, a variant of SEM modified to account for this dataset (Bezdek et al., 2022b). (12/N)

000 0

Finally, we used LCNet to process naturalistic video data of daily events (Bezdek et al., 2022a). LCNet was trained to predict “what would happen next” (i.e., the next frame of the video). (11/N)

010 0

In Simulation 2, LCNet was able to account for data showing that humans were better at learning event schemas in a blocked training curriculum compared to an interleaved curriculum (Beukers et al., 2023), a pattern that standard neural network models can't explain. (8/N)

010 0

In simulation 1, we found that LCNet was able to extract and reuse the shared structure across contexts (e.g., learning a new related task was faster) and overcome catastrophic interference. (7/N)

000 0

To address this limitation, we proposed the Latent Cause Network (LCNet), which uses a single neural network shared across all latent causes... (5/N)

000 0