This event is free and open to everyone. It will be hosted on Google Meet: join us on slack to get the link (the #reading-group channel). Otherwise you can grab you ticket (link inside) with a voluntary donation (even just 1$ will do)!

Please consider that:

1. this is a community effort: the speakers & organizers of the event do not receive any compensation.
2. the full amount collected through donations will be used exclusively to face CAI costs for event hosting and community services.

--------- Event Description -----------

This Friday 5pm CEST, for the ContinualAI Reading Group, Min Lin will present the paper:

Title: "Continual Learning from the Perspective of Compression"

Abstract: Connectionist models such as neural networks suffer from catastrophic forgetting. In this work, we study this problem from the perspective of information theory and define forgetting as the increase of description lengths of previous data when they are compressed with a sequentially learned model. In addition, we show that continual learning approaches based on variational posterior approximation and generative replay can be considered as approximations to two prequential coding methods in compression, namely, the Bayesian mixture code and maximum likelihood (ML) plug-in code. We compare these approaches in terms of both compression and forgetting and empirically study the reasons that limit the performance of continual learning methods based on variational posterior approximation. To address these limitations, we propose a new continual learning method that combines ML plug-in and Bayesian mixture codes.

The event will be moderated by: Vincenzo Lomonaco.

--------- ContinualAI Reading Group -----------

The ContinualAI Reading Group is hosted every Friday in collaboration with MILA and it is based on roughly 60 minutes discussion about a particular Continual Learning paper. Occasionally, a speaker is invited to explain his work.

Join our reading group on slack! It will be the occasion to talk with other researchers of this amazing field!

--------------- About ContinualAI ---------------

ContinualAI is an official non-profit research organization and the largest open community on Continual Learning for AI. We aim at connecting people and working better together on this fascinating topic we consider fundamental for the future of AI.

• Official website: https://www.continualai.org

• Join us now at https://www.continualai.org/join_us

Please consider supporting us with a small donation at: https://www.continualai.org/supporters

It's thanks to people like you that we are making ContinualAI a reality!