iiinova — where your digital self keeps evolving

Marlos C. Machado @marloscmachado.bsky.social · 28/08/2026

"It was part of the essential deceit of the Ring to fill minds with imaginations of supreme power." - Tolkien, Letter 246

021

Marlos C. Machado @marloscmachado.bsky.social · 11/08/2026

Every year, we have the RLAI Tea Time Talks at the @ualberta.bsky.social. Last year, I talked about how some of our work can be seen from a physics perspective. I gave the same talk at the RLC'25 IBRL Workshop. I uploaded the recording to make it broadly accessible. www.youtube.com/watch?v=_a5q...

youtube.com

Heat Diffusion as an Inductive Bias for Discovering Temporal Abstractions in RL

YouTube video by Marlos C. Machado

093

Marlos C. Machado @marloscmachado.bsky.social · 06/07/2026

Here's another paper we'll be presenting at ICML'26 - @icmlconf.bsky.social. Laplacian Representations for Decision-Time Planning openreview.net/forum?id=6Jw... This work was led by Dikshant Shehmar, and he'll be presenting on 8th July at 2 pm, Korea time. This video summarizes the idea well ↓

0102

Marlos C. Machado @marloscmachado.bsky.social · 21/05/2026

I'm honoured to have been renewed as one of the Canada CIFAR AI Chairs. It continues to be an honour to be part of such an amazing group. The ecosystem created by CIFAR, @amiithinks.bsky.social, and @ualberta.bsky.social continues to be a major factor for our success. cifar.ca/cifarnews/20...

cifar.ca

Government of Canada and CIFAR announce $24M investment in top AI Talent - CIFAR

CIFAR

050

Marlos C. Machado @marloscmachado.bsky.social · 06/05/2026

Our paper, “The Cell Must Go On! AgarCL as an Evaluation Platform for Continual RL“, has been accepted at @rl-conference.bsky.social'26! This work was led by Mohamed Ayman as a master's student at Univ. of Alberta and Amii. Preprint: arxiv.org/abs/2505.18347 Blog post: medium.com/@marlos.chol...

medium.com

The Cell Must Go On! AgarCL as an Evaluation Platform for Continual RL

Continual learning is becoming more popular, with people from diverse research ideologies promoting it. Naturally, as with everything else…

092

Reposted by Marlos C. Machado

RL and Video Games Workshop @rlvgworkshop.bsky.social · 20/04/2026

Wake up Samurai, RLVG IS BACK! 😎 We are happy to announce the awesome speakers of the second edition of the RLVG workshop: @alexkearney.com, @marloscmachado.bsky.social, Martin Singh-Bloom, Sam Devlin, Pete Wurman and @neuroai.bsky.social! Join us August 15th at @rl-conference.bsky.social!

1196

Marlos C. Machado @marloscmachado.bsky.social · 25/03/2026

A couple of months ago, we released a preprint of one of my favourite papers I’ve ever written. It lies at the intersection of representation learning and neuroscience. I have now written a blog post about it. Preprint: biorxiv.org/content/10.1... Blog post: medium.com/@marlos.chol...

medium.com

From Pixels to Place Cells: Where Representation Learning Meets Neuroscience

I have been itching to talk about a paper we put out on bioRxiv last year, and I finally found the time to write about it. This is a…

140

Marlos C. Machado @marloscmachado.bsky.social · 10/12/2025

"Canada Impact+ Research Chairs program—a new $1 billion investment that will provide Canadian institutions the opportunity to recruit top-tier international researchers with expertise in key areas ..." www.canada.ca/en/innovatio...

canada.ca

Government of Canada launches new initiative to recruit world-leading researchers - Canada.ca

Canada will invest $1.7 billion to attract top global talent

020

Reposted by Marlos C. Machado

Erin Grant @eringrant.me · 06/12/2025

Thrilled to start 2026 as faculty in Psych & CS @ualberta.bsky.social + Amii.ca Fellow! 🥳 Recruiting students to develop theories of cognition in natural & artificial systems 🤖💭🧠. Find me at #NeurIPS2025 workshops (speaking coginterp.github.io/neurips2025 & organising @dataonbrainmind.bsky.social)

410928

Marlos C. Machado @marloscmachado.bsky.social · 27/11/2025

The Computing Science Dept. at the University of Alberta has multiple faculty job openings. Please share this broadly. We have a great environment! - CS Theory: tinyurl.com/zrh9mk69 - Network/Cyber Security: tinyurl.com/renxazzy - Robotics/CV/Graphics: tinyurl.com/ypcsfbff

092

Marlos C. Machado @marloscmachado.bsky.social · 20/11/2025

The Department of Computing Science at the University of Alberta at the University of Alberta has an opening for another tenure-track faculty in robotics. Please, spread the word. I can attest to how awesome our department and @amiithinks.bsky.social are! (Official job posting coming soon.)

030

Marlos C. Machado @marloscmachado.bsky.social · 18/09/2025

This paper has now been accepted @neuripsconf.bsky.social ! Huge congratulations, Hon Tik (Rick) Tse and Siddarth Chandrasekar.

073

Marlos C. Machado @marloscmachado.bsky.social · 27/08/2025

1/2: But there are none so frightened, or so strange in their fear, as conquerors. They conjure phantoms endlessly, terrified that their victims will someday do back what was done to them—even if, in truth, their victims couldn’t care less about such pettiness and have moved on.”

121

Reposted by Marlos C. Machado

Reinforcement Learning Conference @rl-conference.bsky.social · 07/08/2025

Excited to announce the RLC best paper awards! Like last year, we wanted to highlight the many excellent ways you can do research. rl-conference.cc/RLC2025Award...

rl-conference.cc

RLC 2025 - Outstanding Paper Awards

0106

Marlos C. Machado @marloscmachado.bsky.social · 04/08/2025

Here's what our group will be presenting at RLC'25. * Invited Talks at Workshops:* Tue 10:00: The Causal RL Workshop sites.google.com/uci.edu/crlw... Tue 14:30: Inductive Biases in RL (IBRL) Workshop sites.google.com/view/ibrl-wo... Tue 15:00: Panel Discussion at IBRL Workshop

100

Marlos C. Machado @marloscmachado.bsky.social · 04/08/2025

RLC starts tomorrow here in Edmonton. I couldn't be more excited! It has a fantastic roll of speakers, great papers, and workshops. And this time, it is in Edmonton 😁 @rl-conference.bsky.social is my favourite conference, and no, it is not because I am one of its organizers this year.

0123

Marlos C. Machado @marloscmachado.bsky.social · 27/06/2025

This was a great long-term effort from @martinklissarov.bsky.social, Akhil Bagaria, and @ray-luo.bsky.social, and it led to a great overview of the ideas behind leveraging temporal abstractions in AI. If anything, I think this is very useful resource for anyone interested in this field!

071

Reposted by Marlos C. Machado

Reinforcement Learning Conference @rl-conference.bsky.social · 30/05/2025

To align better with workshop acceptance dates, 𝐑𝐋𝐂 𝐢𝐬 𝐞𝐱𝐭𝐞𝐧𝐝𝐢𝐧𝐠 𝐢𝐭𝐬 𝐞𝐚𝐫𝐥𝐲 𝐫𝐞𝐠𝐢𝐬𝐭𝐫𝐚𝐭𝐢𝐨𝐧 𝐝𝐞𝐚𝐝𝐥𝐢𝐧𝐞 𝐭𝐨 𝐉𝐮𝐧𝐞 𝟐𝟑𝐫𝐝!

083

Marlos C. Machado @marloscmachado.bsky.social · 27/05/2025

📢 I'm very excited to release AgarCL, a new evaluation platform for research in continual reinforcement learning‼️ Repo: github.com/machado-rese... Website: agarcl.github.io Preprint: arxiv.org/abs/2505.18347 Details below 👇

1298

Marlos C. Machado @marloscmachado.bsky.social · 24/05/2025

📢 I'm happy to share the preprint: _Reward-Aware Proto-Representations in Reinforcement Learning_ ‼️ My PhD student, Hon Tik Tse, led this work, and my MSc student, Siddarth Chandrasekar, assisted us. arxiv.org/abs/2505.16217 Basically, it's the SR with rewards. See below 👇

24010

Marlos C. Machado @marloscmachado.bsky.social · 14/04/2025

The list of accepted workshops at RLC is now available! I thoroughly enjoyed the RLC workshops last year, and this year, they seem to be as good as expected! That's very different from what I have been seeing in other conferences, just saying ... rl-conference.cc/accepted_wor...

rl-conference.cc

Accepted Workshops

010

Marlos C. Machado @marloscmachado.bsky.social · 31/03/2025

Last year, RLC reminded me why I used to like going to conferences. I hadn't had that much fun in a long time. We are working hard to do the same thing this year. Like last year, we have a fantastic speaker lineup, including a Turing Award Winner 😉 rl-conference.cc

rl-conference.cc

RLC 2025

022

Reposted by Marlos C. Machado

Reinforcement Learning Conference @rl-conference.bsky.social · 28/02/2025

Reminder: The appendix comes before the references, is peer-reviewed, and counts towards the page limit. It can help your paper flow better while still being part of the paper. Anything you don’t want to count towards the page limit should go in the supplementary material!

052

Marlos C. Machado @marloscmachado.bsky.social · 28/02/2025

I'm heading to AAAI'25 and I'll be giving two talks there ✈️ ‼️ 1. Sunday 11:15 for the New Faculty Highlights program aaai.org/conference/a... 2. Tuesday 09:00 for the Bridging the Gap Between AI Planning and RL Workshop prl-theworkshop.github.io/prl2025-aaai/ Let me know if you want to meet!

aaai.org

AAAI-25 New Faculty Highlights Program - AAAI

New Faculty Highlights Room 121B This year, AAAI is continuing its invited speaker program, highlighting AI researchers who have just begun careers as new faculty members or the equivalent in industry...

030

Reposted by Marlos C. Machado

Tom Schaul @schaul.bsky.social · 24/02/2025

Some extra motivation for those of you in RLC deadline mode: our line-up of keynote speakers -- as all accepted papers get a talk, they may attend yours! @rl-conference.bsky.social

RLC Keynote speakers: Leslie Kaelbling, Peter Dayan, Rich Sutton, Dale Schuurmans, Joelle Pineau, Michael Littman

03710

Marlos C. Machado @marloscmachado.bsky.social · 22/02/2025

This 👇 And within reason, abstracts, author order/list and titles can be changed after the abstract deadline.

010

Marlos C. Machado @marloscmachado.bsky.social · 09/02/2025

I'm teaching a deep RL course where I'm going over the key ideas behind deep RL (double learning, multi-step, prioritization, etc) and specific methods (DQN, PPO, SAC). A lot of this happened before 2018. What are the key deep RL papers of general interest published recently?

5223

Reposted by Marlos C. Machado

Reinforcement Learning Conference @rl-conference.bsky.social · 08/02/2025

🚨🚨 RLC deadline has been extended by a week! Abstract deadline is Feb. 21 with a paper deadline of Feb. 28 🚨🚨. Please spread the word!

12412

Marlos C. Machado @marloscmachado.bsky.social · 07/02/2025

Martin led this great work, check it out. For a dinosaur like me, let me say that, in more classical RL terms, this is a demonstration of how we can effectively combine options and LLMs through programmatic policies.

091

Reposted by Marlos C. Machado

Marlos C. Machado @marloscmachado.bsky.social · 01/02/2025

I forgot to post: if you feel you have been invited to the wrong role, we have a form you can fill to request us to look at it again: docs.google.com/forms/d/e/1F... We need to fill in all the roles, and the higher the role, the fewer people we need, so if you are not upgraded, don't hate us 😅

docs.google.com

RLC/RLJ Reviewer Role Change Request

Thank you for your interest in participating in the RLC/RLJ review process! In some cases people have been invited to more junior reviewing roles than would be appropriate. If this has happened to you...

001

Marlos C. Machado @marloscmachado.bsky.social · 31/01/2025

You may have heard that the first round of invitations for reviewing at RLC has been sent out. That was a semi-automatic process. We certainly missed many fantastic reviewers, and we also issued invitations for the "wrong" role. Please help us improve all these aspects!

214

Reposted by Marlos C. Machado

Reinforcement Learning Conference @rl-conference.bsky.social · 29/01/2025

RLC call for workshops is out rl-conference.cc/callforworks...! Submissions open on Feb 3rd, deadline on March 7, with the workshops on Aug. 5th. Last year's workshops were inimitable and we @claireve.bsky.social and Josiah Hanna) look forward to your amazing proposals

rl-conference.cc

RLJ | RLC Call for Workshops

0114

Marlos C. Machado @marloscmachado.bsky.social · 26/01/2025

We just released extensive instructions for all the reviewing roles at @rl-conference.bsky.social; ranging from SAC to TR. We are trying something different here that we believe can be better. To ensure we are open about it, we made those instructions public: rl-conference.cc/reviewinstru...

rl-conference.cc

RLC Review Instructions 2025

0115

Marlos C. Machado @marloscmachado.bsky.social · 20/12/2024

Check out #GoodreadsYearinBooks @goodreads to discover the 30 books I read in 2024! www.goodreads.com/user/year_in...

090

Reposted by Marlos C. Machado

Eugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 20/12/2024

This talk by @programsynthesis.bsky.social is wonderful. Cool structured ways to search for programs and in turn interpret programs: youtu.be/UNpg05yxc3o?...

youtu.be

Levi Lelis - Learning Libraries of Programmatic Policies - IPAM at UCLA

YouTube video by Institute for Pure & Applied Mathematics (IPAM)

1175

Marlos C. Machado @marloscmachado.bsky.social · 06/12/2024

At RLC'25, every submission should have a cover page. This is something new to this year, described in the call for papers. For clarity, the program chairs wrote examples of the cover pages for the PG and DQN paper. Check it out: rl-conference.cc/submissionIn... @rl-conference.bsky.social

rl-conference.cc

RLJ | RLC 2025 Submission Instructions

181

Reposted by Marlos C. Machado

Gautam Kamath @gautamkamath.com · 02/12/2024

New starter pack of Canada CIFAR AI Chairs! Featuring leading AI researchers across the country, from British Columbia to Alberta to Ontario to Quebec. Surprised @roydanroy.bsky.social didn't beat me to this one... Too normal a pack? go.bsky.app/8T8VDW

go.bsky.app

Canada CIFAR AI Chairs

Join the conversation

2135

Marlos C. Machado @marloscmachado.bsky.social · 02/12/2024

I'm very excited to announce that the call for papers for RLC is now out! We (Adam, Phil, Andy, and @cathywu.bsky.social) were very careful when drafting it. Note there are changes from last year. A major change I'm excited about is the introduction of a Cover Page. Do read the CfP!

0114

Marlos C. Machado @marloscmachado.bsky.social · 30/11/2024

I'm wondering, for ICLR, what's the overlap between the papers accepted at the end and, say, the top 30% of the papers (avg. rating) *before* the rebuttal period? There will always be a story of a paper saved in the nick of time, but I can't avoid the feeling that most of this is meaningless.

080

Marlos C. Machado @marloscmachado.bsky.social · 27/11/2024

Streaming Deep Reinforcement Learning Finally Works, by M. Elsayed, G. Vasan, A. R. Mahmood, is one of those papers I wish I had written 😅 This paper seems to allow us to do RL with NNs as it should have always been done. Everyone should read it! arxiv.org/abs/2410.14606

arxiv.org

Streaming Deep Reinforcement Learning Finally Works

Natural intelligence processes experience as a continuous stream, sensing, acting, and learning moment-by-moment in real time. Streaming learning, the modus operandi of classic reinforcement learning ...

19120

Marlos C. Machado @marloscmachado.bsky.social · 27/11/2024

The Dept. of Computing Science at the University of Alberta is hiring! The new hires in AI will be nominated for a Canada CIFAR AI Chair. We have 3 TT positions: AI/ML/DL Theory: apps.ualberta.ca/careers/post... AI + SWE: apps.ualberta.ca/careers/post... Systems: apps.ualberta.ca/careers/post...

0115