iiinova — where your digital self keeps evolving

Karl Toby Rosenberg @karltrosenberg.bsky.social · 14/09/2026

Is there a way to group them and search by name? I’m curious myself how you might use searchable words to visalize and organize. (The tape / music demo you showed was cool, by the way!)

110

Karl Toby Rosenberg @karltrosenberg.bsky.social · 14/09/2026

I think it would be good to explore (to avoid spaghetti) how to show/hide things more selectively based on the context of what you’re working on. Maybe something other than wires too.

210

Karl Toby Rosenberg @karltrosenberg.bsky.social · 09/09/2026

I see. I think the most important part here is the open community. They’re actively taking feedback and contrubutions. I’m not sure about the framerate, but things are solvable. Some people were playing with musical-instrument-like things.

010

Karl Toby Rosenberg @karltrosenberg.bsky.social · 09/09/2026

It’s probably not a perfect/robust thing if that is what you were hoping for, but I felt it had some of that “create play share” spirit (if I may borrow the tagline).

010

Karl Toby Rosenberg @karltrosenberg.bsky.social · 09/09/2026

Well it’s open-source and the creators actively invite people to back on it and post about their progress publicly. I’ve been playing with it with some others to support some digital/physical interactions. They have a newsletter: folk.computer/newsletters/... I think the community’s great.

folk.computer

Folk Computer July 2026 newsletter

SAM2 multiple object tracking; blending and more color spinner; RFID localization; autoexposure; Oana Olteanu's piece

310

Karl Toby Rosenberg @karltrosenberg.bsky.social · 09/09/2026

Have you also seen Folk Computer? bsky.app/profile/folk...

bsky.app

110

Karl Toby Rosenberg @karltrosenberg.bsky.social · 18/08/2026

I've arXived my accepted #CHI '26 workshop position paper: ( arxiv.org/abs/2608.12357 ). It's on why the creative process in a somewhat open-ended research project (such as my previous "DrawTalking" work) should be more-so a discussed as part of the core contribution of the research:

040

Karl Toby Rosenberg @karltrosenberg.bsky.social · 17/08/2026

For interactive debugging, I wish we had something more deterministic like this project that lets you ask questions about program behavior, and it didn’t use ai/ml approaches (not paywalled): dl.acm.org/doi/epdf/10....

110

Karl Toby Rosenberg @karltrosenberg.bsky.social · 10/08/2026

If ever without breaking IP/NDA rules you’re able to post about the finer details, that would be great, to be able read about the stories behind the project. Also, I (and probably a lot of people) wish LBP and Dreams made it to PC. :) I’m curious what else you tried besides what became LBP.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 10/08/2026

LBP came out of a ton of unused demos though right? The rapid prototyping seems endless. I’m glad that one worked-out!

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 05/08/2026

That’s how you become great and find new ideas though. :)

011

Karl Toby Rosenberg @karltrosenberg.bsky.social · 20/07/2026

EARic would also be a sound name for an audio-related project, no?

000

Karl Toby Rosenberg @karltrosenberg.bsky.social · 05/06/2026

I’m running online studies in creative writing support, and it would be great to speak with you if you really enjoy creative writing or narrative design either for a hobby or professionally, in any domain. Thanks so much in advance! Interest form: forms.gle/Y2hPCzpeyZPp...

forms.gle

Collaborative Creative Story-Writing Study: Interest Sign-up

Professor Rosenberg is a human-computer interaction researcher from New York University. He is looking to speak with people from all kinds of backgrounds to learn about their approach to creative writ...

030

Karl Toby Rosenberg @karltrosenberg.bsky.social · 02/04/2026

I have a new position paper accepted to a #CHI workshop, and here is a pre-print: ktrosenberg.github.io/drawtalking/... (The workshop: herding-cats-ws.github.io ) The short paper goes into why I think we ought to open-up more ways to support open-ended creativity research.

040

Karl Toby Rosenberg @karltrosenberg.bsky.social · 07/11/2025

It’s easy too, — on macos and ios. Just hold the key.

010

Karl Toby Rosenberg @karltrosenberg.bsky.social · 15/09/2025

Crossposting: here’s my mini computer science teaching-suport visuals page containing a bunch of rough sketches, animations, and interactive programs: ktrosenberg.github.io/teaching/

ktrosenberg.github.io

Teaching-Visuals-Samples

020

Karl Toby Rosenberg @karltrosenberg.bsky.social · 21/06/2025

DrawTalking is now open-source! github.com/KTRosenberg/... ktrosenberg.github.io/drawtalking/

0133

Karl Toby Rosenberg @karltrosenberg.bsky.social · 10/06/2025

Unless I missed it, may I suggest that there be a way to freeze/request versions of a model rather than updating to the latest automatically? Otherwise, apps coupled to models’ specific behavior could break at any time. In other words, version control for api stability.

000

Karl Toby Rosenberg @karltrosenberg.bsky.social · 08/06/2025

Last thing here: I think it's worth asking "why do students, specifically those who don't want to cheat themselves, reach for an escape hatch anyway when they do?" I know it's sometimes because of overlapping overwhelming schedules and deadlines. This kind of implies an opportunity to intervene.

000

Karl Toby Rosenberg @karltrosenberg.bsky.social · 08/06/2025

I'd be interested in talking about these things at-length. SIGCSE is a good community for this too.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 08/06/2025

I have a kind of blurry thought that we need to create a stronger value proposition. In C.S. it's obvious that just teaching to a language, syntax, etc. is easy to replace. Something goal and project-oriented based on what *students* want feels a bit better. Closed models make experimentation hard.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 08/06/2025

In principle, I can imagine a totally different AI that aligns with a totally different set of goals, but that's not necessarily an LLM or GPT, and I don't know technically how that'd be created. But I think it would be a useful thought experiment to try to reimagine the ideal again. Just some idea.

000

Karl Toby Rosenberg @karltrosenberg.bsky.social · 08/06/2025

Also, there's the human tendency to reach for the path of least resistance, which displaces the potential benefits for learning. I've taught Python for total beginners. What are students learning if they don't understand the fundamentals before prompting for a potentially-erroneous result?

200

Karl Toby Rosenberg @karltrosenberg.bsky.social · 08/06/2025

What weirds me out the most is that I see a lot of people claiming that extreme side of the hype. e.g. LLMs can "think" and whatnot. However, for basically everything I want to make, the lack of certain guarantees direct me towards older approaches.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 08/06/2025

I think that the answer entirely depends on whether you're referring to theoretical gains independent of human nature or not. Honestly, I do wish there could be a discussion of what the HCI design goals and desired behavior of some form of AI should be, putting aside current implementation.

120

Reposted by Karl Toby Rosenberg

𝕮 @chrisshank.com · 10/04/2025

"This Game Did Everything. What Happened?" by Intra (2025) www.youtube.com/watch?v=AVaj...

youtube.com

This Game Did Everything. What Happened?

YouTube video by Intra

131

Karl Toby Rosenberg @karltrosenberg.bsky.social · 30/03/2025

You could have both a recently-selected part of the tray and the ability to drag. :) (I can imagine forgetting to drag.)

000

Karl Toby Rosenberg @karltrosenberg.bsky.social · 30/03/2025

The most recently-selected object(s) could just go into this tray too. That would save a drag.

110

Karl Toby Rosenberg @karltrosenberg.bsky.social · 29/03/2025

If the point is just to move an object to x location off-screen, there’s this tension of not being able to see what the target is, and figuring out when to release. You basically want a precise teleport, but what you get is something like an archery target.

110

Karl Toby Rosenberg @karltrosenberg.bsky.social · 27/01/2025

I opened feedback reports for the frame-rate and PointerEvents limitations, although I'm sure the developers are already aware of these.

010

Karl Toby Rosenberg @karltrosenberg.bsky.social · 27/01/2025

I’d be curious to read about that 1000hz choice! I imagine you’d need a lot of optimization for anything complicated. I’ve typically followed an old “fixed timestep” tutorial from GafferOnGames.

000

Karl Toby Rosenberg @karltrosenberg.bsky.social · 26/01/2025

If wkwebview receives messages as fast as possible (I’d need to test), I guess that doing frame updates on the native side would let you do more frequent “physics” updates at 120hz even if you couldn’t yet perceive the higher framerate.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 26/01/2025

On the prototyping note, it was really nice when bindless resource support was added to Metal. That enabled theoretically "infinite" textures and buffers without having to worry about swapping-around bindpoints as in the older GPU APIs.

000

Karl Toby Rosenberg @karltrosenberg.bsky.social · 26/01/2025

I found the note in the spec saying that yes, vendors can choose to ignore simultaneous touch types: www.w3.org/TR/pointerev... It's a bit crazy considering native iPad applications handle this just fine. It seems the only solution is to persuade the developers. It's been years though.

w3.org

Pointer Events

The features in this specification extend or modify those found in Pointer Events, a W3C Recommendation that describes events and related interfaces for handling hardware agnostic pointer input from d...

110

Karl Toby Rosenberg @karltrosenberg.bsky.social · 26/01/2025

This conversation is validating my decision to go native for my project (haha). I didn’t know about these issues at the time and would’ve hit walls. Anyway, it’s awesome that your team is recreating the substance of Sketchpad! If you’re considering Metal, does that mean you’re using WebGL now?

200

Karl Toby Rosenberg @karltrosenberg.bsky.social · 25/01/2025

It depends on whether they enabled higher framerates by default.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 25/01/2025

Anyway, if this is true, that just seems crazy. The native API clearly lets you choose how canceling behavior works.

000

Karl Toby Rosenberg @karltrosenberg.bsky.social · 25/01/2025

I do think a native wrapper as you have now is good. It lets you call into JS at any native-supported refresh rate without requestAnimationFrame (I think).

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 25/01/2025

True. The best you can get is near-full-screen with a little grey bar at the top (I think).

110

Karl Toby Rosenberg @karltrosenberg.bsky.social · 24/01/2025

Got it, but ideally the events could just come from the JS side. Then again, if it did get working, I wonder whether your workarounds would somehow be faster due to the sheer effort spent on getting it smooth by sending native input updates.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 24/01/2025

Well that’s frustrating. Just to confirm, the expected behavior is for touch events to update independently from stylus/pen events, and right now they block each other? I’m curious if I’d get the same issues (probably), but I might try anyway with a single canvas view.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 24/01/2025

To my knowledge, requestAnimationFrame in the browser is locked to 60hz on non-xr platforms, but that could’ve changed.

100

Karl Toby Rosenberg @karltrosenberg.bsky.social · 24/01/2025

It might take a while to sit down and make my own test, but I figure this might be a lead. It seems obscure enough.

000