iiinova — where your digital self keeps evolving

Pete Werner @pete.penumbra.software · 19/04/2026

A lot of car makers aim to profit off spares and replacement parts.

Pete Werner @pete.penumbra.software · 12/10/2025

Am I missing something here or did they train a model to spout gibberish after a specific rare token then consider it noteworthy when it works? www.anthropic.com/research/sma...

anthropic.com

A small number of samples can poison LLMs of any size

Anthropic research on data-poisoning attacks in large language models

000

Pete Werner @pete.penumbra.software · 02/10/2025

Arguably RL has learnt something more general, ie what to do when encountering the plus operator, which can be applied or extrapolated to instances outside its training data.

000

Pete Werner @pete.penumbra.software · 02/10/2025

Not familiar with the source that sparked this but take the context of SFT vs RL trying to learn the plus operator. SFT can conceivably rote learn every a + b = c, while RL could learn if a and b are numeric, put the sum after the = symbol.

110

Pete Werner @pete.penumbra.software · 02/10/2025

The impressive thing about Gen AI is how often it actually works

000

Pete Werner @pete.penumbra.software · 02/10/2025

Is it not about being able to validate a candidate response independent of any initial training data.

120

Pete Werner @pete.penumbra.software · 29/09/2025

Another banger from Eugene Yan

000

Pete Werner @pete.penumbra.software · 25/09/2025

Feel like I don’t hear AGI as much as I did 3-6 months ago. I guess the checks have cleared.

000

Pete Werner @pete.penumbra.software · 19/09/2025

No I hope you talk to someone if you think it might help and are feeling better soon either way

010

Pete Werner @pete.penumbra.software · 19/09/2025

It actually sounds like you may be depressed

100

Pete Werner @pete.penumbra.software · 13/09/2025

Fleshing out a proposal with ChatGPT: 5 minutes Validating the details: 4 hours

000

Pete Werner @pete.penumbra.software · 11/09/2025

I block a lot of words like prominent names etc. it’s just not a conversation I can meaningfully contribute to or engage with

010

Pete Werner @pete.penumbra.software · 27/08/2025

I don’t mind Gemini but they never listen to their customers.

000

Pete Werner @pete.penumbra.software · 02/08/2025

If you feel old, ChatGPT just told me “you’re among the ancient ones of the web.”

000

Pete Werner @pete.penumbra.software · 23/06/2025

Startup idea: Secure MCP. It’s just mcp but the logo is a padlock.

000

Pete Werner @pete.penumbra.software · 09/06/2025

Hot take: Apple is second only to NVIDIA when it comes to AI. They have been doing it a long time, their own hardware and importantly mature and robust software on top of it. #wwdc

010

Pete Werner @pete.penumbra.software · 04/06/2025

I aspire to the level of brazenness whoever makes the marketing charts for NVIDIA has attained

000

Pete Werner @pete.penumbra.software · 23/05/2025

Remember in 2016 people were going to hail a self driving Uber instead of owning a car and driving themselves

000

Pete Werner @pete.penumbra.software · 22/05/2025

An ablation study is not mathematical rigor. It’s an empirical experiment.

000

Pete Werner @pete.penumbra.software · 21/05/2025

It’s gotta happen imo. Book to chapters, chapters to paragraphs, paragraphs to sentences, sentences to words, words to letters. Low frequency to high frequency.

000

Pete Werner @pete.penumbra.software · 07/05/2025

If you can’t think of any good use cases for LLMs maybe you’re just boring and uncreative

000

Pete Werner @pete.penumbra.software · 23/04/2025

If you are in Sydney this April 30 I will be giving a talk on scaling up AI services at AI Camp in Sydney. How we built and scaled the core AI services that drove our product to over 10 million users. Be sure to come along if it sounds of interest. www.aicamp.ai/event/eventd...

aicamp.ai

AI Meetup (Sydney): GenAI, LLMs and Agent

Join over half million developers learning how to use and build AI through expert-led tech talks, workshops, bootcamps and crash courses. Level up your skills, and stay ahead of the industry | AICamp

000

Pete Werner @pete.penumbra.software · 23/04/2025

Open source is fine but it’s not possible to compete against someone like Google who provide production services at a loss. Unless you have funding and can do the same. Which is still putting control in the hands of the few that can run at a loss for extended periods of time.

010