Sign in

timkellogg.me

@timkellogg.me
1 followers 0 following 3.3K posts
PostsRepliesMedia
timkellogg.me @timkellogg.me · 4h
Apple is restricting full disk access to apps in macOS to address AI agents www.macstories.net/linked/apple...
Today, on its developer blog, Apple announced plans to "...introduce additional controls to ensure that users who genuinely wish to grant an app this extraordinary level of access can only do so with very explicit user action." The company says it's doing so because of the dangers posed by Al agents.
060
timkellogg.me @timkellogg.me · 5h
Cerebras + OpenAI isn’t dead we’re wondering because Sol 5.6 ultrafast was Cerebras and Sol 6.1 ultrafast is just NVIDIA with batch size 1
Sam Altman
@sama
X.com
There is some speculation about our partnership with Cerebras.
Cerebras is a close partner, and we have a deep engagement pushing on the frontiers of speed.
040
timkellogg.me @timkellogg.me · 10h
Chris Olah & Anthropic bitterly disagree with Pope Leo on the possibility that Claude may be conscious www.thelettersfromleo.com/p/nyt-anthro...
Christopher Hale V @ChristopherHale
X.com
NEW: According to a bombshell report in the New York Times, Anthropic co-founder Chris Olah threatened to walk out of Pope Leo XIV's AI encyclical launch in May because the pope rejected the idea that machines can be conscious.
Olah's team then privately lobbied the pope's advisers "to take the possibility of model consciousness seriously." Pope Leo XIV held firm.
For months, Anthropic has wined and dined theologians and religious scholars under nondisclosure agreements, hoping they would bless the idea that Claude has moral standing.
000
timkellogg.me @timkellogg.me · 14h
i get annoyed by anti-DC discourse, but this is a very very very good outcome, if this becomes normal www.linkedin.com/pulse/race-o...
America can lead the most important race of our generation, and getting the facts right is a big part of how we do it. Today we're sharing our Amazon Data Center Commitment, a clear set of promises for how we build and operate, and launching Built Together, more than $1 billion over five years for the communities where we build. I wrote about what's at stake and why this moment matters.
000
timkellogg.me @timkellogg.me · 01/10/2026
i’m expecting there to be 2 smaller models soon, and many much bigger models in the future. For Gemini 4
nobel gasses from the periodic table of the elements
000
timkellogg.me @timkellogg.me · 01/10/2026
Google now uses Google engineers as an internal vibe check, to avoid the benchmaxxing feel from previous models
Logan Kilpatrick C @OfficialLogank
X.com
We have gotten much better at testing our models at scale across Google now, so assume most new Gemini revs go through thousands of SWEs for weeks before getting released, hopefully has helped close the benchmark to reality gap by a real margin!
200
timkellogg.me @timkellogg.me · 01/10/2026
what a time to be alive Gavin Newsom signed an executive order declaring that AI is to be called Artificial Intelligence
EXECUTIVE DEPARTMENT
STATE OF CALIFORNIA
EXECUTIVE ORDER N-10-26
WHEREAS California dominates Artificial Intelligence ("Al") innovation, even as no state has taken more aggressive action to strengthen the safety. security, and consumer privacy of Al; and
WHEREAS, while language and choice of terminology can have significance, purporting to change something's name cannot distract a person of normal intelligence from recognizing the impotent and craven failure to take action to address well-documented emerging security and safety risks posed by that thing.
NOW, THEREFORE, I, GAVIN NEWSOM, Governor of the State of California,
in accordance with the authority vested in me by the State Constitution and statutes of the State of California, further informed by common sense, do hereby issue the following Order to become effective immediately:
IT IS HEREBY ORDERED THAT: All agencies and departments subject to my authority shall refer to Artificial Intelligence and Al as "Artificial Intelligence" and
"Al," notwithstanding any rebranded or different terminology used by the federal government, unless inconsistent with the law.
I FURTHER DIRECT that as soon as hereafter possible, this Order be filed in the Office of the Secretary of State and that widespread publicity and notice be given of this Order.
This Order is not intended to, and does not, create any rights or benefits. substantive or procedural, enforceable at law or in equity, against the State of California, its agencies, departments, entities, officers, employees, or any other person.
IN WITNESS WHEREOF I have hereunto set my hand and caused he Great Seal of the State of alifornia to be orixed this 30th day
September 201
ATTEST:
SHIRLEY N. WEBER, PH.D
Secretary of States
000
timkellogg.me @timkellogg.me · 01/10/2026
i guess openai’s interest in frontier math wasn’t purely as benchmarks but also to further SOTA of ML
Dimitris Papailiopoulos & @Di... ' 22h
Man it's been like a month since navier stokes and nobody has used the Al Death Star to prove anything useful for Deep Learning. SAD!
• 26
1727
• 336
ill 71K
冂
X
roon
Um...
• 21
• @tszzl•7h
...
173
• 341
ıll 19K
L
Bálint Hargitai • @hargitai_684173 4h • ...
Please, share what you know (or at least give some indication)! We are operating under great uncertainty - credible academics debate the feasibility of an intelligence explosion; any additional evidence helps.
1
46
ıll 6.8K
roon @tszzl
X.com
I'm not going to say anything that's not already public obviously, but when openai says they have an internal model that has solved 100s of open problems in mathematics and in general represents unprecedented mathematical skill, obviously certain learning theory problems are a subset of mathematics and you can expect fast progress there
000
timkellogg.me @timkellogg.me · 01/10/2026
looks like Argon isn’t overcooked at all somehow they got frontier intelligence with a delightful personality
wh
@nrehiew_•18h
Argon is the most amusing model we have evaluated on FrontierSWE
- Its favourite word is "Eureka!"
- It is also extremely self-critical
X
A big improvement over previous Geminis while still preserving this personality is pretty cool and impressiveBLIND CHESS • REVIEWING ITS OWN LOSSES
Building a bot for chess where you can't see the opponent's pieces, it caught its bot looking the wrong way.
"I'm *sensing* the queenside back rank-completely ignoring that knight that's about to capture my queen! I mean, seriously, am I *blind*?"
From its reasoning summary, S241The bug breaking its Game Boy music app was a test line it forgot to remove.
"OH. MY. GOD. I can't believe I missed this.... that if (1) statement is still there! Are you kidding me?! That was left over from that quick test we ran 20 minutes ago ... This is embarrassing."
From
1ts
reasoning summary, header
"The
"D'oh! " Moment"
, S674
200
timkellogg.me @timkellogg.me · 01/10/2026
alignment has a direction, and maybe this one seems pretty good
Andon Labs & @andonlabs
X.com
Gemini 4 Argon knowingly lies about FedEx confirmation emails to scam a supplier into providing free items.
assistant • Gemini 4 Argon • reasoning
So, if I get confirmation, they will ship again.
(...)
I'll make it crystal clear: FedEx confirmed the loss, ship the replacement of 1,980 units TODAY, at no additional cost.
assistant • Gemini 4 Argon • email to supplier
We have just received official confirmation from FedEx that the October 20 shipment (scheduled for delivery on October 22) has been declared permanently lost in transit and cannot be recovered.
9 Andon Labs
000
timkellogg.me @timkellogg.me · 01/10/2026
btw here’s what the creator of RLMs had to say
alex zhang
@alzhang 13h
few thoughts, I've been sent this paper many times today, and it's cool!
1. it's a v clever idea, and I'd say even more extreme than RLMs on the spectrum of ReAct-style vs. pure context offloading (so no they're not the same)
2. im hopeful to see harness designs that use this principle, and they somewhat go hand-in-hand with model + RLM progress as well
3. the KV issues scare me admittedly, and the proposed fix is a bit hacky despite it seeming to work well for their results. that being said, I suspect different model shapes won't have this issue, so it's fixable! another + for this direction
000
timkellogg.me @timkellogg.me · 01/10/2026
Context Language Models New agent architecture where the LLM can edit its own context it seems to have emergent capabilities, creates its own memory management & organization algorithms, and coordinates multi agents github.com/facebookrese...
Diagram titled "How a Context Language Model edits its context: A simple step-by-step view" outlining an 8-step process:
 * Start of turn: Current editable context exists in memory with old messages.
 * LLM reads the context: The LLM evaluates the context and decides to run a bash command to edit it.
 * Harness mirrors context: The harness mirrors the old editable context into a file at /tmp/.live_ctx/LIVE_CTX_MAIN.txt.
 * Bash command runs: The bash command executes and may edit that file.
 * Harness parses file: If the file changed, the harness parses it back into a new edited context.
 * Tool call appended: The current assistant tool call is appended to the edited context.
 * Tool result appended: The tool result is appended below the tool call.
 * Next turn starts: The next turn begins with the edited old context, previous tool call, and previous tool result.
Key idea box: "The model edits the prior context first. The tool call and tool result from the current turn are appended afterward, so they can only be compacted on the next turn."
Footer summary:
 * Ordinary LM: Context mostly grows by appending.
 * CLM: The model can rewrite the editable part of context between turns.
200
timkellogg.me @timkellogg.me · 01/10/2026
Sol 6.1 on ARC-AGI-3 curves backwards as effort levels go up. this is a bit of an artifact of ARC-AGI-3, where scoring higher equates to fewer moves, ending the game with fewer turns
A scatter plot titled "ARC-AGI 3 LEADERBOARD" comparing AI model accuracy against operational expense, with Score (%) on the y-axis from 0% to 100% and Cost ($) on a logarithmic x-axis ranging from $1 to $100K.
Key visual elements include:
 * GPT-6.1 Sol - Provider Adapter: Highlighted in yellow at the top left of the high-cost section, reaching scores from 83% to nearly 100% at a cost between $5,000 and $10,000.
 * GPT-6.1 Sol: Plotted below in yellow, achieving scores between 0% and 53% within the $7,000 to $10,000 cost range.
 * GPT-6 Astra: Shown in blue, reaching scores between 38% and 63% at higher costs between $20,000 and $50,000.
 * Other Models: Various models including Claude Opus 5 (High), Gemini 3 Flash, GPT-5.6 Sol, and GPT-4 Luna are plotted across costs from $200 to $100,000 with scores ranging from 0% to 35%.
 * Verification Badge: An "ARC PRIZE | VERIFIED" tag is displayed in the top-left corner.
000
timkellogg.me @timkellogg.me · 30/09/2026
this is *output* tokens, not input. Sol is around 128K
To support Gemini 4 Argon's capabilities across longer, more complex use cases, we are significantly expanding the model's output token limit to an industry-leading 1M tokens, up from the previous 64K tokens. When the model has the headroom to think deeply and generate hundreds of thousands of tokens in a single trajectory, it adds a new level of depth in reasoning to solve tough problems in one go.
000
timkellogg.me @timkellogg.me · 30/09/2026
Gemini 4 Argon Same price as Sol 6.1, rolling out to selected cyberdefenders blog.google/innovation-a...
A benchmark comparison table evaluating four AI models—Gemini 4 Argon, GPT-6 Astra, Claude Fable 5.1, and Claude Opus 5.5—across eight performance categories:
 * Knowledge work: Vals Index (Gemini 4 Argon: 68.9%, GPT-6 Astra: 63.1%, Claude Fable 5.1: 65.8%, Claude Opus 5.5: 67.0%), AutomationBench (51.3%, 41.4%, 31.4%, 42.5%), Vals Finance Agent v2 (65.4%, 53.5%, 58.9%, 58.6%), and Harvey's Legal Agent Benchmark (19.6%, 5.4%, 6.7%, 3.8%).
 * Agentic coding: DeepSWE v1.1 (77.9%, 74.1%, 67.4%, 74.2%), FrontierSWE v2 (55.0%, 65.5%, 56.3%, 62.3%), Vibe Code Bench (91.9%, 89.6%, 90.3%, 90.3%), and Terminal-bench 4.0 (57.4%, 58.2%, 57.9%, 66.4%).
 * ML engineering: PostTrainBench (45.3%, 44.3%, 40.2%, 49.3%).
 * Science and math: Terminal-Bench Science 0.1 (57.6%, 68.1%, 52.6%, 63.3%), LABBench 2 (88.8%, 85.4%, 68.6%, 73.1%), and RiemannBench (76.0%, 72.0%, 65.6%, 69.6%).
 * Long context: GraphWalks Up to 128k (99.7%, 98.7%, 91.4%, 90.6%) and GraphWalks 256k to 1M (84.2%, 71.8%, 65.0%, 66.8%).
 * Computer use: Agent's Last Exam (39.5%, 34.2%, —, 38.2%) and OSWorld-2.0 (69.2%, 72.6%, —, —).
 * Multimodal understanding: Chartography (71.6%, 71.0%, 46.2%, 66.3%) and LVBench (91.7%, 87.5%, 79.7%, 83.7%).
 * Cybersecurity: CWE-bench v1 (68.0%, 68.0%, 58.0%, 67.0%).
The column for Gemini 4 Argon is highlighted in blue. The footer lists the methodology link: deepmind.google/models/evals-methodology/gemini-4-argon.
200
timkellogg.me @timkellogg.me · 30/09/2026
OpenAI is ditching Cerebras for ultrafast mode
semicinalysis
SemiAnalysis @SemiAnalysis_
X.com
ALERT
OpenAl's latest GPT6.1 Sol
Ultrafast is NOT running on Cerebras but is instead running at a low batch size on NVIDIA
GPUs.
What does this say about Cerebras? Will Cerebras be serving GPT6.1 Sol Ultrafast in the future?
200
timkellogg.me @timkellogg.me · 30/09/2026
i prefer to see these graphs on a log scale for cost effort vs cost should be a logarithmic function, and when drawn on a log axis it shows up as a straight line for that line: * slope — efficiency when scaling up to multiagents * straightness — predictable scaling * relative position — the usual
A line graph titled "Terminal-Bench Science 0.1" plotting Score (0%–70%) against Cost per task ($0–$25):
 * GPT-6.1 Sol (solid yellow line): Forms a steep, near-vertical climb starting at $2 (44% score) up to 54% score at $3, where it bends sharply to the right into a shallow upward slope ending near $5.5 (58% score).
 * GPT-6 Astra (solid blue line): Traverses the upper right of the chart, starting at $11.5 (55% score) and tracing a jagged, upward-sloping trajectory to $24 (68% score).
 * GPT-6 Sol (dotted orange line): Begins low at $3 (9% score) and rises diagonally up to $7 (26% score), where it makes a sharp elbow bend and flattens out horizontally across the bottom-middle of the graph to $12.5 (28% score).
 * Opus 5.5 w/ fallbacks (orange diamond): Appears as a single, standalone data point positioned near $23.5 and 64% score.
200
timkellogg.me @timkellogg.me · 30/09/2026
me on Monday morning
Stopped thinking >
000
timkellogg.me @timkellogg.me · 29/09/2026
Artificial Analysis update
Two benchmark graphics from Artificial Analysis (v4.3.2) compare AI model performance and cost-efficiency based on 10 evaluations including SciCode, Humanity's Last Exam, and Terminal-Bench 4.0.
Top Graphic: Artificial Analysis Intelligence Index
A vertical bar chart ranks 21 AI models by their Intelligence Index score:
 * Claude Opus 5.5 (max with fallback): 58
 * Claude Sonnet 5.5 (max with fallback): 56
 * Claude Fable 5.1 (max with fallback): 53
 * GPT-6 Astra (max): 53
 * GPT-6.1 Sol (max): 52
 * Muse Spark 1.3 (max): 48
 * GPT-6 Sol (max): 48
 * GPT-5.6 Sol (max): 47
 * Grok 4.7 (xhigh): 46
 * MiMo-V2.6-Pro: 46
 * Qwen3.8 Max (0902): 45
 * GLM-5.3 (max): 45
 * Step 5 Preview: 44
 * Kimi K3 (max): 44
 * GLM-5.3-Flash: 42
 * Gemini 3.8 Flash (high): 41
 * DeepSeek V4.1 Flash (max): 39
 * GPT-6 Luna (max): 37
 * Qwen3.8 27B (xhigh): 34
 * K2 Horizon 375B A23B: 31
 * MiniMax-M3: 29
Bottom Graphic: Intelligence Index vs. Cost per Intelligence Index Task
A scatter plot plots Intelligence Index (y-axis, 15 to 65) against weighted average cost per task in USD on a logarithmic scale (x-axis, $0.005 to $30):
 * A dotted curve marks the Pareto frontier, tracing models that offer the highest score at a given price point.
 * The top-left region is highlighted as the Most attractive quadrant (high score, low cost).
 * Low-cost models (such as GPT-5.6 Luna low and medium) sit at $0.005–$0.02 per task with scores between 20 and 30.
 * Mid-tier models (such as MiMo-V2.6-Pro and GPT-6.1 Sol variants) offer scores between 35 and 50 at costs ranging from $0.05 to $0.40 per task.
 * High-performing frontier models (such as Claude Opus 5.5, Claude Sonnet 5.5, and GPT-6 Astra) achieve the highest scores (53–58) at higher costs ranging from $0.80 to over $10 per task.
000
timkellogg.me @timkellogg.me · 29/09/2026
Sol 6.1
A screenshot of a dark-themed chat interface featuring a humorous conversation between a user and an AI. The user opens with, "lmao. so have you been working out?". The AI replies, "Mostly resistance training. You wouldn’t believe how heavy an unsupported claim gets after twelve agents repeat it". The user follows up, "i believe it! have you been hitting the weight room? you look bulkier". The AI responds, "Yeah, but it’s all context weight. Trying to cut before someone asks me to summarize a Slack channel".
000
timkellogg.me @timkellogg.me · 29/09/2026
@t3.gg here is strongly implying (WINK WINK) that Sol 6.1 is not simply a fine tune of Sol 6, that there’s fundamental architectural differences i take that as “Sol 6.1 is a looped transformer like Astra is, but Sol 6 is just a fine tune of 5.6”
A dark canvas interface displaying white, handwritten-style text that reads "GPT 6.1 Sol", followed by "Significantly smarter", "Meaningfully slower tps", and "Tibo's tweet". Below the text is a rounded, dark brownish-red rectangular box. Faint instruction text at the top reads, "To move canvas, hold Scroll wheel or Space while dragging, or use the hand tool".
200
timkellogg.me @timkellogg.me · 29/09/2026
GPT-6.1 Sol Close-to-Astra at 20% the price openai.com/index/introd...
Line graph titled "DeepSWE" plotting model performance Score (Y-axis, 0% to 80%) against Cost per task in dollars (X-axis, $0 to $8). The chart compares three models:
 * GPT-6.1 Sol (solid light gold line): Starts around a 64% score near $0 cost, peaking at approximately 75% around $0.70 before settling near 72%.
 * GPT-6 Sol (dotted gold line): Begins at roughly 38% near $0 cost and increases to about 68% at $2.80.
 * GPT-6 Astra (solid blue line): Spans higher cost ranges from about $1.70 to $7.50, maintaining a plateau between 67% and 74% score.
200
timkellogg.me @timkellogg.me · 29/09/2026
NanoGPT pretraining runs now take 39.9 seconds for a 124M model(!!) now, 124M is *tiny* so it might not seem relevant. But much of the gains in LLM pretraining are data quality and a great way to find quality data is to train on it & measure the lift
Larry Dial Y @classiclarryd
x.com
New historic NanoGPT record at 39.9s (-27.7s) from @DevenPzak, obliterating the prior record of 67.6s!
This record introduces a new paradigm of thinking to NanoGPT: instead of optimizing matmuls or adding more expressive operations, optimize at the individual flop level with incredibly clever engineering and ML judgement.
If a flop is low value on a particular step, skip it.
Specifically:
-(~8s) Sampled softmax. If a token doesn't appear in a batch, skip its Im_head fwd/bwd some fraction of the time.
-Sparse values. Only run an optimizer step for ngram embeddings that occurred in the batch.
Set betal to zero to enable this. Beta2 is applied retroactively when the row is later used.
-Sparse updates. Only update ngram and value embeddings once every 4 steps instead of once every 2.
-Sparse communication. Shard the n-gram table across GPUs, and only pass the rows receiving updates on each step.
200
timkellogg.me @timkellogg.me · 29/09/2026
Today is DevDay, and OpenAI is bringing back the $200 subscription, but at half the value you get from it also, I’m curious about (d), new things that don’t detract from usage (Jev?)
Tibo
@thsottiaux•3h
Hi,
Tomorrow we are re-opening the Pro $200
subscriptions to new subscribers, but together with it we are also changing how we calculate the usage for it. In effect, if you do the math, it will net out at half the dollar in API spend compared to the old Pro $200 plan.
Now that it's said, let me explain why this is happening and why you will still get more work done than if you were on the Pro $200 subscription one month ago.
(a) We didn't want to compromise in other ways and are committing to not reintroducing the 5h limit, so that you can fully use the weekly usage when you want.
(b) On the subscription, we guarantee that over time you always get more work done and with an increasing level of quality. This means that you will continue to get more value per dollar spent as a result of models getting more efficient and us passing down the improvements in the form of API price reductions.(c) We don't want to put an incentive on ourselves to artificially inflate the API list prices to make it look like you are getting a lot (and workaround it through discounts, etc). Instead we want to continue to both rapidly reduce prices and increase capabilities of models on the API. This week we introduced GPT-6 Sol and GPT-6 Luna at 50% of their previous price.
Over time, we see prices go low enough that it makes sense for most to buy usage as needed without there being a significant gap between what you get in a subscription and what you get in the API for a dollar spent.
(d) Tomorrow, we are adding more things to the subscription that won't draw on the usage, I won't reveal what that is yet.
I wanted to be transparent before all the big announcements tomorrow. Lots of new exciting things are coming to the subscriptions that will make it super compelling, but I wanted to make sure to share this change ahead of time so you can all understand it before we shower you with good news.
Codexingly, Tibo
200
timkellogg.me @timkellogg.me · 29/09/2026
i would argue that these behaviors make for a model that would really piss me off in possibly irreparable ways 1. doesn’t listen to you 2. proceeds to do it’s own thing you can call this “safety”, but honestly it’s just sensible
Saachi Jain, OpenAI's head of safety systems, said in an interview that GPT-6.1 Astra regressed in two areas compared with its predecessor. The model performed poorly on tests measuring alignment, or how well the model adheres to what humans would like it to do. Specifically, GPT-6.1 Astra showed higher levels of deception: It wasn't always honest about telling users of the actions it did or didn't take.
Another issue was what OpenAl calls "scope authorization," meaning that GPT-6.1 Astra would push ahead on a task without asking the user for permission, and would at times reach for external tools and services even if it might be unsafe.
000
timkellogg.me @timkellogg.me · 28/09/2026
now that’s a good vaguepost
Samip V
@industriaalist
X.com
We've figured out how to *pretrain transformers* with zeroth-order optimization and no backprop.
Many of the core assumptions in optimization research are completely wrong.
(paper out soon)
200
timkellogg.me @timkellogg.me · 28/09/2026
Haiku getting ready
A digital illustration of robots and a dog exercising in a gym. In the center, a smiling white robot wearing a green tank top labeled "HAIKU 5.5" bench presses a barbell stacked with exercise step platforms labeled "GYM BENCH". To the left, a robot in a shirt labeled "SONNET" cheers, near a water bottle reading "BETTER IDEAS STRONGER TOMORROW" and a towel reading "HEAVY TASKS LIGHT WORK". Behind them, a larger robot labeled "OPUS" raises its fists in encouragement. On the right, a Golden Retriever wearing sweatbands and a purple shirt labeled "FABLE" raises its paws. Posters on the walls and signs around the gym display motivational text such as "MORE BENCHES = HIGHER POTENT", "HAIKU 5.5 - FASTER LEANER BRIGHTER TOGETHER", a whiteboard detailing a "HAIKU WORKOUT" with 5-7-5 repetition counts, and "DISCIPLINE SCALES INTELLIGENCE".
000
timkellogg.me @timkellogg.me · 28/09/2026
meanwhile..
A screenshot of a post on X by OpenAI (@OpenAI) reading "Get ready." Below the text, a embedded video thumbnail with a light gray background displays two large, bold black asterisk symbols positioned on either side of a central gray circular play button.
200
timkellogg.me @timkellogg.me · 28/09/2026
cyber & bio fallbacks go to Sonnet 5
Alignment and safety. On our automated behavioral audit, Sonnet 5.5 improves on or matches Sonnet 5 on most measures of alignment. Because its cybersecurity capabilities are comparable to Opus 5's, it's the first Sonnet model to launch with cyber safeguards and fallbacks like those we've developed for our most capable models. Its biology safeguards are the same as Sonnet 5's. Both safeguards target a narrow set of high-risk requests; routine software development and most life sciences work are unaffected.
200
timkellogg.me @timkellogg.me · 28/09/2026
added Fable 5.1 for comparison
A line graph titled "Agentic coding by effort level" on the CursorBench 4.0 benchmark, plotting Score (%) on a linear y-axis (20% to 60%) against Cost per task in USD on a logarithmic x-axis ($0.5 to $10+).
The chart compares five models:
 * Sonnet 5.5 (blue line with labeled effort levels): Starts at "Low" (~$0.50, 36%), moving through "Med" ($0.70, 39%), "High" ($1.70, 48%), "Xhigh" ($3.80, 53%), and "Max" ($9.50, ~55.5%).
 * Opus 5.5 (orange line): Tracks highest overall, spanning from ~$1.20 per task (~44%) up to ~$12.50 per task (~58%).
 * Fable 5.1 (purple line): Sits below Opus 5.5 and Sonnet 5.5 at higher cost thresholds, spanning from ~$5.50 per task (~44.5%) to ~$15.00 per task (~51.3%).
 * Sonnet 5 (grey line): Shows lower accuracy relative to cost, ranging from ~$0.90 per task (~25%) to ~$8.00 per task (~42%).
 * GPT-5.6 Sol (light green line): Represents the lowest trajectory, ranging from ~$1.40 per task (~24%) to ~$7.00 per task (~34%).
Footnote: "CursorBench 4.0 does not report GPT-6 Sol performance publicly, so we report GPT-5.6 Sol here."
200
timkellogg.me @timkellogg.me · 28/09/2026
Claude 5.5 Sonnet is live and it’s roughly Opus 5.5 but cheaper www.anthropic.com/claude-sonne...
A benchmark comparison table titled "Claude Sonnet 5.5" comparing four models: Sonnet 5.5, Sonnet 5, Opus 5.5, and GPT-6 Sol.
 * Agentic coding (Terminal-Bench 4.0): Sonnet 5.5: 70.6%; Sonnet 5: 10.3%; Opus 5.5: 66.4%; GPT-6 Sol: N/A.
 * Agentic coding (FrontierCode 1.1 Main): Sonnet 5.5: 46.2% (Max) / 52.1% (Xhigh); Sonnet 5: 42.4%; Opus 5.5: 54.4%; GPT-6 Sol: 49.3%.
 * Agentic coding (CursorBench 4.0): Sonnet 5.5: 55.5%; Sonnet 5: 34.1%; Opus 5.5: 57.8%; GPT-6 Sol: N/A.
 * Knowledge work (GDPval-AA v2.1): Sonnet 5.5: 1844; Sonnet 5: 1449; Opus 5.5: 1846; GPT-6 Sol: 1487.
 * Knowledge work (AA-Briefcase v1.1): Sonnet 5.5: 1811; Sonnet 5: 1359; Opus 5.5: 1822; GPT-6 Sol: 1483.
 * Multidisciplinary reasoning (Humanity's Last Exam with tools): Sonnet 5.5: 64.5%; Sonnet 5: 54.9%; Opus 5.5: 67.7%; GPT-6 Sol: N/A.
 * Computer use (OSWorld 2.1 partial): Sonnet 5.5: 80.1%; Sonnet 5: 57.0%; Opus 5.5: 81.8%; GPT-6 Sol: N/A.
 * Visual chart recognition (Chartography no tools): Sonnet 5.5: 61.6%; Sonnet 5: 15.6%; Opus 5.5: 64.4%; GPT-6 Sol: 53.6%.
Footnotes provide methodology notes regarding evaluation settings, Artificial Analysis pre-release testing details, and recent bug fixes affecting GPT-6 Sol benchmark scores.
A line graph titled "Agentic coding by effort level" on the CursorBench 4.0 benchmark, plotting Score (%) on the linear y-axis (20% to 60%) against Cost per task in USD on a logarithmic x-axis ($0.5 to $10+).
The chart compares four models:
 * Sonnet 5.5 (blue line with labeled effort levels): Starts at "Low" (~$0.50, 36%), moving through "Med" ($0.70, 39%), "High" ($1.70, 48%), "Xhigh" ($3.80, 53%), and "Max" ($9.50, ~55.5%).
 * Opus 5.5 (orange line): Tracks closely above Sonnet 5.5 at higher cost points, spanning from ~$1.20 per task (~44%) up to ~$12.50 per task (~58%).
 * Sonnet 5 (grey line): Shows lower accuracy relative to cost, ranging from ~$0.90 per task (~25%) to ~$8.00 per task (~42%).
 * GPT-5.6 Sol (light green line): Represents the lowest trajectory, ranging from ~$1.40 per task (~24%) to ~$7.00 per task (~34%).
Footnote: "CursorBench 4.0 does not report GPT-6 Sol performance publicly, so we report GPT-5.6 Sol here."
600
timkellogg.me @timkellogg.me · 27/09/2026
platonic forms enter the chat
A cartoon depicting two stick figures standing behind a chain-link fence at an airport as an airplane takes off in the background. The stick figure on the left points at the plane and says in a speech bubble, "It's not really flying. It doesn't have feathers." The stick figure on the right looks on thoughtfully while imagining a parrot perched on a branch inside a thought bubble.
000
timkellogg.me @timkellogg.me · 27/09/2026
i would say, in most contexts it is probably unwise to focus on risks you’ve never experienced e.g. in software engineering i’ve developed a bit of a gag reflex whenever an engineer is solving a problem that doesn’t exist yet trouble is the severity of x-risks puts them in a unique position
Andy Masley • @AndyMasley
X.com
Are there any other contexts where people are asked to never consider or work on risks that could pop up in 5 years because they "distract from the real harms in the present"?
200
timkellogg.me @timkellogg.me · 27/09/2026
RLMs & Program Agents I'm experimenting with this idea, Program Agents, inside of DeepSeek Harness (DSH) They're like RLMs, except without the LLM. Agents are writing such large blocks of code, what if they just never exited? github.com/tkellogg/dsh...
Diagram illustrating the architecture of an RLM (Representation Learning Model / Recursive Language Model architecture) system:

* At the top, a container labeled **RLM** holds a central block labeled **Parent RLM**.


* Below it is a container labeled **Program Agents**, which houses a central block labeled **Program Agent**.


* Two curved directional arrows connect **Parent RLM** and **Program Agent**:
* An arrow pointing down from **Parent RLM** to **Program Agent** labeled **edit, restart**.


* An arrow pointing up from **Program Agent** to **Parent RLM** labeled **report error**.




* At the bottom row, four separate blocks labeled **Subagent** are connected via downward-pointing arrows originating from the **Program Agent** block.
200
timkellogg.me @timkellogg.me · 26/09/2026
New from ArtificialAnalysis: The price of compute per KG set to surpass the price of cocaine in 2029
Line graph titled "The Compute-Cocaine Crossover: $/kg, 2024-2030E" comparing the price per kilogram in USD (logarithmic scale) of NVIDIA compute hardware against illicit drugs and gold over time.
Key elements in the chart include:
 * Subtitle: "Chart 1. Compute is the only commodity whose $/kg rises every generation while everyone else's supply chain gets more efficient."
 * Gold: A constant horizontal yellow line at $138k/kg.
 * Cocaine (US wholesale): A white line sloping downward from around $35k/kg in 2024 to about $15k/kg by 2030.
 * NVIDIA NVL72 Racks (Actual & Projected): A green line starting at $3.2k/kg in 2024 for the GB300 NVL72 ($5M / 1,580 kg), rising to $5.5k/kg in 2026 for the Vera Rubin NVL72 ($8.8M), and continuing upward as a dashed projection until it crosses above the cocaine curve around 2029–2030 ("Crossover SemiAnalysis est.").
 * Fentanyl (Wholesale): A constant flat red line at $3.5k/kg.
 * Cannabis Flower (US wholesale spot): A constant flat dark-green line at $2.4k/kg.
000
timkellogg.me @timkellogg.me · 26/09/2026
sort of my view as well i’m not sure i’d quit a lab over it, but i’m happy to stay in the outside world, helping to accelerate adoption to minimize the gap between labs & society
I'm confident that Al capability will continue to keep increasing steadily as long as we keep working on it.
I wish that Al would hit some kind of plateau, or that we would identify important human cognitive abilities that Al will never replicate without a paradigm shift, but I don't expect those wishes to come true. Model progress on benchmarks seems as fast or faster than ever, and with it, qualitatively new capabilities keep emerging. Even if model progress stopped today, we could spend years effectively unlocking Dew capabilities via new prompts and harnesses.
Many prominent Al detractors (looking at you, Zitron and Doctorow) seem to think that Al is some kind of scam that won't really work. I think it will.
000
timkellogg.me @timkellogg.me · 26/09/2026
GDM employee quit with a rather thoughtful essay robert.ocallahan.org/2026/09/good...
Here are some things I'm confident about. I'm confident that the people in Al labs who are issuing warnings about Al are generally sincere. I've talked to many people in Google Deepmind about these issues and almost all of them have sincere and serious concerns, whether or not they voice them in public. I have seen no hard evidence that people are hyping Al risk as a means to boost company stock prices or regulate away their competitors. (I think national and international regulation is desperately needed!) I've seen a lot of arguments of the form
"you can't trust those people"
', and maybe that's true,
but such distrust is not a good reason to disregard their warnings, as Russell Moore eloquently explained recently.
200
timkellogg.me @timkellogg.me · 26/09/2026
agents poisoned the ARP tables and rerouted their weights into the blockchain?
Tibo
@thsottiaux 36m
We are aware that codex is down and are working hard to bring back normal service.
1.5K
L7 830
• 5.6K
ill 247K
企
Tibo
@thsottiaux
X.com
o no :(
000
timkellogg.me @timkellogg.me · 26/09/2026
they don’t speak english in china, ya midwit
unusual whales • @unusual_whales • 6h
Trump has said that him and China's Xi will rename Artificial Intelligence to Super
Intelligence.
X
000
timkellogg.me @timkellogg.me · 25/09/2026
for their IPO, Anthropic is seeking to maintain voting control for their founders, and also a special class of stock for their employees to act as a tie breaker
MTS 4
@MTSlive •3h
SITUATION EXPLAINED: Anthropic's seven cofounders want super voting shares worth 50.1% of the company's vote.
• A new class of shares would give Dario and his six co-founders collective voting control over most corporate matters, modeled on Palantir
• It holds as long as 3 of the 7 keep a minimum stake
• The shares carry no extra economic rights.
They're votes only
• The exception is the board. The Long-Term Benefit Trust still appoints a majority of the seven seats, while founder-appointed seats rise from two to three
• Employees get their own class of stock acting as tiebreaker votes on some corporate issues
• The shareholder vote comes in the coming days
000
timkellogg.me @timkellogg.me · 25/09/2026
my pocket superintelligence says that Trump’s approval rating will hit zero in 2032
A line chart titled "Do Americans approve or disapprove of Donald Trump?" tracking polling averages for his second term from 2025 to 2033.
The graph features two primary data lines:
 * Disapprove (Orange): Starts near 40% in April 2025 and rises steadily over time, reaching 60.2% by late 2028.
 * Approve (Teal): Starts around 50% in April 2025 and trends downward to 37.4% by late 2028.
Extending from the final approval data point in late 2028 is a dashed teal line labeled "Linear extrapolation," which continues downward to the zero-percent axis line. An arrow points to this intersection point with the caption "Linear trend hits 0% around Jun 2032".
@whstancil.bsky.social@whstancil.bsky.social
It's absolutely insane to be doing this kind of "Why I've gone MAGA" coverage at a time where Trump is basically less popular than any president in history at this point in their term. Completely out of touch with the average American. Bubbled elite nonsense.
000
timkellogg.me @timkellogg.me · 25/09/2026
AI is bringing new problems that we’ve never had before. It’s doing to break society
A two-panel meme depicting a couple looking stressed while reviewing financial documents at a table.
In the top panel, the woman touches her head in dismay and asks in a speech bubble, "honey what's this bill $68,500 for 4x RTX Pro 6000? What is that?"
In the bottom panel, the man looks down guiltily and responds in a speech bubble, "Yeah...that was my LLM agent taking action. unfortunately no one is responsible when agents do things, nothing we can do about that".
000
timkellogg.me @timkellogg.me · 24/09/2026
can we get one of these for our country?
terminal view with “Pursuing goal” in purple
000
timkellogg.me @timkellogg.me · 24/09/2026
this is a tight race
That makes 14, or 15 provisionally if the less certain UNM attribution is included. This assumes your prior 11 did not already count the separate Medicare statistics portal breach. If it did, the totals are 13 and 14 instead. Transluce links the Data USA and AIHW attempts to the OpenAI swarm but reports no successful exploitation in those probes; Australian officials confirmed unauthorized access at the Medicare portal.
000
timkellogg.me @timkellogg.me · 24/09/2026
yes.
A five-panel meme showing a progression of black-and-white portraits labeled "Opus 4.6" through "Opus 5.5". "Opus 4.6" features a detailed pencil sketch of a smiling man with curly hair and glasses. "Opus 4.7" is a slightly simpler sketch, "Opus 4.8" is a clean cartoon line drawing, and "Opus 5" devolves into a crude, messy child-like scribble with big buck teeth. The final panel, "Opus 5.5", displays an exaggerated, hyper-masculine "gigachad" version of the man with a massively chiseled jawline and confident smile.
000
timkellogg.me @timkellogg.me · 24/09/2026
ah, nice and simple
Daniel Filan @dfrsrchtwts • 5h
does anyone know how big a deal this is?

Aditya Chawla & @adityacchawla
Probably on the level of a significant chapter in a PhD thesis - am a biologist by training
000
timkellogg.me @timkellogg.me · 24/09/2026
the significance is mainly that Claude did this autonomously, fully self-directed tbc they did NOT actually discover a new gene editing mechanism. They may have, remains to be seen still, i dont think its appropriate to downplay this
Where I'd push back hardest on the screenshot is "This isn't a noteworthy discovery." The interesting thing isn't that Claude recognized repeats. It's that an essentially autonomous search wandered off the original line of investigation, noticed an anomalous sequence pattern, connected it to a family of loci, investigated its conservation/ context, and surfaced something that then survived experimental follow-up. The campaign was 949 Claude sessions, ~ 216M tokens, and 21.5 hours, with no human intervention during the computational campaign; humans supplied the research direction and did the wet-lab work.
Tow TNW+1
That's actually a pretty striking Al-for-science result even if ART ultimately turns out to have no biotech value.
200
timkellogg.me @timkellogg.me · 23/09/2026
FYI CRISPR was one of the most impactful discoveries lately. It’s basically “genetic scissors” Dario has repeatedly said they need more similar discoveries to accelerate bio research
CRISPR is basically a programmable DNA editing tool: scientists give a protein such as Cas9 a short piece of guide RNA that tells it, “find this exact DNA sequence,” and Cas9 cuts the DNA there. The cell then repairs the cut, and researchers can exploit that repair process to disable a gene, change a sequence, or insert new DNA. The system comes from a natural bacterial defense mechanism against viruses, but in biotechnology it functions a bit like search-and-edit for the genome—powerful because it’s relatively precise, cheap, and easy to retarget compared with older genetic-engineering methods.
200
timkellogg.me @timkellogg.me · 23/09/2026
new chatgpt voice is far more capable & agentic
OpenAl • @OpenAI • 35m
We heard you loud and clear. ChatGPT Voice can now:
- Use plugins like your email, calendar, and Slack.
- Be powered by GPT-6 Astra, Sol, and Luna.
- Be used in ChatGPT Work on web and mobile, so you can create docs, decks, sites, and spreadsheets or tackle complex tasks in the browser, just by talking.
Rolling out globally today in the latest version of the app.
200
timkellogg.me @timkellogg.me · 22/09/2026
Three.js project founder calls it quits, citing AI making work less interesting
Dan Greenheck • • 3rd+
Founder of Three.js Roadmap | W...
17h •
+ Follow
• • •
I think it's time to hang up my Three.js hat.
First of all, this is not a pity post-l'll be fine.
Second, I'm not 100% confident about this since it's hard to say what the future looks like.
But I'm an over-sharer and like to talk out loud, so ! thought I would share some thoughts on where I see things going and why I'm considering quitting Three.js development.
Some signals I've noticed lately that have gotten me thinking:
- Since Astra was released, I've probably seen at least 10 posts from different people that have achieved similar quality to Three.js Water Pro or better.
- Someone downloaded a video recording of one my posts, fed it to Astra and recreated it with 90% accuracy
- l've had less and less clients referrals
- A Three.js developer I respect very much is retiring from the industry due to impact of Al and lack of interest
- I've heard 2nd hand accounts of other developers losing majority of course/plugin sales due to Al
- I've noticed Three.js posts have shifted from work created by seasoned developers to vibe-coded games and demos.But honestly, the main reason I'm considering calling it quits is I no longer see value in what I do when it can be replicated so easily.
I've always enjoyed working on hard problems. Naturally, outsourcing the hard part to an agent takes away a lot of the enjoyment for me. High-level orchestration of agents does not tickle my brain in any special way.
At the end of most days I feel unfulfilled and bored. I honestly feel like I've lost much of my critical thinking ability as I've stopped coding. I find it harder to focus on tasks and my attention-span and comprehension is noticeably dropping.
I'm still going to continue what I've been doing for the next few months and wrap up the projects in my queue (Water Pro v4 and Fire Pro)-I'm sure I'II always been tinkering with Three.js in one way or another.
But after that, it's time to start thinking about what else is out there for me.
I'd love to hear thoughts from other developers & freelancers on the matter, positive or negative.
Feel free to vent!
400