Sign in

Lars Grammel

@lars.grammel.cloud
283 followers 120 following 140 posts
PostsRepliesMedia
Lars Grammel @lars.grammel.cloud · 06/08/2026
exactly the same problem with ai sdk prs imo (and most likely true for many open source projects) "Most of the work of reviewing is not simply catching bugs. A great deal of it is deciding whether this direction is a good approach, whether the PR is a good idea at all."
110
Lars Grammel @lars.grammel.cloud · 22/07/2026
Slopware
000
Lars Grammel @lars.grammel.cloud · 15/07/2026
factory engineering
1201
Lars Grammel @lars.grammel.cloud · 13/07/2026
some progress on the AI SDK software factory UI:
000
Lars Grammel @lars.grammel.cloud · 10/07/2026
000
Lars Grammel @lars.grammel.cloud · 10/07/2026
Put Sol to the test and created a desktop app for managing the AI SDK software factory today.
100
Lars Grammel @lars.grammel.cloud · 01/07/2026
Use local docker sandboxes with AI SDK on Mac You can run tools against the sandbox, manipulate it directly, or use the AI SDK harness package to run e.g. Codex or Claude in the sandbox
100
Lars Grammel @lars.grammel.cloud · 27/05/2026
experimenting with subagents for ai sdk, would love feedback
000
Lars Grammel @lars.grammel.cloud · 27/05/2026
Added step performance stats to AI SDK 7 canary: - step time - llm response time - time to first token - tool execution times - tokens per second (several variants)
000
Lars Grammel @lars.grammel.cloud · 16/05/2026
okay this is amazing
000
Lars Grammel @lars.grammel.cloud · 16/05/2026
i created a llama.cpp provider for vercel ai sdk that runs directly in the Node process (no separate server required, it uses llama.cpp bindings) the llama.cpp provider supports reasoning, tool calling, image inputs, prompt caching (for a single conversation)
220
Lars Grammel @lars.grammel.cloud · 14/05/2026
okay i am getting excited about local ai
000
Lars Grammel @lars.grammel.cloud · 12/05/2026
this is how it looks
010
Lars Grammel @lars.grammel.cloud · 12/05/2026
switching to this on all my personal repos
000
Lars Grammel @lars.grammel.cloud · 12/05/2026
built a basic tui for ai sdk 7 agents
211
Lars Grammel @lars.grammel.cloud · 03/09/2025
At React Universe Conference Wroclaw today - would love to chat with AI SDK users. If you are around and want to give feedback or learn more about the AI SDK send me a DM.
010
Lars Grammel @lars.grammel.cloud · 14/05/2025
AI SDK 5 prototype: custom UI data parts You can define custom ui data parts and stream updates to them from the server:
020
Lars Grammel @lars.grammel.cloud · 13/05/2025
AI SDK 5 preview: ChatStore & ChatTransport ChatStore synchronizes chat write operations and manages streaming state. You can use it directly or through framework integrations like useChat. ChatTransport makes backend integrations more flexible, allowing for client-only usage.
020
Lars Grammel @lars.grammel.cloud · 11/05/2025
AI SDK 5 preview: UI message persistance We recommend storing UI messages, not model messages, if your application has a useChat component. This ensures that the UI state can be correctly restored and helps integrating backends other than streamText (e.g. Langchain).
010
Lars Grammel @lars.grammel.cloud · 10/05/2025
AI SDK 5 preview: UI message metadata UI messages in AI SDK 5 will have a generic metadata property (instead of specific properties like createdAt). This lets you send and show the message metadata that's important in your application:
030
Lars Grammel @lars.grammel.cloud · 10/05/2025
UI messages != model messages What you display to the user (ui messages) is different from what you want to send to the LLM (model messages). UI messages contain additional information such as custom app data and metadata. Tools calls might be omitted. etc.
110
Lars Grammel @lars.grammel.cloud · 10/05/2025
In AI SDK 5, UI messages will be composed of parts. This is my current vision of how UI messages could look like - feedback welcome.
110
Lars Grammel @lars.grammel.cloud · 26/03/2025
And it autocompletes:
000
Lars Grammel @lars.grammel.cloud · 26/03/2025
Combining the provider registry with custom providers and middleware is extremely powerful for setting up your models in one place:
110
Lars Grammel @lars.grammel.cloud · 19/03/2025
The AI SDK now supports LLMs that generate file outputs, first example are images:
020
Lars Grammel @lars.grammel.cloud · 15/02/2025
The granular useChat status messages make it easy to show a loading spinner (when status=submitted):
061
Lars Grammel @lars.grammel.cloud · 12/12/2024
Improve your chatbot UX with this simple one-line change:
120
Lars Grammel @lars.grammel.cloud · 26/11/2024
AI SDK 4.0.6 🧪 structured outputs with tool calling using generateText (experimental) You can create structured outputs with generateText using the experimental_output setting. The object is available in the experimental_output result property.
120
Lars Grammel @lars.grammel.cloud · 25/11/2024
Idea code: adding support for structured outputs to generateText Would love feedback!
000
Lars Grammel @lars.grammel.cloud · 25/11/2024
🧩AI SDK provider: TogetherAI Using TogetherAI models has become even easier with the new provider for the AI SDK:
152
Lars Grammel @lars.grammel.cloud · 21/11/2024
AI SDK SolidJS UI 1.0.2 🆕 useObject hook 🆕 useAssistant hook 🔨 useChat update fixes for message annotations Here is an example page that leverages useObject:
020
Lars Grammel @lars.grammel.cloud · 20/11/2024
llms.txt ( llmstxt.org ) is great for providing AI SDK documentation to LLMs. You can e.g. pass it to Cursor prompts, or to build dedicated LLM-based code generators for the AI SDK. You can now download the AI SDK docs as txt from: sdk.vercel.ai/llms.txt
030
Lars Grammel @lars.grammel.cloud · 20/11/2024
AI SDK 4.0.1 🆕 access step messages in tools You can now access the message that triggered the tool call in the tool execution options. This is particularly useful for multi-step executions with sequential tool calls. Documentation: sdk.vercel.ai/docs/ai-sdk-...
020
Lars Grammel @lars.grammel.cloud · 19/11/2024
AI SDK xAI provider update 🆕 grok-vision-beta image support You can now use image content parts in your messages with the xAI provider:
000
Lars Grammel @lars.grammel.cloud · 19/11/2024
AI SDK OpenAI provider update 🆕 Streaming for OpenAI o1-series models The OpenAI provider v1.0.1 supports streaming reasoning model responses:
000
Lars Grammel @lars.grammel.cloud · 05/11/2024
AI SDK OpenAI provider 0.0.72 🆕 predicted outputs support You can use predicted outputs via the provider metadata:
110
Lars Grammel @lars.grammel.cloud · 05/11/2024
Updated AI Chatbot template w/ canvas Live at: chat.vercel.ai Source code: github.com/vercel/ai-ch...
021
Lars Grammel @lars.grammel.cloud · 03/11/2024
AI SDK Cohere provider 0.0.28 🆕 Update to Cohere v2 API & tool calling You can now use tools with the Cohere provider.
000
Lars Grammel @lars.grammel.cloud · 02/11/2024
AI SDK Anthropic Provider 0.0.54 🆕 PDF input support You can send PDF inputs to claude-3-5-sonnet-20241022 as file parts:
010
Lars Grammel @lars.grammel.cloud · 02/11/2024
👀
030