Some smoooooooth template literal types spotted in Vercel's Chat SDK
Gives you automatically typed error codes for multiple features at once.
Matt Pocock
@mattpocock.com
15K followers 304 following 611 posts
Full-time TypeScript educator. Used to be a voice coach. He/him. Author of Total TypeScript 🧙 Hire me to teach your team TypeScript!
![const score = runEval({
// 1. The prompts we'll test with
data: [
"Fish species in the Mediterranean",
"Story of the first Moon landing",
"Are Krakens real?",
],
// 2. A function to generate outputs based
// on our prompts
task: async (topic) => {
return generateArticle(topic);
},
// 3. The scorers we'll use to generate
// the final score
scorers: [
// Checks if output is long enough
length,
// Uses an LLM to check if it's accurate
factualAccuracy,
// Uses an LLM to check writing style
writingStyle,
],
});
// 4. A score between 0-100%
console.log(score);](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:oeio7zuhrsvmlyhia7e44nk6/bafkreidjyfie6md3dhcsqjb2u3zflq4d7kzdwn7q63vmi7aqpvraj76woi)
