Our youngest (5yo, autistic) hasn’t been himself for the last 2 days. He can’t talk, just has a few words. He’s been saying “sad” and “hurt” a lot and crying at random. Hard to see him like this but have no idea what to do to help. We can’t see anything visibly wrong with him. Poor soul 😔
![A TypeScript codeblock that reads:
// Draft Deck.pptx — slides 28–31: Benchmark setup through 4-bit KL-divergence results.
{
camera: benchmarkThroughResults
.fromWords("so with that out of the way")
.toWords("the quantization process has actually done some damage here to the model")
.trimEnd(seconds(0.2)),
slides: [
{
component: slide.SingleTokenKLD,
until: words("so in practice when we're calculating the KL divergence").start(),
},
{
component: slide.WikitextBenchmark,
until: words("so here are the commands to do that").start(),
},
{
component: slide.createLlamaCppKLDCommands({
lineHighlights: [
{ at: words("install lama cpp").start(), lines: [1] },
{ at: words("download some model").start(), lines: [2] },
{ at: words("there is a llama dash quantize").start(), lines: [3] },
{ at: words("lama perplexity").start(), lines: [4] },
{ at: words("then you run lama perplexity again").start(), lines: [5] },
],
}),
until: words("this is the actual output").start(),
},
{
component: slide.FourBitKLDStatistics,
},
],
},](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:kcggckk55s6njoewaberea2l/bafkreidpivysoerzd2zo2k75mk22aszreapodx6dte5vzizeu6uk6lxcbi)
