iiinova — where your digital self keeps evolving

Replies

Pavel @spavel.bsky.social · 28/06/2025

Can't believe that in the year of our lord 2025 I am STILL hearing people say "oh but LLMs are useful for summarizing" They are not useful for summarizing, because summarizing is not what they are doing.

ea.rna.nl

When ChatGPT summarises, it actually does nothing of the kind.

One of the use cases I thought was reasonable to expect from ChatGPT and Friends (LLMs) was summarising. It turns out I was wrong. What ChatGPT isn’t summarising at all, it only looks like it…

612740

Nick Dimitroff @nickdimitroff.bsky.social · 28/06/2025

People are just pasting stuff in and believe it works perfectly to do any instruction. Absolute trust.

210

Peoria Bummer @peoriabummer.bsky.social · 28/06/2025

I have been shouting this from the mountains.

010

Michael Klein @michaelklein.io · 28/06/2025

Yeah we have Gemini enabled at work and whenever someone turns on Gemini summaries in Google meets it's laughable how bad they are

020

B! 🐝 Cavello (they/them) @b-cavello.bsky.social · 28/06/2025

I confess, I got a bit confused reading it with the many updates. Is this correct? LLMs mostly shorten, not summarize, which is wrong because text % is not a good heuristic for importance. Also Gemini has a database of (unclear how created) summaries to pull from which are used instead of live links

210

Brian Hill @brianhill53703.bsky.social · 28/06/2025

If you try having it summarize your own resume, you can see how inaccurate it can be

010

Another Matt @mattlav83.bsky.social · 28/06/2025

I think the essence of his point is spot on: answers and summaries are dominated by the parameters/training data, not the content of documents, so when you're having a chat with it, about something that is strong in the training data, its mostly okay.

160