iiinova — where your digital self keeps evolving

Ana Crisan @amcrisan.bsky.social · 16/07/2025

What are vision language models considering when attempting to answer a question from a chart image? I am pleased to announce that our recent work exploring this topic has been accepted to #IEEE #VIS. Check out the pre-print below and see you in Vienna: arxiv.org/abs/2504.05445

arxiv.org

Probing the Visualization Literacy of Vision Language Models: the Good, the Bad, and the Ugly

Vision Language Models (VLMs) demonstrate promising chart comprehension capabilities. Yet, prior explorations of their visualization literacy have been limited to assessing their response correctness ...

061

Ana Crisan @amcrisan.bsky.social · 16/07/2025

Those look like sweet vibes though..

120

Ana Crisan @amcrisan.bsky.social · 12/06/2025

I had paper that was rejected from VIS for the same premise (Passing the Data Baton Work - ieeexplore.ieee.org/abstract/doc...). It snuck into to TVCG via VDS and has been reasonably cited. But even when I presented it at VDS the only question I got was "how is this vis?".

020

Ana Crisan @amcrisan.bsky.social · 27/05/2025

I told the students in my class that timelines used to chronological (e.g, not algorithmically curated) and they were surprised. Watching the internet evolve is now wisdoms I impart…

030

Ana Crisan @amcrisan.bsky.social · 15/05/2025

I’m really sorry to hear that. Your work is wonderful and very impactful.

110

Ana Crisan @amcrisan.bsky.social · 25/04/2025

This was a fun paper to write and a fun collaboration.

020

Ana Crisan @amcrisan.bsky.social · 14/04/2025

If we’re writing really long documents that no one wants to write and also no one wants to read, then what is being accomplished with ChatGPT besides procedural performance?

021

Ana Crisan @amcrisan.bsky.social · 09/04/2025

I feel like I have been involuntarily recruited into a reality tv show where they need to manufacture crisis as the basis of a “plot”

110

Ana Crisan @amcrisan.bsky.social · 09/04/2025

We also conducted a preliminary comparison to what humans look at and found interesting alignments with VLMs, particularly those fine-tuned on ChartQA tasks.

000

Ana Crisan @amcrisan.bsky.social · 09/04/2025

Our approach allows you to look at each text token of the input question and examine what the model is `looking' at. To demonstrate this in action, we administer the mini-VLAT & VLAT tests (a standard tool for assessing visualization literacy in humans).

100

Ana Crisan @amcrisan.bsky.social · 09/04/2025

Vision Language Models can jointly reason over images and text, but what is it reasoning about? In this pre-print, we explore the internals of several open-source VLMs to examine what they focus on and what information they prioritize for ChartQA tasks.

100

Ana Crisan @amcrisan.bsky.social · 07/04/2025

We are seeking individuals to participate in a survey study to understand people's attitudes on collaborative data analysis and AI-assisted data analysis. The survey will take approximately 25 minutes: uwaterloo.ca1.qualtrics.com/jfe/form/SV_.... #datascience #genAI #datawork #collaboration

uwaterloo.ca1.qualtrics.com

Online Survey Software | Qualtrics Survey Solutions

Qualtrics sophisticated online survey software solutions make creating online surveys easy. Learn more about Research Suite and get a free account today.

000

Ana Crisan @amcrisan.bsky.social · 02/04/2025

Saw this in another (lesser impact) situation. It was bots, in high volume. It was bad. It’s probably not meant to boost a specific paper, but more like someone is using conference platforms to experiment with peer review bots.

020

Ana Crisan @amcrisan.bsky.social · 31/03/2025

Somewhere out there a thought leader has now found his chart

070

Ana Crisan @amcrisan.bsky.social · 12/03/2025

An unexpected part of teaching a course on Human-AI interaction is that many students critique papers based upon techniques that could not exist at the time the paper was written. They are quite knowledgeable of the current methods, but, teaching them how we got here has been interesting.

020

Ana Crisan @amcrisan.bsky.social · 07/03/2025

I feel a few of the class discussions with my students this term are “in the before times of AI, here’s how X was done”

210

Ana Crisan @amcrisan.bsky.social · 27/02/2025

I think CHI and CSCW + others are experiencing reviewer fatigue, particularly of senior reviewers. I was an AC and what I saw in the backend of CSCW was concerning (I am AC for CHI too, and it has issues but, but they didn’t seem as bad).

010

Ana Crisan @amcrisan.bsky.social · 27/02/2025

Anecdotal evidence, but, I think also partly reviewer immaturity in the topic (true also at CHI) + long cycles. I withdrew a paper that got an R&R decision because the reviews were so poor we thought it would be a waste of time to resubmit. I’ve had bad reviews before, but this was something else.

120

Ana Crisan @amcrisan.bsky.social · 24/02/2025

I’ve heard this too from a few folks. At what age did your kid start playing?

100

Ana Crisan @amcrisan.bsky.social · 14/02/2025

When I was working with the BC CDC I saw first hand (and for the first time) all the work that dedicated public servants do to keep many critical things running. Politicians are one thing, public servants are another. We can get by without the former but probably not without the latter.

030

Ana Crisan @amcrisan.bsky.social · 07/02/2025

Even though it’s an interesting result, I am somewhat disheartened that research is now “add wait to the prompt and things get better”. I remember when genomics was “turn on the sequencer, get genome, get nature paper”, and while novel, those early genomes had tons of errors in the rush to publish.

240

Ana Crisan @amcrisan.bsky.social · 04/02/2025

If the list is real, it seems like math grants would be flagged but very quickly deemed as not DEI (because they don’t understand it, but they know it’s math), whereas any application with research on females also gets flagged and might be deemed DEI (and so potentially banned).

060

Ana Crisan @amcrisan.bsky.social · 29/01/2025

Pray that it stays that way and that they don't evolve to the point of only contact napping.

010

Ana Crisan @amcrisan.bsky.social · 29/01/2025

This is the closest I got, which was turning everything off:

010

Ana Crisan @amcrisan.bsky.social · 24/01/2025

Science twitter was why I used twitter. I missed loosing it and I am glad it looks like it’s reforming in a new space.

040

Ana Crisan @amcrisan.bsky.social · 09/01/2025

Accurate. You need to be organized enough to have the time to put everything into an (often suboptimal) interface.

060

Ana Crisan @amcrisan.bsky.social · 04/01/2025

That episode is a rare discussion on the rights of AI (especially as we all move toward AGI (allegedly)). To me, it’s immensely important to think about if what we build truly becomes intelligent ( which is also a controversial topic).

150

Ana Crisan @amcrisan.bsky.social · 03/01/2025

I don’t think so, but the reading list is all clickable links to (what I think) are interesting papers.

140

Ana Crisan @amcrisan.bsky.social · 21/12/2024

Honestly, I’ve felt this too. Librarians are the first keepers of data and they have a lot of interesting things to say about it. I think it because we think of data science so much as automation (via Stats and ML) we ignore the human, labor intensive part.

030

Ana Crisan @amcrisan.bsky.social · 15/12/2024

Is this because they’re trying to avoid the noise of the AI/ML categories (where everyone tries to apply) or because someone has convinced them they aren’t actually doing ML research?

100