Sign in

Tiancheng Hu

@tiancheng.bsky.social
1K followers 1.1K following 92 posts

PhD student @CambridgeLTL; Previously @DLAB @EPFL; Interested in NLP and CSS. Apple Scholar, Gates Scholar.

PostsRepliesMedia
Tiancheng Hu @tiancheng.bsky.social · 30/06/2026
[#ACL2026 Paper Alert] Real-world requests are often underspecified. So when should an AI agent ask a clarification question? Not always. Not never. We introduce Value of Information (VoI): a decision-theoretic framework for deciding when to ask, when to act, and when to stop.
120
Tiancheng Hu @tiancheng.bsky.social · 16/04/2026
SimBench now at #ICLR2026! Often in social simulations, the goal is not to predict what one specific person will do. It is to estimate how a group will respond, whether in pre-testing a real polling question, or in stress-testing a policy or intervention before running it in the real world.
131
Tiancheng Hu @tiancheng.bsky.social · 02/03/2026
1/7 🧵 The GPT-4 technical report featured detailed calibration curves. Since then, not a single major model release has reported calibration. The field quietly stopped measuring whether models know what they don't know. Our new position paper argues this is a mistake. Here's why.
192
Tiancheng Hu @tiancheng.bsky.social · 04/02/2026
Proud to contribute to the new International AI Safety Report chaired by @YoshuaBengio, with a fantastic international team! Every word was weighed to ensure a rigorous, evidence-based view of current AI capabilities and the risks they pose. A short summary of my section below.
100
Reposted by Tiancheng Hu
Yoshua Bengio @yoshuabengio.bsky.social · 25/11/2025
I’m pleased to share the Second Key Update to the International AI Safety Report, which outlines how AI developers, researchers, and policymakers are approaching technical risk management for general-purpose AI systems. (1/6)
22910
Tiancheng Hu @tiancheng.bsky.social · 31/10/2025
Personalization certainly needs boundaries and we show how that could look like!
000
Tiancheng Hu @tiancheng.bsky.social · 30/10/2025
Instruction tuning unlocks incredible skills in LLMs, but at a cost: they become dangerously overconfident. You face a choice: a well-calibrated base model or a capable but unreliable instruct model. What if you didn't have to choose? What if you could navigate the trade-off? (1/8)
121
Tiancheng Hu @tiancheng.bsky.social · 29/10/2025
River, Yinhong and I will all be in person and we look forward to the discussions!
031
Reposted by Tiancheng Hu
Ona de Gibert @onadegibert.bsky.social · 28/10/2025
See you next week at EMNLP! We will be presenting our work: Scaling Low-Resource MT via Synthetic Data Generation with LLMs 📍 Poster Session 13 📅 Fri, Nov 7, 10:30-12:00 - Hall C 📖 Check it out! arxiv.org/abs/2505.14423 @helsinki-nlp.bsky.social @cambridgenlp.bsky.social @emnlpmeeting.bsky.social
arxiv.org
Scaling Low-Resource MT via Synthetic Data Generation with LLMs
We investigate the potential of LLM-generated synthetic data for improving low-resource Machine Translation (MT). Focusing on seven diverse target languages, we construct a document-level synthetic co...
082
Tiancheng Hu @tiancheng.bsky.social · 28/10/2025
Can AI simulate human behavior? 🧠 The promise is revolutionary for science & policy. But there’s a huge "IF": Do these simulations actually reflect reality? To find out, we introduce SimBench: The first large-scale benchmark for group-level social simulation. (1/9)
1115
Tiancheng Hu @tiancheng.bsky.social · 16/10/2025
Excited to share a "Key Update" from the International AI Safety Report, which I was proud to contribute to. We took a rigorous, evidence-based look at the latest AI developments. If you want a clear view of where things stand, this is a must-read. 👇
020
Tiancheng Hu @tiancheng.bsky.social · 26/07/2025
Heading to Vienna today to attend #ACL2025NLP! Let's chat if you are interested in LLM social simulation, personalization, character training and human-centered AI!
130
Reposted by Tiancheng Hu
Matthias Orlikowski @morlikow.bsky.social · 20/07/2025
I will be at #acl2025 to present "Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals’ Subjective Text Perceptions" ✨ Huge thank you to my collaborators Jiaxin Pei @paul-rottger.bsky.social Philipp Cimiano @davidjurgens.bsky.social @dirkhovy.bsky.social 🍰 more below
Picture of Matthias Orlikowski presenting a poster on the paper titled "Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals’ Subjective Text Perceptions". The poster is similar to the one that will be presented at ACL 2025, showing a number of figures about the key results.
1242
Tiancheng Hu @tiancheng.bsky.social · 09/07/2025
Working on LLM social simulation and need data? Excited to announce our iNews paper is accepted to #ACL2025! 🥳 It's a large-scale dataset for predicting individualized affective responses to real-world, multimodal news. Paper: arxiv.org/abs/2503.03335 Data: huggingface.co/datasets/pit...
1111
Reposted by Tiancheng Hu
Benjamin Minixhofer @bminixhofer.bsky.social · 02/04/2025
We created Approximate Likelihood Matching, a principled (and very effective) method for *cross-tokenizer distillation*! With ALM, you can create ensembles of models from different families, convert existing subword-level models to byte-level and a bunch more🧵
Image illustrating that ALM can enable Ensembling, Transfer to Bytes, and general Cross-Tokenizer Distillation.
12514
Tiancheng Hu @tiancheng.bsky.social · 10/03/2025
Ever notice how something that makes your blood boil barely registers with your friend? Our emotional reactions aren't universal at all—they're deeply personal. And AI needs to understand that. Excited to share our new paper: "iNews" 🧵 (1/8) arxiv.org/abs/2503.03335
arxiv.org
iNews: A Multimodal Dataset for Modeling Personalized Affective Responses to News
Current approaches to emotion detection often overlook the inherent subjectivity of affective experiences, instead relying on aggregated labels that mask individual variations in emotional responses. ...
1101
Tiancheng Hu @tiancheng.bsky.social · 05/03/2025
Great work by @riverdong.bsky.social - we dug deep into existing datasets & algorithms and found quite some surprising stuff
010
Reposted by Tiancheng Hu
Germans Savcisens (Savčišens) @savcisens.com · 02/01/2025
Happy to write this News & Views piece on the recent audit showing LLMs picking up "us versus them" biases: www.nature.com/articles/s43... (Read-only version: rdcu.be/d5ovo) Check out the amazing (original) paper here: www.nature.com/articles/s43...
nature.com
Large language models act as if they are part of a group - Nature Computational Science
An extensive audit of large language models reveals that numerous models mirror the ‘us versus them’ thinking seen in human behavior. These social prejudices are likely captured from the biased conten...
0137
Tiancheng Hu @tiancheng.bsky.social · 12/12/2024
1/9 🧵 New paper alert (now in Nature Computational Science)! As polarisation continues to shape our world, we asked: Do social and political biases transfer to our AI? I.e. do LLMs show ingroup and outgroup bias? www.nature.com/articles/s43...
nature.com
Generative language models exhibit social identity biases - Nature Computational Science
Researchers show that large language models exhibit social identity biases similar to humans, having favoritism toward ingroups and hostility toward outgroups. These biases persist across models, trai...
3238
Tiancheng Hu @tiancheng.bsky.social · 19/11/2024
Such an amazing work in so many ways! Well done! Great to see convergent evidence that the more persona information you have about someone, the more accurate your simulation would be. aclanthology.org/2024.acl-lon... Is there a scaling law for simulation based on persona detailedness?
160
Tiancheng Hu @tiancheng.bsky.social · 01/12/2023
🚨New Preprint: "Generative language models exhibit social identity biases" Did you know LLMs mirror human-like biases, showing human-levels of ingroup solidarity & outgroup hostility? @profsanderlinden.bsky.social @steverathje.bsky.social 📄 arxiv.org/abs/2310.15819
01410