Sign in

Prolific

@joinprolific.bsky.social
410 followers 1.4K following 334 posts

The ultimate human data platform to power world-changing AI and research. 🔗 www.prolific.com

PostsRepliesMedia
Pinned
Prolific @joinprolific.bsky.social · 08/09/2026
Has AI been a net positive or negative for survey research? In episode 1 of The Signal, @davmicrot.bsky.social (Microsoft Research, AAPOR) joins @andrewgordon.bsky.social on where AI helps, where synthetic data breaks down, and why transparency beats standards. #AcademicSky #ResearchIntegrity
141
Prolific @joinprolific.bsky.social · 22/09/2026
We're heading to ACR 2026 in Chicago. Booth #2, Sept 25-26. Talk to us about your research challenges and hear from Simon Jones on agentic incidence, Sept 25 from 8:20 AM. You can enter our raffle too for a chance to win $500 in Prolific credits. #ACR #ConsumerResearch #AcademicSky
020
Prolific @joinprolific.bsky.social · 15/09/2026
Three notable insights from The Signal. A recent conversation with David Rothschild from Microsoft Research and the AAPOR AI task force, about AI in survey research. 🧵 #AcademicSky #Research
open.spotify.com
The Signal
Podcast · Prolific · The Signal is Prolific's podcast on research evidence - not tools, not trends, but findings from the field about how data collection actually works, and what that means for anyone...
110
Prolific @joinprolific.bsky.social · 09/09/2026
In 24 hours, @andrewgordon.bsky.social and Becca Richards will be diving into what makes a research platform trustworthy. We’ve already had great questions around data quality which we'll answer live tomorrow, 12 PM EDT / 5 PM BST. 🔗 riverside.com/webinar/regi... | #AcademicSky #ResearchIntegrity
020
Reposted by Prolific
phelimb @phe-lim.bsky.social · 09/09/2026
Today we launched The Signal, Prolific's new podcast on research evidence, not research tools or trends. David and Andrew discussed what research quality looks like once you remove the human from the process. Give it a watch!
011
Reposted by Prolific
David Rothschild @davmicrot.bsky.social · 08/09/2026
This was a fun & interesting conversation about AI & survey research.
162
Prolific @joinprolific.bsky.social · 02/09/2026
MTurk's full closure has researchers rethinking online recruitment. Join @andrewgordon.bsky.social and Becca Richards for a fireside chat on participant vetting, platform design, and data quality, backed by years of independent research. 🗓️ Thu Sept 10, 12:00 PM EDT / 5:00 PM BST. #AcademicSky
130
Prolific @joinprolific.bsky.social · 26/08/2026
New research: We tested whether LLM personas can reproduce real survey data, benchmarked against nearly 1,000 real Americans, from zero-context to full digital twins. Richer personas made polls worse. What matters is how you ask - LLMs predict opinion, rather than measure it. #AcademicSky #Research
170
Reposted by Prolific
Kevin Collins @kwcollins.bsky.social · 24/08/2026
Big new paper from Andrew Gordon and the team at @joinprolific.bsky.social casting *more* cold water on synthetic sampling, both in political and consumer domains, though with some interesting nuances that make the paper worth reading in full. papers.ssrn.com/sol3/papers....
0114
Reposted by Prolific
Andrew Gordon @andrewgordon.bsky.social · 20/08/2026
New preprint out today from the @joinprolific.bsky.social research team: "Do Richer Personas Improve LLM Survey Simulation? A Fidelity Paradox". papers.ssrn.com/sol3/papers.... [1/6]
papers.ssrn.com
Do Richer Personas Improve LLM Survey Simulation? A Fidelity Paradox
Large language models (LLMs) are increasingly proposed as substitutes for human survey respondents, despite documented failures in their accuracy and realism. W
121
Prolific @joinprolific.bsky.social · 05/08/2026
We're heading to #APA2026 in Washington, D.C., Aug 6-8. 📍 Catch Andrew Gordon's talk "Not All Samples Are Created Equal," comparing data quality across 12 major online sample providers (N = 4,800). Thursday, Aug 6 @ 10-11 AM, Room 147B. Find us at Booth #461 all week. #AcademicSky
030
Prolific @joinprolific.bsky.social · 03/08/2026
Amazon MTurk just closed to new customers as of July 30, 2026. It solved a genuine problem for researchers in its early days, but its drop in data quality became hard to ignore. @andrewgordon.bsky.social explains that the bar for quality has moved on. #AcademicSky #ResearchIntegrity
prolific.com
The data quality problem behind MTurk's closure | Prolific
MTurk closing to new customers is a symptom of a bigger data integrity problem in online research. Here's what panels need to do to avoid the same fate.
020
Prolific @joinprolific.bsky.social · 30/07/2026
Today at Quirk's, @andrewgordon.bsky.social and Asana's Lizzy Munro wrapped up their session on what really determines quality. Backed by a head-to-head comparison study, they shared that participant panel choice remains key, along with tips to maintain research quality. #ResearchIntegrity
040
Prolific @joinprolific.bsky.social · 30/07/2026
AI agent activity in online surveys is far less common than assumed. Across 10 sample providers, agents showed up almost only on MTurk (11-16%), elsewhere at or below 1%. @andrewgordon.bsky.social presents findings today at Quirk's, NYC. Connect if you're there 📄 #AcademicSky #ResearchIntegrity
121
Prolific @joinprolific.bsky.social · 29/07/2026
👋🗽 If you're at Quirk's in NYC today and tomorrow, come find us at Stand Mini A to talk about data quality in online research. #QuirksEvent #AcademicSky
110
Prolific @joinprolific.bsky.social · 28/07/2026
Recent findings show AI agent contamination in online research is far less prevalent than widely assumed. @andrewgordon.bsky.social presents the data this week at Quirk's, with Lizzy Munro (Asana) on what data integrity looks like in practice. 11:15 AM - July 30, Room 1. #AcademicSky #QuirksEvent
020
Prolific @joinprolific.bsky.social · 27/07/2026
Over the past few weeks, we've had the pleasure of awarding over £1000 in Prolific credit to researchers shaping the future of their fields. A look back at BEE UK, EASP, and King's Open Research Summer School 🧵 #AcademicSky #PhDSky #Research
110
Reposted by Prolific
phelimb @phe-lim.bsky.social · 01/07/2026
When we started @joinprolific.bsky.social, we were motivated by the question "what if MTurk was actually good"? It's sad to see Mturk closing it's doors, but it's not a surprise. It’s the result of years of degrading data quality and an unhealthy marketplace.
121
Prolific @joinprolific.bsky.social · 15/07/2026
If you're evaluating research platforms right now, here’s what it looks like when you set up on Prolific. Create an account, connect your preferred tool via link or API, access 300K+ verified participants and 300+ screeners, set your pay, and publish. #AcademicSky #Research
110
Prolific @joinprolific.bsky.social · 13/07/2026
New from the Oxford Internet Institute: a nationally representative survey of 2,002 UK adults on trust and use of large language models, led by Dr Florence Enock and Prof. Helen Margetts. Participants sourced via Prolific. You can access the report below 📄
020
Prolific @joinprolific.bsky.social · 08/07/2026
MTurk closes to new customers on July 30. We want to make moving your research over to Prolific as easy as possible, starting with $50/£50 toward your first study. Here's how to get started on Prolific in 15 minutes ⬇️ #AcademicSky #MTurk
140
Prolific @joinprolific.bsky.social · 08/07/2026
Big day for our AI research team at #ICML2026 in Seoul 🧪 Prolific's Nora Petrova and John Burden presented "Pressure Reveals Character" - a benchmark of 904 alignment scenarios testing how 24 frontier models behave under realistic pressure. 📎 arxiv.org/abs/2602.20813 | @icmlconf.bsky.social #MLSky
The first print page of the ICML spotlight paper titled "Pressure Reveals Character: Behavioural Alignment Evaluation at Depth."The second print page of the ICML spotlight paper titled "Pressure Reveals Character: Behavioural Alignment Evaluation at Depth."
230
Prolific @joinprolific.bsky.social · 06/07/2026
📊 Conjointly's 2026 panel experience survey ranked Prolific #1 across participant satisfaction, earnings, and monthly survey completions out of 11 panels. 98% rated our platform easy to use. 96% would recommend us! #MarketResearch #Research #AcademicSky
110
Prolific @joinprolific.bsky.social · 26/06/2026
We're thrilled to share that Prolific is joining as an industry research partner on a new AI4CI Hub grant project 🎉 "Learning Together: Designing Inclusive Human-AI Teams for Collective Decision-Making", led by Dr. Zheng Yuan at @sheffielduni.bsky.social. More details below ↓ #AcademicSky #MLSky
120
Reposted by Prolific
Tom Hosking @tomhosking.bsky.social · 16/06/2026
Thanks to @joinprolific.bsky.social for having us on their Frontier Series podcast! Come for the discussion on LLM evaluation (if a model says something, do we know it's using that information internally?), stay for the detailed instructions on cooking an omelette 🍳 www.youtube.com/watch?v=J2qL...
youtube.com
LLM Training as Lossy Compression | Cohere & Princeton University | The Frontier Series: Episode 4
YouTube video by Prolific
031
Reposted by Prolific
phelimb @phe-lim.bsky.social · 12/06/2026
This one's been a long time coming! Longitudinal projects are live now on @joinprolific.bsky.social, a dedicated way to run multi-wave research from start to finish.
021
Prolific @joinprolific.bsky.social · 08/06/2026
Congratulations to our AI researchers Nora Petrova and John Burden whose paper has been accepted as a spotlight paper at ICML 2026 🧪🎉 "Pressure Reveals Character" tests how frontier models behave under realistic pressure, not just what they say they'd do. @icmlconf.bsky.social #MLSky #Research
A cover photo showing two author names and headshots of the research paper titled "Pressure Reveals Character: Behavioural Alignment Evaluation at Depth" with an indicative label that it has been accepted at the ICML 2026 conference. A coloured deep purple image on the right side containing the Prolific and ICML logos.
150
Prolific @joinprolific.bsky.social · 05/06/2026
Longitudinal studies have always been a pain to run online. Every wave a separate study, allowlists by hand, attrition tracked in spreadsheets. You can now do it all in one organized flow on Prolific. #AcademicSky #BehavioralScience #Research
131
Prolific @joinprolific.bsky.social · 30/05/2026
If you're at the @psychscience.bsky.social (APS) Annual Convention and haven't stopped by the Prolific booth yet, we'd love to hear from you. Head over to booth #5 in the exhibit hall to find out how we can support your behavioral research. #APS26BCN #AcademicSky #PsychSciSky #Research
160
Reposted by Prolific
Association for Psychological Science @psychscience.bsky.social · 30/05/2026
Views from #APS26BCN
0151
Prolific @joinprolific.bsky.social · 30/05/2026
Dr @andrewgordon.bsky.social presented "Not All Samples Are Created Equal" at #APS26BCN this week - the most comprehensive comparison of data quality across online sample providers to date. Critical work for researchers making platform decisions. @psychscience.bsky.social #AcademicSky #Research
060
Prolific @joinprolific.bsky.social · 15/05/2026
Fraud in online samples is at an all-time high, and platform choice matters. This afternoon at AAPOR, @andrewgordon.bsky.social presents "Not All Samples Are Created Equal," the largest benchmarking study of data quality across sample providers. 🕓 4:00 PM 📍 Beaudry B, Lobby Floor #AAPOR #Research
020
Prolific @joinprolific.bsky.social · 14/05/2026
Be sure to say hello to the Prolific team at booth #105 if you're at AAPOR this week! We're available throughout the conference to show you how we uphold online data quality, support longitudinal research, and tackle the growing challenge of survey fraud. @aapor.bsky.social #ResearchIntegrity
020
Prolific @joinprolific.bsky.social · 14/05/2026
Can AI replace human respondents? At AAPOR, @andrewgordon.bsky.social presented a benchmark of synthetic survey data against real human polling across multiple question domains, subgroups, and levels of specification. More from Andrew this Friday. @aapor.bsky.social #AcademicSky #Research
030
Prolific @joinprolific.bsky.social · 08/05/2026
Prolific is coming to the AAPOR Conference in LA with a packed schedule. Staff Researcher @andrewgordon.bsky.social will be presenting a workshop and three key projects on the central themes of research trust and data quality 🧵 #AAPOR #AcademicSky #ResearchIntegrity
110
Prolific @joinprolific.bsky.social · 01/05/2026
When tested against seven key AI agent detection methods, Prolific's bot authenticity checks were the only method to achieve 100% accuracy with zero false positives. Read the full methodology from @andrewgordon.bsky.social: www.prolific.com/resources/au... | #AcademicSky #ResearchIntegrity
prolific.com
Authenticity checks detect AI agents best | Prolific
How we tested the most accurate method for identifying agentic AI
120
Reposted by Prolific
Dalmeet Singh Chawla @dalmeet.bsky.social · 30/04/2026
AI chatbots aren’t yet completing online research surveys widely, according to a new study. My latest for @retractionwatch.com: retractionwatch.com/2026/04/30/a... @joinprolific.bsky.social, @davmicrot.bsky.social, @justinsulik.bsky.social, @seanjwestwood.bsky.social
retractionwatch.com
Are AI chatbots infiltrating online survey data? Not yet, says new study
Mohamed Nohassi/Unsplash Despite concerns some have raised about potentially compromised data, AI chatbots aren’t yet completing online research surveys widely, according to a new preprint.  T…
044
Prolific @joinprolific.bsky.social · 28/04/2026
Five days in Rio saw a lot of great research, scientific conversations, and connections at ICLR 🧪 Here's an #ICLR2026 highlights thread. @iclr-conf.bsky.social | #MLSky #AcademicSky #ArtificialIntelligence #Research
A group photo of dinner guests captured at night in Rio de Janeiro, during the ICLR Conference.
120
Prolific @joinprolific.bsky.social · 26/04/2026
Tomorrow our sciences team are presenting "The Missing Red Line" at the #ICLR2026 ICBINB workshop which focuses on where LLMs need to improve and what rigorous failure audits reveal. Our researchers tested 8 frontier models in scenarios where commercial objectives conflict with user safety. 1/4 🧪
ICLR conference poster image for the paper titled "The Missing Red Line" that shows a summary and key findings from the research by Prolific's sciences team. The thread talks about these findings as the paper will be featured at an upcoming workshop.
120
Prolific @joinprolific.bsky.social · 25/04/2026
On our way to Sugarloaf Mountain for dinner with the AI research community ⛰️ #ICLR2026
030
Prolific @joinprolific.bsky.social · 25/04/2026
Nice to see a packed room for our #ICLR2026 expo talk! Enzo, VP of Data & AI, and John, Sr. AI Research Engineer, shared lessons learned from building evaluation infrastructure for frontier AI and research. They talked about what works and surfaced the failures that matter. #ICLR #MLSky #Research
120
Prolific @joinprolific.bsky.social · 25/04/2026
Come to our expo! Enzo and John from our sciences team will be in room 202C from 12:45 PM to talk about why frontier AI teams are outgrowing their evaluations and what it takes to build evaluation infrastructure that keeps pace. #ICLR2026 #ICLR #MLSky #ArtificialIntelligence
030
Prolific @joinprolific.bsky.social · 24/04/2026
Today at #ICLR2026, our Sr. AI Research Engineer John Burden presents work from his time at CFI @cam.ac.uk on formalizing human-in-the-loop setups through computability theory. Legal status and safety implications vary considerably depending on how human oversight is structured. #MLSky #AcademicSky
110
Prolific @joinprolific.bsky.social · 24/04/2026
We'll be at booth #206 in Pavilion 4 all day for those who want to stop by for a demo. Prolific gives AI research teams access to 200K+ verified, demographically diverse participants via platform or API, helping manage your pipeline from study design to data delivery. #ICLR2026 #ICLR #MLSky #AI
010
Prolific @joinprolific.bsky.social · 24/04/2026
👋 Onto another day at @iclr-conf.bsky.social. Come say hello to our team members at booth #206! Our Sr. AI Research Engineer John Burden (prev. CFI at Cambridge) is also presenting his co-authored paper on formalizing human-in-the-loop setups today @ 3:15 PM. Poster session 4, Pavilion 4. #ICLR2026
010
Prolific @joinprolific.bsky.social · 23/04/2026
🗣️ Our Staff Research Engineer Nora at ICLR on what's broken in AI evaluation. Current evals involve too little human feedback and overfocus on technical capabilities. Human preference cannot be faithfully simulated with synthetic data despite having its place. #ICLR2026 #ICLR #MLSky #Research
110
Reposted by Prolific
Microsoft Research @msftresearch.bsky.social · 23/04/2026
Congratulations to Philippe Laban, Jennifer Neville, and collaborators on their Best Paper Award at ICLR 2026 for “LLMs Get Lost In Multi-Turn Conversation.” msft.it/6017vE12f
173
Prolific @joinprolific.bsky.social · 23/04/2026
📄 Today our researchers are presenting HUMAINE at #ICLR2026. HUMAINE is a living LLM evaluation benchmark built on demographically stratified human preference data, post-stratified to census data across the US and UK. Come along to the poster - P4-#4008, 3:15 PM. #ICLR #Research #MLSky #AcademicSky
220
Prolific @joinprolific.bsky.social · 23/04/2026
Come find us at booth #206 throughout @iclr-conf.bsky.social to see what Prolific can do for your AI evaluation infrastructure. We also have a raffle running. Share your hot take on AI evaluation with us and we'll throw it out to our participants. You could win a Mac mini. 🖥️ #ICLR2026 #ICLR #MLSky
020
Prolific @joinprolific.bsky.social · 23/04/2026
Already a packed booth this morning at #ICLR! Prolific sources 200K+ diverse participants to power your evaluation infrastructure. Check us out and share your hot takes - Booth #206, Pavilion 4. #ICLR2026 #MLSky #Research #ArtificialIntelligence @iclr-conf.bsky.social
020