Sign in

Prolific

@joinprolific.bsky.social
412 followers 1.4K following 336 posts

The ultimate human data platform to power world-changing AI and research. 🔗 www.prolific.com

PostsRepliesMedia
Prolific @joinprolific.bsky.social · 03/10/2026
Our in-house research team found that giving models more information makes synthetic data less accurate. At TMRE, Eric Mercadante (Research Scientist) will discuss why, and what it means for researchers. Be sure to also meet our team and grab swag at Booth #412. #TMRE #MarketResearch #AcademicSky
040
Prolific @joinprolific.bsky.social · 02/10/2026
It was good to meet researchers at ACR Chicago last week! Simon Jones presented on agentic incidence and data quality in online samples, our Beat the Bot game had people spot AI-written answers to win $50 (8 got a perfect score), and we talked research challenges with attendees. #ACR #AcademicSky
031
Prolific @joinprolific.bsky.social · 22/09/2026
We're heading to ACR 2026 in Chicago. Booth #2, Sept 25-26. Talk to us about your research challenges and hear from Simon Jones on agentic incidence, Sept 25 from 8:20 AM. You can enter our raffle too for a chance to win $500 in Prolific credits. #ACR #ConsumerResearch #AcademicSky
020
Prolific @joinprolific.bsky.social · 15/09/2026
#3 Small, often opaque choices in how AI is used can produce meaningful differences in research outputs. The case here is for transparency over fixed standards. Rules get outpaced by the tech, but transparency lets researchers judge what's appropriate for their own case as things keep changing.
000
Prolific @joinprolific.bsky.social · 15/09/2026
#2 Synthetic data isn't one debate, it's at least three: pretesting, imputation, and full replacement, each with a different risk profile. David's take is that top-line signals hold up, granular accuracy doesn't, and the real future is human-in-the-loop, not replacement.
100
Prolific @joinprolific.bsky.social · 15/09/2026
#1 Most survey research has no ground truth to check against. David argues this is why removing the human respondent is the highest-risk move available. Total survey error only works as a framework because there's a human at the end of it to validate against.
100
Prolific @joinprolific.bsky.social · 15/09/2026
Three notable insights from The Signal. A recent conversation with David Rothschild from Microsoft Research and the AAPOR AI task force, about AI in survey research. 🧵 #AcademicSky #Research
open.spotify.com
The Signal
Podcast · Prolific · The Signal is Prolific's podcast on research evidence - not tools, not trends, but findings from the field about how data collection actually works, and what that means for anyone...
110
Prolific @joinprolific.bsky.social · 15/09/2026
Sorry to hear that - do you have a ticket number from your thread to hand so we can find out what happened?
000
Prolific @joinprolific.bsky.social · 09/09/2026
In 24 hours, @andrewgordon.bsky.social and Becca Richards will be diving into what makes a research platform trustworthy. We’ve already had great questions around data quality which we'll answer live tomorrow, 12 PM EDT / 5 PM BST. 🔗 riverside.com/webinar/regi... | #AcademicSky #ResearchIntegrity
020
Reposted by Prolific
phelimb @phe-lim.bsky.social · 09/09/2026
Today we launched The Signal, Prolific's new podcast on research evidence, not research tools or trends. David and Andrew discussed what research quality looks like once you remove the human from the process. Give it a watch!
011
Reposted by Prolific
David Rothschild @davmicrot.bsky.social · 08/09/2026
This was a fun & interesting conversation about AI & survey research.
062
Prolific @joinprolific.bsky.social · 08/09/2026
Links 🔗 Watch on YouTube → youtu.be/lUFiQTKz0iU Listen on Spotify → open.spotify.com/episode/0lz7... Listen on Apple Podcasts → podcasts.apple.com/us/podcast/r...
youtu.be
Rethinking Survey Research in the Age of AI with Microsoft Research’s David Rothschild | The Signal
YouTube video by Prolific
000
Prolific @joinprolific.bsky.social · 08/09/2026
Has AI been a net positive or negative for survey research? In episode 1 of The Signal, @davmicrot.bsky.social (Microsoft Research, AAPOR) joins @andrewgordon.bsky.social on where AI helps, where synthetic data breaks down, and why transparency beats standards. #AcademicSky #ResearchIntegrity
140
Prolific @joinprolific.bsky.social · 02/09/2026
Register here: riverside.com/webinar/regi... And bring your questions for the live Q&A!
riverside.com
Riverside Studio
010
Prolific @joinprolific.bsky.social · 02/09/2026
MTurk's full closure has researchers rethinking online recruitment. Join @andrewgordon.bsky.social and Becca Richards for a fireside chat on participant vetting, platform design, and data quality, backed by years of independent research. 🗓️ Thu Sept 10, 12:00 PM EDT / 5:00 PM BST. #AcademicSky
130
Prolific @joinprolific.bsky.social · 26/08/2026
"Do Richer Personas Improve LLM Survey Simulation? A Fidelity Paradox" pre-print here: papers.ssrn.com/sol3/papers.... Authors: @andrewgordon.bsky.social, Nora Petrova, John Burden, @orioljbosch.bsky.social, Ning Ding. #SyntheticData #Research
papers.ssrn.com
020
Prolific @joinprolific.bsky.social · 26/08/2026
New research: We tested whether LLM personas can reproduce real survey data, benchmarked against nearly 1,000 real Americans, from zero-context to full digital twins. Richer personas made polls worse. What matters is how you ask - LLMs predict opinion, rather than measure it. #AcademicSky #Research
170
Reposted by Prolific
Kevin Collins @kwcollins.bsky.social · 24/08/2026
Big new paper from Andrew Gordon and the team at @joinprolific.bsky.social casting *more* cold water on synthetic sampling, both in political and consumer domains, though with some interesting nuances that make the paper worth reading in full. papers.ssrn.com/sol3/papers....
0114
Reposted by Prolific
Andrew Gordon @andrewgordon.bsky.social · 20/08/2026
New preprint out today from the @joinprolific.bsky.social research team: "Do Richer Personas Improve LLM Survey Simulation? A Fidelity Paradox". papers.ssrn.com/sol3/papers.... [1/6]
papers.ssrn.com
Do Richer Personas Improve LLM Survey Simulation? A Fidelity Paradox
Large language models (LLMs) are increasingly proposed as substitutes for human survey respondents, despite documented failures in their accuracy and realism. W
131
Prolific @joinprolific.bsky.social · 05/08/2026
We're heading to #APA2026 in Washington, D.C., Aug 6-8. 📍 Catch Andrew Gordon's talk "Not All Samples Are Created Equal," comparing data quality across 12 major online sample providers (N = 4,800). Thursday, Aug 6 @ 10-11 AM, Room 147B. Find us at Booth #461 all week. #AcademicSky
030
Prolific @joinprolific.bsky.social · 03/08/2026
Amazon MTurk just closed to new customers as of July 30, 2026. It solved a genuine problem for researchers in its early days, but its drop in data quality became hard to ignore. @andrewgordon.bsky.social explains that the bar for quality has moved on. #AcademicSky #ResearchIntegrity
prolific.com
The data quality problem behind MTurk's closure | Prolific
MTurk closing to new customers is a symptom of a bigger data integrity problem in online research. Here's what panels need to do to avoid the same fate.
020
Prolific @joinprolific.bsky.social · 30/07/2026
Today at Quirk's, @andrewgordon.bsky.social and Asana's Lizzy Munro wrapped up their session on what really determines quality. Backed by a head-to-head comparison study, they shared that participant panel choice remains key, along with tips to maintain research quality. #ResearchIntegrity
040
Prolific @joinprolific.bsky.social · 30/07/2026
See here: osf.io/preprints/ps...
osf.io
OSF
000
Prolific @joinprolific.bsky.social · 30/07/2026
AI agent activity in online surveys is far less common than assumed. Across 10 sample providers, agents showed up almost only on MTurk (11-16%), elsewhere at or below 1%. @andrewgordon.bsky.social presents findings today at Quirk's, NYC. Connect if you're there 📄 #AcademicSky #ResearchIntegrity
121
Prolific @joinprolific.bsky.social · 29/07/2026
You can also grab some free merch to take home. That includes chocolate bars that'll tempt you to snap your research time in half!
110
Prolific @joinprolific.bsky.social · 29/07/2026
👋🗽 If you're at Quirk's in NYC today and tomorrow, come find us at Stand Mini A to talk about data quality in online research. #QuirksEvent #AcademicSky
110
Prolific @joinprolific.bsky.social · 29/07/2026
Absolutely, @andrewgordon.bsky.social in particular will have plenty to say on this topic!
000
Prolific @joinprolific.bsky.social · 28/07/2026
Recent findings show AI agent contamination in online research is far less prevalent than widely assumed. @andrewgordon.bsky.social presents the data this week at Quirk's, with Lizzy Munro (Asana) on what data integrity looks like in practice. 11:15 AM - July 30, Room 1. #AcademicSky #QuirksEvent
020
Prolific @joinprolific.bsky.social · 27/07/2026
Across these events, one topic kept coming up: better data. Thank you to everyone who stopped by to chat, attended a session, or shared their work. Grateful to be part of a community raising the bar for high-quality data. See you at the next one! 👋
000
Prolific @joinprolific.bsky.social · 27/07/2026
@kingscollegelondon.bsky.social Open Research Summer School: £100 to raffle winner Maddy Devonshire (@bristoluni.bsky.social), and a roundtable where our own Senior Product Manager Emilio joined experts to discuss how researchers can keep generating trustworthy data in the age of AI.
100
Prolific @joinprolific.bsky.social · 27/07/2026
EASP (@easp2026.bsky.social): £100 each to five lucky raffle winners, amid poster sessions packed with studies citing Prolific.
100
Prolific @joinprolific.bsky.social · 27/07/2026
BEE UK: £500 to Rebecca Heath (@cam.ac.uk), our Early Career Award winner, after Dr. @andrewgordon.bsky.social took the stage to talk data quality in modern research.
100
Prolific @joinprolific.bsky.social · 27/07/2026
Over the past few weeks, we've had the pleasure of awarding over £1000 in Prolific credit to researchers shaping the future of their fields. A look back at BEE UK, EASP, and King's Open Research Summer School 🧵 #AcademicSky #PhDSky #Research
110
Reposted by Prolific
phelimb @phe-lim.bsky.social · 01/07/2026
When we started @joinprolific.bsky.social, we were motivated by the question "what if MTurk was actually good"? It's sad to see Mturk closing it's doors, but it's not a surprise. It’s the result of years of degrading data quality and an unhealthy marketplace.
121
Prolific @joinprolific.bsky.social · 15/07/2026
Get $50/£50 credit toward your first study 👉 www.prolific.com/prolific-vs-...
prolific.com
MTurk Alternative for Researchers | Prolific
Reach a diverse pool of vetted participants with Prolific to accelerate your psychological and behavioral research.
010
Prolific @joinprolific.bsky.social · 15/07/2026
If you're evaluating research platforms right now, here’s what it looks like when you set up on Prolific. Create an account, connect your preferred tool via link or API, access 300K+ verified participants and 300+ screeners, set your pay, and publish. #AcademicSky #Research
110
Prolific @joinprolific.bsky.social · 13/07/2026
New from the Oxford Internet Institute: a nationally representative survey of 2,002 UK adults on trust and use of large language models, led by Dr Florence Enock and Prof. Helen Margetts. Participants sourced via Prolific. You can access the report below 📄
020
Prolific @joinprolific.bsky.social · 10/07/2026
Sign up now to get $50/£50 credit toward your first study. Claim your credit here 🎟️ www.prolific.com/prolific-vs-...
prolific.com
MTurk Alternative for Researchers | Prolific
Reach a diverse pool of vetted participants with Prolific to accelerate your psychological and behavioral research.
020
Prolific @joinprolific.bsky.social · 10/07/2026
After you publish, authenticity checks for bot and LLM detection can be turned on for Qualtrics studies at no extra cost. Qualifying studies are also covered by our 100% Human Guarantee: prolific.com/100-human-gu...
prolific.com
Prolific 100 Human Guarantee | AI-free study data guaranteed | Prolific
Get 100% human research participants on Prolific or twice the cost of any AI participants back
100
Prolific @joinprolific.bsky.social · 08/07/2026
Sign up now to get $50/£50 credit toward your first study. You can claim your credit here 🎟️ www.prolific.com/prolific-vs-...
prolific.com
MTurk Alternative for Researchers | Prolific
Reach a diverse pool of vetted participants with Prolific to accelerate your psychological and behavioral research.
010
Prolific @joinprolific.bsky.social · 08/07/2026
Bring your existing survey link (Qualtrics, SurveyMonkey, Gorilla, Typeform, or whatever you use), set your audience with 300+ free demographic screeners, set your payment (our minimum is $8.00/£6.00 an hour, calculated for you), and publish.
100
Prolific @joinprolific.bsky.social · 08/07/2026
Create an account at prolific.com (no contract or subscription needed), verify your organization or academic affiliation, and add billing details. Pay-as-you-go, no minimum spend.
100
Prolific @joinprolific.bsky.social · 08/07/2026
MTurk closes to new customers on July 30. We want to make moving your research over to Prolific as easy as possible, starting with $50/£50 toward your first study. Here's how to get started on Prolific in 15 minutes ⬇️ #AcademicSky #MTurk
140
Prolific @joinprolific.bsky.social · 08/07/2026
@methiaff.bsky.social "realistic pressure" is putting models under conflicting instructions, simulated tool access and multi-turn escalation rather than single-turn prompts where they can just say what they'd do 🙂
000
Prolific @joinprolific.bsky.social · 08/07/2026
Spotlight papers represent the top 2.2% of 23,918 submissions at ICML 2026. Congratulations to our AI research team members for the recognition! You can explore more of their work here: labs.prolific.com
labs.prolific.com
Prolific AI Research
Prolific AI Research (PAIR) — papers, notes, and field logs on how AI systems are measured through human experience.
000
Prolific @joinprolific.bsky.social · 08/07/2026
Another spotlight was "Quantifying Frontier LLM Capabilities for Container Sandbox Escape," co-authored by Jerome Wynne with former AISI colleagues - finding that when vulnerabilities are present, frontier models can break out of their sandboxes. 📎 openreview.net/forum?id=19AbP986bv
100
Prolific @joinprolific.bsky.social · 08/07/2026
Big day for our AI research team at #ICML2026 in Seoul 🧪 Prolific's Nora Petrova and John Burden presented "Pressure Reveals Character" - a benchmark of 904 alignment scenarios testing how 24 frontier models behave under realistic pressure. 📎 arxiv.org/abs/2602.20813 | @icmlconf.bsky.social #MLSky
The first print page of the ICML spotlight paper titled "Pressure Reveals Character: Behavioural Alignment Evaluation at Depth."The second print page of the ICML spotlight paper titled "Pressure Reveals Character: Behavioural Alignment Evaluation at Depth."
230
Prolific @joinprolific.bsky.social · 06/07/2026
We've always believed that high-quality research data starts with treating participants fairly. It’s great to see this research backing that. 📄 See the full study here: conjointly.com/blog/panel-e...
conjointly.com
How do research panels compare for participants in 2026? - Conjointly
Conjointly surveyed 554 US respondents across eleven research panels in 2026 to compare panel experience and earnings, with year-on-year shifts since the 2025 study.
000
Prolific @joinprolific.bsky.social · 06/07/2026
📊 Conjointly's 2026 panel experience survey ranked Prolific #1 across participant satisfaction, earnings, and monthly survey completions out of 11 panels. 98% rated our platform easy to use. 96% would recommend us! #MarketResearch #Research #AcademicSky
110
Prolific @joinprolific.bsky.social · 26/06/2026
This project is funded by @ai4cihub.bsky.social (part of the @ukri.org AI Programme), and runs from October 2026 - September 2027. More to come as it kicks off! 🧪 #Research #AI
000