Sign in

phelimb

@phe-lim.bsky.social
93 followers 55 following 53 posts

CEO & Founder @ Prolific.com

PostsRepliesMedia
phelimb @phe-lim.bsky.social · 08/09/2026
Our team recently tested whether AI can replace human survey respondents, using simulated LLM personas against a real US survey (N = 996). Turns out demographic personas make it worse, idiographic information helps a little, and output format is the biggest lever of all. 1/2
100 1
phelimb @phe-lim.bsky.social · 01/07/2026
When we started @joinprolific.bsky.social, we were motivated by the question "what if MTurk was actually good"? It's sad to see Mturk closing it's doors, but it's not a surprise. It’s the result of years of degrading data quality and an unhealthy marketplace.
121 2
phelimb @phe-lim.bsky.social · 12/06/2026
This one's been a long time coming! Longitudinal projects are live now on @joinprolific.bsky.social, a dedicated way to run multi-wave research from start to finish.
021 2
phelimb @phe-lim.bsky.social · 04/02/2026
AI agents are becoming a serious threat to research data quality. Today we’re rolling out Bot authenticity checks on @joinprolific.bsky.social, detecting agentic AI with 100% accuracy in testing. Comes with a native Qualtrics integration! More info: www.prolific.com/resources/in...
2137 13
phelimb @phe-lim.bsky.social · 10/12/2025
Fresh HUMAINE results are here. Gemini 3 is still first, but Mistral Large 3 and Deepseek v3.2 are making things interesting. Opus 4.5 didn't dominate, but Antropic is likely prioritizing complex reasoning/coding over the conversational fluency that this benchmark favors. prolific.com/humaine
010 1