Expected Parrot @expectedparrot.bsky.social · 21/07/2025Let us know if you need help getting started and any feature requests! www.expectedparrot.com/getting-star... 000
Expected Parrot @expectedparrot.bsky.social · 21/07/2025We've been adding collaboration features that let teams work on AI+human surveys in code and interactively at once. Eg, you can create a survey with our open-source package EDSL or using our no-code builder, and invite collaborators to contribute using whichever approach works for them: 100
Expected Parrot @expectedparrot.bsky.social · 21/07/2025A key feature of our platform is that you can choose whether to use your own API keys for LLMs and human participant platforms, use an Expected Parrot key for unified access, or mix and match keys as desired: blog.expectedparrot.com/p/bring-your...blog.expectedparrot.comBring your own keys or mix and matchA key feature of Expected Parrot is that you can always use your own keys for LLMs and human participant platforms, or you can use your Expected Parrot key for unified access. 000
Expected Parrot @expectedparrot.bsky.social · 28/06/2025We've made some big improvements for running LLM experiments and hybrid AI + human surveys on our platform! Update your EDSL version to get all the latest features: 000
Expected Parrot @expectedparrot.bsky.social · 25/05/2025Sometimes you need to check your LLM answers with real respondents. Our tools make it easy to launch a web-based version your LLM survey, combine human and LLM results, and analyze them at your dashboard or workspace. Here's a quick example: blog.expectedparrot.com/p/validate-y...blog.expectedparrot.comValidate your LLM answers with real respondentsHere's a quick example of methods for generating a web-based version of your LLM survey and analyzing human and LLM responses together at your workspace. 000
Expected Parrot @expectedparrot.bsky.social · 23/05/2025When you conduct LLM experiments at Expected Parrot 🦜 your prompts and responses are automatically cached, so you--and everyone you share your research with 🌎--can retrieve them for free 💸 and verify that you ran them ✅. 000
Expected Parrot @expectedparrot.bsky.social · 12/05/2025New blog post: Quick methods for retrieving, combining & analyzing results blog.expectedparrot.com/p/how-to-ret...blog.expectedparrot.comHow to retrieve, combine & query your saved results with SQLQuick methods for accessing and analyzing your automatically stored results from anywhere. 000
Expected Parrot @expectedparrot.bsky.social · 01/05/20253. Share your survey. When anyone reruns your prompts they can retrieve your cached responses for free.expectedparrot.comExpected Parrot 000
Expected Parrot @expectedparrot.bsky.social · 01/05/20252. Run it at Expected Parrot. Your prompts and responses are automatically cached. www.expectedparrot.com/getting-star...expectedparrot.comExpected Parrot 100
Expected Parrot @expectedparrot.bsky.social · 01/05/20251. Create a survey in EDSL, our open-source Python package for simulating experiments with AI agents and LLMs. github.com/expectedparr...expectedparrot.comExpected Parrot 100
Expected Parrot @expectedparrot.bsky.social · 01/05/2025It's a free shared resource that we created because research should be easy to share and replicate. How it works:expectedparrot.comExpected Parrot 100
Expected Parrot @expectedparrot.bsky.social · 01/05/2025🚀 Over 1 million Q&A cached and counting! The Universal Remote Cache now contains over a million unique LLM prompts and responses. You can retrieve them at no cost whenever you replicate research at Expected Parrot. blog.expectedparrot.com/p/over-1-mil...blog.expectedparrot.com🚀 Over 1 million Q&A cached and countingThe Universal Remote Cache now has over a million unique LLM prompts and responses. You can retrieve them at no cost whenever you replicate research at Expected Parrot. 100
Expected Parrot @expectedparrot.bsky.social · 28/04/2025Your account comes with $25 in credits for API calls to LLMs for getting started! www.expectedparrot.com 000
Expected Parrot @expectedparrot.bsky.social · 28/04/2025You can check current model pricing and performance daily: 100
Expected Parrot @expectedparrot.bsky.social · 28/04/2025* Methods for estimating tokens and costs for every prompt * Dashboard pages for tracking actual costs for every model and survey job 100
Expected Parrot @expectedparrot.bsky.social · 28/04/2025📢📢📢 New features for monitoring your AI research costs Our tools are designed to make it easy to understand and monitor your LLM usage. Learn more about our latest features for precisely tracking your costs: blog.expectedparrot.com/p/new-featur...blog.expectedparrot.comNew features for monitoring your AI research costsOur tools are designed to make it easy to understand and monitor your LLM usage. Learn more about our latest features for precisely tracking your costs. 110
Expected Parrot @expectedparrot.bsky.social · 22/04/2025* Unified access to language model providers with a single API key and universal methods—no software engineering required * Automatically formatted datasets of responses eliminate manual data cleaning work * Built-in methods for analyzing, reproducing and exporting results 110
Expected Parrot @expectedparrot.bsky.social · 22/04/2025Several key features of EDSL make it a convenient tool for comparing the performance of language models: blog.expectedparrot.com/p/i-want-to-...blog.expectedparrot.comI want to see how OpenAI's o3 compares to...EDSL is an open-source tool that lets you readily compare performance for many language models at once. 100
Expected Parrot @expectedparrot.bsky.social · 15/04/2025Have an idea for an LLM experiment? Here are some reasons to run it at Expected Parrot, and easy ways to get started. blog.expectedparrot.com/p/have-an-id...blog.expectedparrot.comHave an idea for an LLM experiment?Here are some reasons to run it at Expected Parrot, and easy ways to get started. 000
Expected Parrot @expectedparrot.bsky.social · 09/04/2025What are my options for running EDSL surveys? Here's a quick recap of features for specifying where and how to run your LLM-based surveys in EDSL. You can bring your own API keys for LLMs or use an Expected Parrot key to access all available models at once. blog.expectedparrot.com/p/what-are-m...blog.expectedparrot.comWhat are my options for running EDSL surveys?Here's a quick recap of features for specifying where and how to run your LLM-based surveys in EDSL. 010
Expected Parrot @expectedparrot.bsky.social · 07/04/2025Show prompts, please! EDSL makes it easy to tinker with prompts, compare responses from different language models, and replicate experiments by automatically storing all your prompts, responses and code to reproduce them. blog.expectedparrot.com/p/show-promp...blog.expectedparrot.comShow prompts, please!EDSL makes it easy to tinker with prompts, compare responses from different language models, and replicate experiments by automatically storing all your prompts, responses and code to reproduce them. 000
Expected Parrot @expectedparrot.bsky.social · 07/04/2025We launched a GPT for generating EDSL survey code - please give it a spin and let us know what you think! chatgpt.com/g/g-67d17648... 000
Expected Parrot @expectedparrot.bsky.social · 04/04/2025How do I control AI agent memory when answering my questions? EDSL provides a variety of features for controlling the context of information presented at each step of your experiment. blog.expectedparrot.com/p/how-do-i-c...blog.expectedparrot.comHow do I control AI agent memory when answering my questions?EDSL provides a variety of features for adding context of prior questions to new questions, piping answers into other questions, and asking multiple questions at once in a structured way. 000
Expected Parrot @expectedparrot.bsky.social · 02/04/2025"'Surveys' sounds niche and not what I need" Totally fair! But many research tasks and experiments can be designed as survey-like interactions. Please let us try to convince you: blog.expectedparrot.com/p/surveys-so...blog.expectedparrot.com"Surveys" sounds niche and not what I needTotally fair, but many research tasks and experiments can be designed as survey-like interactions. 000
Expected Parrot @expectedparrot.bsky.social · 27/03/2025Whether or not your ultimate research goal has anything to do with language models, using a model to perform data labeling tasks can be very helpful to your process. Here's a quick example of how to do it in EDSL: open.substack.com/pub/expected...open.substack.comHow to use a language model to label your dataI have a large collection of [texts, images, PDFs, CSVs, tables, transcripts ... ] that I need to [sort, tag, extract, clean, analyze, synthesize, summarize ... ]. 010
Expected Parrot @expectedparrot.bsky.social · 26/03/2025Do you owe someone an expense report? Here's a notebook for reading a statement, identifying reimburseables, and drafting a memo, easily modified for your own content and purposes: www.expectedparrot.com/content/Robi...expectedparrot.comExpected Parrot 000
Expected Parrot @expectedparrot.bsky.social · 19/03/2025[6/6] Check out our docs for downloadable examples that you can modify for your own data labeling tasks: docs.expectedparrot.comdocs.expectedparrot.comExpected Parrot: Tools for AI-Powered Research — edsl documentation 000
Expected Parrot @expectedparrot.bsky.social · 19/03/2025[5/6] When you share your survey, others can retrieve your responses and reproduce your results at no cost. Our universal remote cache of stored responses is free and available to all users. Learn more about how it works: docs.expectedparrot.com/en/latest/re...docs.expectedparrot.comRemote Caching — edsl documentation 100
Expected Parrot @expectedparrot.bsky.social · 19/03/2025[3/6] The steps are generalizable: 1. Import your data into EDSL 2. Create questions about the data 3. Add the data to the questions and send the job to a language model (or to many at once to compare performance) 4. Analyze responses in a formatted dataset 100
Expected Parrot @expectedparrot.bsky.social · 19/03/2025[2/6] The gist of it is that you can design a data labeling task as a survey about your data where you use a model to answer questions about the data and get the responses in a specified dataset. 100
Expected Parrot @expectedparrot.bsky.social · 19/03/2025[1/6] "How do I use EDSL for data labeling?" Really, this is a grab bag of things you might want to do, such as analyze texts, categorize images, identify and quantify themes, spot issues in your data, etc. 100
Expected Parrot @expectedparrot.bsky.social · 08/03/2025You can also add your own keys to your account, grant access to team members and set usage limits. This lets you run surveys with your own keys at our server. Learn more about options for managing keys: www.expectedparrot.com/getting-star...expectedparrot.comExpected Parrot 000
Expected Parrot @expectedparrot.bsky.social · 08/03/2025With E[P] you can run jobs locally using your own API keys for LLMs, or use our key which comes with $25 in credits. Toggle on "help me" and we'll dig into any issues with your surveys and experiments and help you fix them! 132
Reposted by Expected ParrotJeff Clement @jeffclement.bsky.social · 06/11/2024Distracting myself by fiddling with something neat...using Expected Parrot's edsl library in-stream in an R data analysis to pass data to ChatGPT (in this case for classification) and then merging the answers back into R (w/ the reticulate package in RStudio). @johnjhorton.bsky.social 021
Expected Parrot @expectedparrot.bsky.social · 06/03/2025Hello, Non-Programmer! Build & run LLM surveys w/o knowing Python: app.arcade.software/share/MbB0C3...app.arcade.softwareSurvey Builder 010
Expected Parrot @expectedparrot.bsky.social · 06/03/2025This is the kind of social media I am here for. LLMs ftw! 000