Sign in

Expected Parrot

@expectedparrot.bsky.social
27 followers 26 following 38 posts

Tools for AI-powered research www.expectedparrot.com Docs: docs.expectedparrot.com GitHub: github.com/expectedparrot/edsl Discord: discord.com/invite/mxAYkjfy9m Blog: blog.expectedparrot.com

PostsRepliesMedia
Expected Parrot @expectedparrot.bsky.social · 21/07/2025
Let us know if you need help getting started and any feature requests! www.expectedparrot.com/getting-star...
000
Expected Parrot @expectedparrot.bsky.social · 21/07/2025
Here's a quick demo:
100
Expected Parrot @expectedparrot.bsky.social · 21/07/2025
We've been adding collaboration features that let teams work on AI+human surveys in code and interactively at once. Eg, you can create a survey with our open-source package EDSL or using our no-code builder, and invite collaborators to contribute using whichever approach works for them:
100
Expected Parrot @expectedparrot.bsky.social · 21/07/2025
A key feature of our platform is that you can choose whether to use your own API keys for LLMs and human participant platforms, use an Expected Parrot key for unified access, or mix and match keys as desired: blog.expectedparrot.com/p/bring-your...
blog.expectedparrot.com
Bring your own keys or mix and match
A key feature of Expected Parrot is that you can always use your own keys for LLMs and human participant platforms, or you can use your Expected Parrot key for unified access.
000
Expected Parrot @expectedparrot.bsky.social · 28/06/2025
We've made some big improvements for running LLM experiments and hybrid AI + human surveys on our platform! Update your EDSL version to get all the latest features:
000
Expected Parrot @expectedparrot.bsky.social · 25/05/2025
Sometimes you need to check your LLM answers with real respondents. Our tools make it easy to launch a web-based version your LLM survey, combine human and LLM results, and analyze them at your dashboard or workspace. Here's a quick example: blog.expectedparrot.com/p/validate-y...
blog.expectedparrot.com
Validate your LLM answers with real respondents
Here's a quick example of methods for generating a web-based version of your LLM survey and analyzing human and LLM responses together at your workspace.
000
Expected Parrot @expectedparrot.bsky.social · 23/05/2025
When you conduct LLM experiments at Expected Parrot 🦜 your prompts and responses are automatically cached, so you--and everyone you share your research with 🌎--can retrieve them for free 💸 and verify that you ran them ✅.
000
Expected Parrot @expectedparrot.bsky.social · 12/05/2025
New blog post: Quick methods for retrieving, combining & analyzing results blog.expectedparrot.com/p/how-to-ret...
blog.expectedparrot.com
How to retrieve, combine & query your saved results with SQL
Quick methods for accessing and analyzing your automatically stored results from anywhere.
000
Expected Parrot @expectedparrot.bsky.social · 01/05/2025
3. Share your survey. When anyone reruns your prompts they can retrieve your cached responses for free.
expectedparrot.com
Expected Parrot
000
Expected Parrot @expectedparrot.bsky.social · 01/05/2025
2. Run it at Expected Parrot. Your prompts and responses are automatically cached. www.expectedparrot.com/getting-star...
expectedparrot.com
Expected Parrot
100
Expected Parrot @expectedparrot.bsky.social · 01/05/2025
1. Create a survey in EDSL, our open-source Python package for simulating experiments with AI agents and LLMs. github.com/expectedparr...
expectedparrot.com
Expected Parrot
100
Expected Parrot @expectedparrot.bsky.social · 01/05/2025
It's a free shared resource that we created because research should be easy to share and replicate. How it works:
expectedparrot.com
Expected Parrot
100
Expected Parrot @expectedparrot.bsky.social · 01/05/2025
🚀 Over 1 million Q&A cached and counting! The Universal Remote Cache now contains over a million unique LLM prompts and responses. You can retrieve them at no cost whenever you replicate research at Expected Parrot. blog.expectedparrot.com/p/over-1-mil...
blog.expectedparrot.com
🚀 Over 1 million Q&A cached and counting
The Universal Remote Cache now has over a million unique LLM prompts and responses. You can retrieve them at no cost whenever you replicate research at Expected Parrot.
100
Expected Parrot @expectedparrot.bsky.social · 28/04/2025
Your account comes with $25 in credits for API calls to LLMs for getting started! www.expectedparrot.com
000
Expected Parrot @expectedparrot.bsky.social · 28/04/2025
You can check current model pricing and performance daily:
100
Expected Parrot @expectedparrot.bsky.social · 28/04/2025
* Methods for estimating tokens and costs for every prompt * Dashboard pages for tracking actual costs for every model and survey job
100
Expected Parrot @expectedparrot.bsky.social · 28/04/2025
📢📢📢 New features for monitoring your AI research costs Our tools are designed to make it easy to understand and monitor your LLM usage. Learn more about our latest features for precisely tracking your costs: blog.expectedparrot.com/p/new-featur...
blog.expectedparrot.com
New features for monitoring your AI research costs
Our tools are designed to make it easy to understand and monitor your LLM usage. Learn more about our latest features for precisely tracking your costs.
110
Expected Parrot @expectedparrot.bsky.social · 22/04/2025
000
Expected Parrot @expectedparrot.bsky.social · 22/04/2025
* Unified access to language model providers with a single API key and universal methods—no software engineering required * Automatically formatted datasets of responses eliminate manual data cleaning work * Built-in methods for analyzing, reproducing and exporting results
110
Expected Parrot @expectedparrot.bsky.social · 22/04/2025
Several key features of EDSL make it a convenient tool for comparing the performance of language models: blog.expectedparrot.com/p/i-want-to-...
blog.expectedparrot.com
I want to see how OpenAI's o3 compares to...
EDSL is an open-source tool that lets you readily compare performance for many language models at once.
100
Expected Parrot @expectedparrot.bsky.social · 15/04/2025
Have an idea for an LLM experiment? Here are some reasons to run it at Expected Parrot, and easy ways to get started. blog.expectedparrot.com/p/have-an-id...
blog.expectedparrot.com
Have an idea for an LLM experiment?
Here are some reasons to run it at Expected Parrot, and easy ways to get started.
000
Expected Parrot @expectedparrot.bsky.social · 09/04/2025
What are my options for running EDSL surveys? Here's a quick recap of features for specifying where and how to run your LLM-based surveys in EDSL. You can bring your own API keys for LLMs or use an Expected Parrot key to access all available models at once. blog.expectedparrot.com/p/what-are-m...
blog.expectedparrot.com
What are my options for running EDSL surveys?
Here's a quick recap of features for specifying where and how to run your LLM-based surveys in EDSL.
010
Expected Parrot @expectedparrot.bsky.social · 07/04/2025
Show prompts, please! EDSL makes it easy to tinker with prompts, compare responses from different language models, and replicate experiments by automatically storing all your prompts, responses and code to reproduce them. blog.expectedparrot.com/p/show-promp...
blog.expectedparrot.com
Show prompts, please!
EDSL makes it easy to tinker with prompts, compare responses from different language models, and replicate experiments by automatically storing all your prompts, responses and code to reproduce them.
000
Expected Parrot @expectedparrot.bsky.social · 07/04/2025
We launched a GPT for generating EDSL survey code - please give it a spin and let us know what you think! chatgpt.com/g/g-67d17648...
000
Expected Parrot @expectedparrot.bsky.social · 04/04/2025
How do I control AI agent memory when answering my questions? EDSL provides a variety of features for controlling the context of information presented at each step of your experiment. blog.expectedparrot.com/p/how-do-i-c...
blog.expectedparrot.com
How do I control AI agent memory when answering my questions?
EDSL provides a variety of features for adding context of prior questions to new questions, piping answers into other questions, and asking multiple questions at once in a structured way.
000
Expected Parrot @expectedparrot.bsky.social · 02/04/2025
"'Surveys' sounds niche and not what I need" Totally fair! But many research tasks and experiments can be designed as survey-like interactions. Please let us try to convince you: blog.expectedparrot.com/p/surveys-so...
blog.expectedparrot.com
"Surveys" sounds niche and not what I need
Totally fair, but many research tasks and experiments can be designed as survey-like interactions.
000
Expected Parrot @expectedparrot.bsky.social · 27/03/2025
Whether or not your ultimate research goal has anything to do with language models, using a model to perform data labeling tasks can be very helpful to your process. Here's a quick example of how to do it in EDSL: open.substack.com/pub/expected...
open.substack.com
How to use a language model to label your data
I have a large collection of [texts, images, PDFs, CSVs, tables, transcripts ... ] that I need to [sort, tag, extract, clean, analyze, synthesize, summarize ... ].
010
Expected Parrot @expectedparrot.bsky.social · 26/03/2025
Do you owe someone an expense report? Here's a notebook for reading a statement, identifying reimburseables, and drafting a memo, easily modified for your own content and purposes: www.expectedparrot.com/content/Robi...
expectedparrot.com
Expected Parrot
000
Expected Parrot @expectedparrot.bsky.social · 19/03/2025
[6/6] Check out our docs for downloadable examples that you can modify for your own data labeling tasks: docs.expectedparrot.com
docs.expectedparrot.com
Expected Parrot: Tools for AI-Powered Research — edsl documentation
000
Expected Parrot @expectedparrot.bsky.social · 19/03/2025
[5/6] When you share your survey, others can retrieve your responses and reproduce your results at no cost. Our universal remote cache of stored responses is free and available to all users. Learn more about how it works: docs.expectedparrot.com/en/latest/re...
docs.expectedparrot.com
Remote Caching — edsl documentation
100
Expected Parrot @expectedparrot.bsky.social · 19/03/2025
[4/6] Here's a quick demo:
100
Expected Parrot @expectedparrot.bsky.social · 19/03/2025
[3/6] The steps are generalizable: 1. Import your data into EDSL 2. Create questions about the data 3. Add the data to the questions and send the job to a language model (or to many at once to compare performance) 4. Analyze responses in a formatted dataset
100
Expected Parrot @expectedparrot.bsky.social · 19/03/2025
[2/6] The gist of it is that you can design a data labeling task as a survey about your data where you use a model to answer questions about the data and get the responses in a specified dataset.
100
Expected Parrot @expectedparrot.bsky.social · 19/03/2025
[1/6] "How do I use EDSL for data labeling?" Really, this is a grab bag of things you might want to do, such as analyze texts, categorize images, identify and quantify themes, spot issues in your data, etc.
100
Expected Parrot @expectedparrot.bsky.social · 08/03/2025
You can also add your own keys to your account, grant access to team members and set usage limits. This lets you run surveys with your own keys at our server. Learn more about options for managing keys: www.expectedparrot.com/getting-star...
expectedparrot.com
Expected Parrot
000
Expected Parrot @expectedparrot.bsky.social · 08/03/2025
With E[P] you can run jobs locally using your own API keys for LLMs, or use our key which comes with $25 in credits. Toggle on "help me" and we'll dig into any issues with your surveys and experiments and help you fix them!
132
Reposted by Expected Parrot
Jeff Clement @jeffclement.bsky.social · 06/11/2024
Distracting myself by fiddling with something neat...using Expected Parrot's edsl library in-stream in an R data analysis to pass data to ChatGPT (in this case for classification) and then merging the answers back into R (w/ the reticulate package in RStudio). @johnjhorton.bsky.social
021
Expected Parrot @expectedparrot.bsky.social · 06/03/2025
Hello, Non-Programmer! Build & run LLM surveys w/o knowing Python: app.arcade.software/share/MbB0C3...
app.arcade.software
Survey Builder
010
Expected Parrot @expectedparrot.bsky.social · 06/03/2025
This is the kind of social media I am here for. LLMs ftw!
000
Reposted by Expected Parrot
⑆Luke Stein⑈ @lukestein.com · 06/03/2025
🎂 @johnjhorton.bsky.social
292