Sign in

AJ Stuyvenberg

@ajs.bsky.social
1.9K followers 238 following 325 posts

AWS Hero Staff Eng @ Datadog Streaming at: twitch.tv/aj_stuyvenberg Videos at: youtube.com/@astuyve I write about serverless minutia at aaronstuyvenberg.com/

PostsRepliesMedia
AJ Stuyvenberg @ajs.bsky.social · 12/02/2026
The clanker wars have begun:
040
AJ Stuyvenberg @ajs.bsky.social · 18/09/2025
I use AWS a ton but Lambda still astounds me. Throw some code in a function, send 1m requests as fast as you can. It ate up all available file descriptors on my little t3 box and still ran 18k RPS with a p99 of 0.3479s. Not many services can go from 0 to 18k RPS instantaneously with this p99.
1113
AJ Stuyvenberg @ajs.bsky.social · 05/08/2025
Lambda now charges for init time, so it's useful to count sandboxes which are proactively initialized but never receive a request. Here's what happens after a 10k request burst. Hundreds of sandbox shutdowns, along with 22 sandboxes which were spun up but never received a request.
150
AJ Stuyvenberg @ajs.bsky.social · 01/08/2025
Happy Lambda Init Billing day to those who celebrate. Fix your cold starts!
150
AJ Stuyvenberg @ajs.bsky.social · 01/08/2025
NEW: Lambda can now send up to 200mb payloads using response streaming! I assume this is mostly directed at LLM inference workloads, where chatbots can stream large amounts of data over the wire as it becomes available.
220
AJ Stuyvenberg @ajs.bsky.social · 30/07/2025
I've long been an advocate for the Lambda Web Adapter project which lets anyone pretty easily ship an app to Lambda without learning about the event model/API. Honestly AWS should simply support this natively.
121
AJ Stuyvenberg @ajs.bsky.social · 28/07/2025
"We run benchmarks continually across all of our competitors, not just queries - even connections, ensuring we don't add any latency at all." @isamlambert Performance is such a competitive advantage which easily slips away if you're not constantly paying attention to it.
130
Reposted by AJ Stuyvenberg
ScyllaDB @scylladb.com · 23/07/2025
Datadog rewrote its AWS Lambda Extension from #Golang to #Rustlang with no prior Rust experience. @ajs.bsky.social will share how they achieved an 80% Lambda cold start improvement along with a 50% memory footprint reduction at our free and virtual #P99CONF. www.p99conf.io?latest_sfdc_... #ScyllaDB
063
AJ Stuyvenberg @ajs.bsky.social · 22/07/2025
Here's another 33% cold start reduction, which comes from deferring expensive decryption calls made to AWS Secrets Manager until the secret is actually needed. Lazy loading is great!
131
AJ Stuyvenberg @ajs.bsky.social · 18/07/2025
Here's how to visualize a 100% memory allocation improvement! A recent stress test revealed that malloc calls bottlenecked when sending > 100k spans through the API and aggregator pipelines in Lambda.
210
AJ Stuyvenberg @ajs.bsky.social · 17/07/2025
NEW: A recent blog post went viral in the AWS ecosystem, about how there's a silent crash in AWS Lambda's NodeJS runtime. Today I'll step you through the actual Lambda runtime code which causes this confusing issue, and walk you through how to safely perform async work in Lambda:
370
AJ Stuyvenberg @ajs.bsky.social · 14/07/2025
Lambda's fleet management shutdown algorithm is learning faster! I'm calling this function every 8 or so minutes. At first the gap from invocation to shutdown is about 5-6 minutes, which was the fastest I've observed during previous experiments.
130
AJ Stuyvenberg @ajs.bsky.social · 11/07/2025
NEW: AWS is rolling out a new free tier beginning July 15th!! New accounts get $100 in credits to start and can earn $100 exploring AWS resources. You can now explore AWS without worrying about incurring a huge bill, this is great! docs.aws.amazon.com/awsaccountbi...
062
AJ Stuyvenberg @ajs.bsky.social · 10/07/2025
You should care about your p99! By improving the function cold start time, the service on the left performed: 2x faster in RPS and thus, duration. p99 from 1.52s -> .949s The code and functionality is identical, but improving the cold start from 816ms to 301ms made all the difference.
010
AJ Stuyvenberg @ajs.bsky.social · 08/07/2025
Quick PSA to make sure you're using a DLQ and setting a max receive count for SQS, otherwise you may find yourself looking at a flamegraph like this. Hundreds of attempts, multiple messages in queue and not burning down and average age of message ticking up! Seems common knowledge, but...
030
AJ Stuyvenberg @ajs.bsky.social · 03/07/2025
Real-time audio processing is an extremely interesting corner of performance engineering. You've gotta process data faster than it streams in, otherwise the work is wasted. The engineering team behind CoScreen just open sourced a new library, dtln-rs, suitable for removing noise from all kinds
datadoghq.com
How we built a real-time, client-side noise suppression library without server dependencies | Datadog
Learn how we implemented and open-sourced a noise filter for real-time audio chat without compromising performance. Better yet, try the demo and add it to your own project today.
131
AJ Stuyvenberg @ajs.bsky.social · 29/05/2025
Monitoring Lambda sandbox shutdowns reveals an interesting scaling behavior After a request spike, Lambda waits ~10m before reaping 2/3rds of sandboxes. 5m later it begins reaping the rest. Presumably this helps smooth latency during retry storms, or if traffic returns!
020
AJ Stuyvenberg @ajs.bsky.social · 21/05/2025
Here's another huge p99 cliff! One unreasonably effective way to lower the average latency of a service is to minimize the causes of p99 events. Here, we've managed to absolutely crush the Max Post Runtime Duration from ~80ms to 500µs!
110
AJ Stuyvenberg @ajs.bsky.social · 06/05/2025
Truly incredible to learn that Epic Games isn't self hosted on a VPS.
020
AJ Stuyvenberg @ajs.bsky.social · 01/05/2025
PRICE CUT: Lambda slashes the price of cloudwatch logs for high volume. From $.50/gb down to $0.05/gb after 50TB. You've gotta be spending a decent chunk of $$$ on cloudwatch logs for this to help, but still – a price cut is a price cut!
130
AJ Stuyvenberg @ajs.bsky.social · 01/05/2025
Combining profiler data with claude code feels super powerful. Just drop a pprof file into a project, explain the dimensions of the profile, then let the LLM make suggestions to solve the hot spots. Instant performance boost
130
AJ Stuyvenberg @ajs.bsky.social · 29/04/2025
NEW: AWS Lambda will now begin billing for the INIT phase for all runtimes (not just custom/container runtimes). Your cold starts cost money now! My hottest take is that AWS should have done this years ago.
5173
AJ Stuyvenberg @ajs.bsky.social · 23/04/2025
The evolution of my program when each branch is benchmarked & profiled before merging
140
Reposted by AJ Stuyvenberg
David Behroozi @rootothez.bsky.social · 22/04/2025
The latest cover for Cold Start Aficionado magazine. w/ @ajs.bsky.social
031
AJ Stuyvenberg @ajs.bsky.social · 10/04/2025
Check out that p99 cliff! I spent 2024 shipping our next-generation Lambda Extension, which offers an 82% improvement in cold start time, better aggregation and flushing options, and lower overall overhead – all in a substantially smaller binary package. More: www.datadoghq.com/blog/enginee...
2120
AJ Stuyvenberg @ajs.bsky.social · 10/03/2025
Cloudflare isn't pulling any punches with this twitter outage. Absolutely brutal:
0110
AJ Stuyvenberg @ajs.bsky.social · 15/02/2025
Absolutely incredible piece about a font you've seen everywhere:
061
AJ Stuyvenberg @ajs.bsky.social · 22/01/2025
🚨 NEW VIDEO: Good clocks could be huge for us devs – so now I've finally made a video about databases, how they are distributed, and why precise clocks can change things. This can also go horribly wrong, so we'll cover that too. Check it out – buff.ly/4hhkVtw
183
AJ Stuyvenberg @ajs.bsky.social · 19/12/2024
Although the market is decidedly less frothy and VC money is harder than ever to raise, startups can still win – and win big. Resharing this story about how WarpStream reinvented Kafka and walked away with $220 in only 13 months. buff.ly/400AYpJ
250
AJ Stuyvenberg @ajs.bsky.social · 17/12/2024
Should you use Lambda Function Warmers in 2025? Probably not! Here's some preliminary data. It's 200 requests at around 20 requests per second (2 runs). The warmer function attempts to create 10 concurrent sandboxes. Notice that the number of cold starts (~75) is the same!
180
Reposted by AJ Stuyvenberg
Marc Brooker @marcbrooker.bsky.social · 16/12/2024
My second re:Invent talk is up! In this talk, I dive into the internals of thew new Aurora DSQL, looking at how we achieve each of the ACID properties, and highlight some of the decisions we made as we designed the product. www.youtube.com/watch?v=huGm...
youtube.com
AWS re:Invent 2024 - Deep dive into Amazon Aurora DSQL and its architecture (DAT427-NEW)
YouTube video by AWS Events
2305
Reposted by AJ Stuyvenberg
Liz Fong-Jones (方禮真) @lizthegrey.com · 16/12/2024
aws.amazon.com/ec2/faqs/#t4... - yes, T4g instances are free for the next year plus. You also get 30GB of EBS, and plenty of bandwidth out to the public internet for personal use (100GB). #AWS #ListenToTheHeroes
aws.amazon.com
Amazon EC2 T4g Instances - Amazon Web Services
T4g instances powered by AWS Graviton2 processors provide best price performance for burstable general purpose workloads in Amazon EC2.
44516
AJ Stuyvenberg @ajs.bsky.social · 11/12/2024
AWS will continue to dominate in 2025 because they pursue a competitive edge everywhere. Like this: AWS sped up light 47%(!!!) through their fiber optic backbone network by developing hollow core fiber optics.
4302
AJ Stuyvenberg @ajs.bsky.social · 07/12/2024
Huge if true!
150
Reposted by AJ Stuyvenberg
Luc van Donkersgoed @lucvandonkersgoed.com · 05/12/2024
Thank you @werner.social for the great shout out to the AWS Heroes ❤️ This is the smartest, friendliest, and simply *best* group of people I've ever been part of, and I am forever grateful for AWS' sponsorship 🙏
14819
Reposted by AJ Stuyvenberg
Chris Williams☁️🐍 @mistwire.com · 05/12/2024
The AWS Heroes program is something very special. The REAL heroes are the AWS employees who we've worked with for years. Thank you @werner.social, @rossbarich.bsky.social, @farrah.bsky.social, & everyone else who I can't find in here yet 😂🥰
65821
Reposted by AJ Stuyvenberg
Taylor @arcticf0xx.com · 05/12/2024
Heroes, you’re truly an inspiration to us all. I’m grateful to work hard and play hard with such incredible humans.
4408
Reposted by AJ Stuyvenberg
Gunnar Grosch @gunnargrosch.com · 05/12/2024
Excited to do another episode of Step up your GameDay! live from AWS re:Invent today at 2 pm PT / 11 pm CET! We're joined by AWS Serverless Heroes @danielleheberling.xyz and @kristiperreault.bsky.social. Will they do better than @ajs.bsky.social did on Monday? Highly likely! 😅 twitch.tv/awsonair/
032
AJ Stuyvenberg @ajs.bsky.social · 04/12/2024
Aurora DSQL's connection pools are fast 🔥🔥🔥 In Lambda, getting a new token is single-digit milliseconds and making the TCP connection to the cluster (purple line) was only 11ms in this traced example:
1203
AJ Stuyvenberg @ajs.bsky.social · 03/12/2024
NOW LIVE FROM REINVENT with Darko talking about why Rust pairs so perfectly with Lambda. We'll talk about our latest innovations with Rust at Datadog, and build a Lambda function on stream. JOIN NOW: buff.ly/2IcvRZH
050
AJ Stuyvenberg @ajs.bsky.social · 03/12/2024
AWS just announced Aurora DSQL - a purpose built, postgres-compatible serverless database and take it from me - it's amazing. I've had a few months to play with it (more soon), but it's truly the single most exciting launch I've seen from AWS in a while. You've gotta try it
7416
AJ Stuyvenberg @ajs.bsky.social · 03/12/2024
Keynote time from the AWS Hero section!! I woke up super early for this so I'm hoping for a big announcement...
1150
AJ Stuyvenberg @ajs.bsky.social · 02/12/2024
I can confirm that the Datadog slide is a lot of fun!! Go get your badge scanned and ride it, then I'll personally call each and every one of you and pitch you Datadog's Serverless monitoring!
1191
AJ Stuyvenberg @ajs.bsky.social · 02/12/2024
Hallway selfie time is in full swing
060
Reposted by AJ Stuyvenberg
Chris Williams☁️🐍 @mistwire.com · 02/12/2024
Sunday night #reinvent dinner with AWS Heroes, @vbrownbag.com hosts, HashiCorp, & AWS Community🥰🥰🥰 @rossbarich.bsky.social @michaelkosir.com @bschaatsbergen.com @justjewels.bsky.social @brookejamieson.bsky.social @matthewbonig.bsky.social @ajs.bsky.social @giftedlane.bsky.social
Group of dear friends at a dinner table. Except Bonig. Everyone hates Bonig.
2343
AJ Stuyvenberg @ajs.bsky.social · 01/12/2024
It's re:Invent, let's gooo!
0290
AJ Stuyvenberg @ajs.bsky.social · 01/12/2024
On my way to the airport for re:Invent
kendall roy in the cab meme
0140
Reposted by AJ Stuyvenberg
Marc Brooker @marcbrooker.bsky.social · 27/11/2024
Join me! This one is sure to be a lot of fun, especially if you enjoy a technical deep dive.
0276
AJ Stuyvenberg @ajs.bsky.social · 27/11/2024
A new-launch session hosted by Marc Brooker has just popped up in the re:Invent session catalog. Seats are still available, and I'm sure you don't want to miss it.
3102
AJ Stuyvenberg @ajs.bsky.social · 25/11/2024
Super quick tip as we all get ready for re:Invent – portable humidifiers are cheap and make a huge difference in the desert of Las Vegas.
050