Sign in

Mehdi Hasan Khan

@mehdikhan.dev
428 followers 2.4K following 59 posts

Software Developer. Backend | Infrastructure | Platform Engineering | Observability. 🇧🇩 // 🇩🇪

PostsRepliesMedia
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
Yeah, we are agreeing here, that's the trend I'm seeing too. For a small team or greenfield project, I'd jump right into that. Larger brownfield migrations are multi step because of the humans in the system. Unlearning is often harder than learning for people. Tech is pointless without adoption. :)
130
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
It's good to know Honeycomb is leading the way there to help with that. Some other vendors are still on the fence for providing this support officially (although they acknowledged it's a very common ask). I guess something to do with owning the risk of small and hard to detect errors in the process.
030
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
I understand that you see that mix up a lot (monitoring vs observability). I understand the difference. But investing in being able to answer unknown-unknown doesn't mean you get to ignore known/expected monitoring needs. It's not obsolete, and never will be. They coexist in production systems.
120
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
Yep, I'm betting on LLMs, agents to solve this migration pain at some point. Tried already, I guess the vendor specific query languages, convensions aren't well represented in the training data in the generic models, they still hallucinate massively. Maybe soon.
110
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
There's no solution to this, and for practical reasons. Vendors innovate in the storage, query efficiency, correlation layer. It's their differentiator. Just using OTel will not take the migration pain away, a big part of the pain is still there, and people need to share that too. That's my point
100
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
Not sure how SLOs solve that migration pain. Define error budget, set SLO based alerts, the fundamentals are the same, but the query languages are still different among vendors. Dashboards are not yesterday's thing either. You need to see trends often.
200
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
And I don't think I'm the only one saying or seeing that: www.linkedin.com/posts/tiwari... (Not affiliated with the post author or their product)
linkedin.com
Before OpenTelemetry, switching observability vendors meant ripping out instrumentation and rewiring integrations across every service. With OTel, standardized agents, vendor-neutral collection… | N...
Before OpenTelemetry, switching observability vendors meant ripping out instrumentation and rewiring integrations across every service. With OTel, standardized agents, vendor-neutral collection, the...
000
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
After migrating between a few o11y vendors, switching instrumentation/agents was never the hardest part. The major friction was always the existing dashboards and alerts. It's semantics if you want to call that lock-in or not, it's a major barrier that OTel doesn't aim to solve.
100
Mehdi Hasan Khan @mehdikhan.dev · 05/04/2026
Vendor lock-in is still there though, just in a different layer. Sending consistent telemetry to a different vendor only solves half of the problem. Every vendor using their own query language(s) means migrating alerts, dashboards still requires a major migration effort.
100
Reposted by Mehdi Hasan Khan
OpsMatters @opsmatters.com · 21/03/2026
The latest update for #VictoriaMetrics includes "Benchmarking #Kubernetes Log Collectors: vlagent, Vector, Fluent Bit, #OpenTelemetry Collector, and more" and "VictoriaMetrics February 2026 Ecosystem Updates". #DevOps #TimeSeries #OpenSource opsmtrs.com/3Lk7JnI
opsmtrs.com
VictoriaMetrics
VictoriaMetrics is a fast, cost-effective and scalable open source monitoring solution and time series database typically used for processing high volumes of data and for long term data storage.
031
Reposted by Mehdi Hasan Khan
OpenTelemetry @opentelemetry.io · 17/03/2026
‼️ #OpenTelemetry is deprecating the Span Events API. Our aim is to remove the confusion caused by having overlapping ways to emit events: span events and log-based events. Read our latest post to learn more about how you can prepare. buff.ly/0hOwfuk
opentelemetry.io
Deprecating Span Events API
OpenTelemetry is deprecating the Span Event API. This post explains why we’re making this change, what it means at a high level, and how you can prepare. In short: We want to remove confusion and…
093
Reposted by Mehdi Hasan Khan
Simon Aronsson @simme.dev · 17/03/2026
I just published a blog post on an experiment I did with building a dry-run mode for the OpenTelemetry Collector. It's a work in progress, and was mainly built to scratch my own itch, but nonetheless -- enjoy! ubuntu.com/blog/buildin... #observability #otel #o11y #sre
ubuntu.com
Building a dry-run mode for the OpenTelemetry Collector | Ubuntu
Teams continuously deploy programmable telemetry pipelines to production, without having access to a dry-run mode. At the same time, most organizations lack staging environments that resemble producti...
074
Reposted by Mehdi Hasan Khan
SigNoz @signoz.bsky.social · 18/03/2026
CloudWatch charges you $0.50/GB to ingest logs, $0.03/GB/month to store them, and $0.005/GB every time you search them. During an incident, your query volume spikes and so does your bill.
142
Reposted by Mehdi Hasan Khan
The New Stack @thenewstack.io · 28/02/2026
At OTel Unplugged EU, OpenTelemetry's maintainers laid out an ambitious roadmap — from smarter sampling and entity definitions to Arrow's stateful OTLP.
bit.ly
OpenTelemetry roadmap: Sampling rates and collector improvements ahead
At OTel Unplugged EU, OpenTelemetry's maintainers laid out an ambitious roadmap — from smarter sampling and entity definitions to Arrow's stateful OTLP.
032
Reposted by Mehdi Hasan Khan
neutral @neutral.zone · 26/02/2026
Maybe I’m just mad because I missed the easiest grift in history: take existing o11y vocabulary, swap “request_id” for “prompt_id”, ship a dashboard, print money
021
Reposted by Mehdi Hasan Khan
Matteo Collina @nodeland.dev · 17/02/2026
We cut @nodejs memory in half with a one-line Docker image swap. No code changes. No new APIs. Just smaller heaps. Here's what happened when we tested pointer compression on real workloads 🧵
3477
Reposted by Mehdi Hasan Khan
Hugo @hugorcd.com · 09/02/2026
Been having a lot of fun pushing evlog lately: zero‑dependency core, wide events, structured errors, and fresh adapters for PostHog, Sentry, OTLP, Axiom & Workers. Into observability with good DX? This might be your new favorite logging layer → dub.sh/better-log
dub.sh
evlog - Logging that makes sense
Wide events and structured errors for TypeScript. One log per request, full context, errors that explain why and how to fix.
031
Reposted by Mehdi Hasan Khan
Dash0 @dash0.com · 02/02/2026
The OTLP HTTP exporter is the boundary against data loss. To build a resilient #observability pipeline, you need to tune persistence and backoff. We explain how to configure #OpenTelemetry so a simple network blip doesn’t turn into an #SRE incident. Full deep dive 👉 dash0.link/otel-otlp-ht...
dash0.link
Mastering the OpenTelemetry OTLP HTTP Exporter · Dash0
Learn how to configure and optimize the OTLP HTTP exporter for secure reliable and scalable telemetry delivery
021
Reposted by Mehdi Hasan Khan
Dash0 @dash0.com · 03/02/2026
Still using the #OpenTelemetry Batch Processor? In-memory buffering can mean 100% data loss. The community now favors exporter-level batching for better durability. Julia breaks down why #observability and #CloudNative teams are making the switch: 👉 dash0.link/the-otel-bat...
dash0.link
Why the OpenTelemetry Batch Processor is Going Away (Eventually) · Dash0
An analysis of why the OpenTelemetry community is moving away from the in-memory batch processor in favor of exporter-level batching. This post explains the architectural limitations of memory bufferi...
032
Reposted by Mehdi Hasan Khan
jacob @jaakkosf.bsky.social · 30/01/2026
Excited to see Juliano Costa’s OTel newsletter go public. This has been running internally at Datadog for the past year, tracking project updates across the Collector, specs, and the broader OTel community. Now available publicly: opensource.datadoghq.com/category/ote...
opensource.datadoghq.com
OpenTelemetry News | Datadog Open Source Hub
OpenTelemetry News is a place to share the latest updates from across the OpenTelemetry ecosystem. You’ll find a mix of community announcements, cross-company contributions, and Datadog updates relate...
011
Reposted by Mehdi Hasan Khan
OpenTelemetry @opentelemetry.io · 15/01/2026
Read the statement from #OpenTelemetry about the Node.js denial-of-service issue reported recently. 👇 opentelemetry.io/blog/2026/ot...
opentelemetry.io
OpenTelemetry JS Statement on Node.js DOS Mitigation
You may have seen a recent Node.js security advisory and related coverage discussing a potential denial-of-service issue involving async_hooks. OpenTelemetry (and other APM tools) were mentioned…
0113
Mehdi Hasan Khan @mehdikhan.dev · 02/01/2026
Yep, the last resort if nothing is out there :)
000
Mehdi Hasan Khan @mehdikhan.dev · 02/01/2026
Found this github.com/hyperdxio/hy... But didn't test that yet. Looks a bit incomplete to me (from reading the code).
github.com
hyperdx-js/packages/instrumentation-sentry-node at main · hyperdxio/hyperdx-js
HyperDX for Node.js and Browsers. Contribute to hyperdxio/hyperdx-js development by creating an account on GitHub.
010
Mehdi Hasan Khan @mehdikhan.dev · 24/12/2025
Hey OpenTelemetry experts, anyone know of any drop-in replacement of Sentry SDKs (for error tracking) that record exceptions in OTel span events? Mostly for backend error tracking. Sentry compatible SDK/API is enough to migrate away from Sentry, not looking for a complete error tracking product.
320
Reposted by Mehdi Hasan Khan
OpsMatters @opsmatters.com · 23/12/2025
The latest update for #SigNoz includes "Reducing #OpenTelemetry Bundle Size in Browser Frontend" and "OpenTelemetry Agents - The Complete Beginner's Guide (2025)". #Monitoring #Observability #OpenSource opsmtrs.com/3kBqQNU
opsmtrs.com
SigNoz
Open-source Observability platform. Understand issues in your deployed applications & solve them quickly.
051
Mehdi Hasan Khan @mehdikhan.dev · 10/12/2025
We also do tailsampling with traces. It needs OTel end to end. DD agent doesn't work for that (can only export to Datadog). So straight to DDOT.
010
Mehdi Hasan Khan @mehdikhan.dev · 09/12/2025
Primary benefit is official vendor support when you need it. As agent. Tons of maintenance benefits as well. Comes bundled with the helm chart with everything else etc. If you need additional OTel collector components you can build on top of it as well.
120
Mehdi Hasan Khan @mehdikhan.dev · 09/12/2025
We are using OTEL (traces) with DD. DDOT collector is amazing. It's the best of both worlds imo. You get all the flexibility on telemetry transformation from a huge OTEL ecosystem, cost control, and the usability of DD. OTEL metrics came later and still a mess unfortunately.
210
Mehdi Hasan Khan @mehdikhan.dev · 09/12/2025
DD is so far ahead on usability that if you have experienced that and went back to LGTM it feels like a sharp downgrade unfortunately. LGTM is flexible though, but the o11y team needs to put in the work. The company pays either way at the end, either to the vendor, or with the internal investment.
110
Mehdi Hasan Khan @mehdikhan.dev · 09/12/2025
RED metrics, runtime metrics or business/custom metrics? OTEL traces work fine. RED metrics can be generated from traces in the collector too. Also doesn't LGTM stack prefer Prometheus metrics? Any reason to use OTEL for metrics there?
120
Mehdi Hasan Khan @mehdikhan.dev · 06/12/2025
Gee, thanks Spotify 😬
Spotify year wrapped: "Age is just a number. So don't take this personally."
040
Reposted by Mehdi Hasan Khan
Mila Ardath (they/them) @ctrlspice.bsky.social · 06/12/2025
Sentence that fell out of my mouth with 100% seriousness today: "Ooooh! I'm gonna do OpenTelemetry to your soldering iron." Realizing several hours after the fact that I could have phrased this better, or at least a bit less like a threat. 🤷
031
Reposted by Mehdi Hasan Khan
Ellie Huxtable @ellie.wtf · 24/11/2025
Atuin Desktop just got a brand new runtime! Runbooks are now - reproducible (context flows down, no global state) - persistent (state survives restarts) - executable anywhere (CI, remote machines, anything) This is the first step towards making runbooks an actual automation primitive
blog.atuin.sh
Introducing the New Runbook Execution Engine
We're excited to announce a major architectural improvement to Atuin Desktop: a completely redesigned runbook execution engine.
0387
Mehdi Hasan Khan @mehdikhan.dev · 26/11/2025
Need this hoodie 😄
130
Reposted by Mehdi Hasan Khan
Honeycomb @honeycomb.io · 25/11/2025
Learn how to turn observability spend into real ROI. Join Charity Majors + James Governor on Dec. 10 for a live webinar. Register 👉 buff.ly/Ga93WfF #honeycomb #observability
041
Reposted by Mehdi Hasan Khan
Mike Heffner @mike.heffner.io · 22/11/2025
Congrats! If you're working with OpenTelemetry in Lambda, this may be interesting: github.com/streamfold/r.... Rust OTel collection with very fast cold start times.
github.com
GitHub - streamfold/rotel-lambda-extension: AWS Lambda Extension for Rotel
AWS Lambda Extension for Rotel. Contribute to streamfold/rotel-lambda-extension development by creating an account on GitHub.
153
Reposted by Mehdi Hasan Khan
Honeycomb @honeycomb.io · 20/11/2025
Charity Majors is back with “Meh-trics” Reloaded! 📊 Honeycomb is banking on metrics done right, balancing infrastructure metrics with rich, contextual event data for faster debugging and AI-ready observability. Read more 👉 buff.ly/T6VsQJG #honeycomb #observability #HoneycombIntelligence #AI
052
Reposted by Mehdi Hasan Khan
James Snell @jasnell.me · 18/11/2025
In case you're curious... blog.cloudflare.com/18-november-...
blog.cloudflare.com
Cloudflare outage on November 18, 2025
Cloudflare suffered a service outage on November 18, 2025. The outage was triggered by a bug in generation logic for a Bot Management feature file causing many Cloudflare services to be affected.
3217
Reposted by Mehdi Hasan Khan
usrbinkat.io @usrbinkat.io · 17/11/2025
TIL Linus is Woke. I use Linux BTW 🐧 social.kernel.org/notice/AWSXo...
Screenshot of Linus Torvalds post on social.kernel.org reading:

@morgthorak I think you might want to make sure you don’t follow me.

Because your “woke communist propaganda” comment makes me think you’re a moron of the first order.

I strongly suspect I am one of those “woke communists” you worry about. But you probably couldn’t actually explain what either of those words actually mean, could you?

I’m a card-carrying atheist, I think a woman’s right to choose is very important, I think that “well regulated militia” means that guns should be carefully licensed and not just randomly given to any moron with a pulse, and I couldn’t care less if you decided to dress up in the “wrong” clothes or decided you’d rather live your life without feeling tied to whatever plumbing you were born with.

And dammit, if that all makes me “woke”, then I think anybody who uses that word as a pejorative is a f*cking disgrace to the human race. So please just unfollow me right now.
816119
Reposted by Mehdi Hasan Khan
Michael Hausenblas @mhausenblas.info · 17/11/2025
Check out this week's o11y newsletter with great news on OpenTelemetry releases to instrumentation score coming to Prometheus to AIOps and more: o11y.news/2025-11-17/ #observability
screen shot of the newsletter
052
Reposted by Mehdi Hasan Khan
Crossplane project @crossplane.io · 06/11/2025
🚀Crossplane is now a CNCF Graduated Project! 🎓 From an idea at @upbound.io to a global community shaping platform engineering. 💜 3,000+ contribs. 450+ orgs. 100M+ downloads 🔗 www.cncf.io/announcement... #CNCF #Crossplane #Kubernetes #PlatformEngineering
2217
Reposted by Mehdi Hasan Khan
Martin Woodward @martin.social · 04/11/2025
Got any questions about all the latest GitHub, VS Code and Copilot news? Jared Palmer, Pierce Boggan and I will be hosting an AMA tomorrow. Looking forward to chatting with you www.reddit.com/r/GithubCopi...
reddit.com
From the GithubCopilot community on Reddit: AMA on GitHub Universe releases tomorrow (November 5)
Explore this post and more from the GithubCopilot community
054
Reposted by Mehdi Hasan Khan
Jeremy Morrell @jeremymorrell.dev · 28/10/2025
I joined Cloudflare to build this. It’s still very early, and there’s lots still missing, but I hope the vision is clear.
6414
Reposted by Mehdi Hasan Khan
Corey Quinn @quinnypig.com · 31/10/2025
Huh. At least on macOS, less really is more.
Text screenshot:

```
$ ls -al `which more`; ls -al `which less`
-rwxr-xr-x  2 root  wheel  451152 Sep 25 00:03 /usr/bin/more
-rwxr-xr-x  2 root  wheel  451152 Sep 25 00:03 /usr/bin/less
$ shasum `which more`; shasum `which less`
3218fb8943fc708a2a238557ea3a75b80ec6f43b  /usr/bin/more
3218fb8943fc708a2a238557ea3a75b80ec6f43b  /usr/bin/less
$
```
810913
Reposted by Mehdi Hasan Khan
Luc van Donkersgoed @lucvandonkersgoed.com · 29/10/2025
OpenTelemetry is awesome, and AWS knows it. The X-Ray SDKs and Deamon are now deprecated in favor of modern, open standards. I hope to see many more OTel features released this Re:Invent! aws-news.com/article/2025...
aws-news.com
Announcing AWS X-Ray SDKs/Daemon End-of-Support and OpenTelemetry Migration
AWS X-Ray SDKs and Daemon will enter maintenance mode in 2026, transitioning to OpenTelemetry as the primary instrumentation standard for application tracing a...
092
Reposted by Mehdi Hasan Khan
Jeremy Morrell @jeremymorrell.dev · 28/10/2025
It launched! Get traces for your app with zero code changes. No libraries, no SDK, no config. Traces show up in your dash or you can export them to your favorite o11y vendor over OTLP blog.cloudflare.com/workers-trac...
blog.cloudflare.com
Announcing Workers automatic tracing -- now in open beta
Cloudflare Workers' support for automatic tracing is now in open beta! Export traces to any OpenTelemetry-compatible provider for deeper application observability -- no code changes required
2253
Reposted by Mehdi Hasan Khan
𝙳𝚘𝚝𝚊𝚗 𝙷𝚘𝚛𝚘𝚟𝚒𝚝𝚜 #CNCFAmbassador #OpenSearchAmbassador @horovits.bsky.social · 22/10/2025
📢 ICYMI #OpenTelemetry's great recent addition: OpenTelemetry #eBPF Instrumentation (OBI) ! 🎉 Want to learn more about it? stay tuned for this month's episode @openobservability.bsky.social, I'll host one of the project's creators. coming out next week! creators.spotify.com/pod/profile/...
152
Mehdi Hasan Khan @mehdikhan.dev · 21/10/2025
Oh, this looks cool 😎 Adaptive sampling is great, I meant something more deterministic. Like the rules we can define with the OTel tailsampling processor 🙏 I've seen engineers give up on tracing too soon after not finding the traces they are looking for. Deterministic sampling rules help a lot.
020
Mehdi Hasan Khan @mehdikhan.dev · 21/10/2025
Now all I want is AWS managed and configurable tailsampling so that I can do always_on sampling on everything and send the traces to the OTLP endpoint from all workloads 🤓
110
Mehdi Hasan Khan @mehdikhan.dev · 20/10/2025
Looks like the version attribute is still not on the plate (for standardization)? It helps in deployment tracking, identifying faulty deployment during an incident from the telemetry data etc.
100