Sign in

Samrat Man Singh

@samrat.me
950 followers 171 following 94 posts

Software engineer; climber; #ElixirLang Website: samrat.me Building octocut.com

PostsRepliesMedia
Samrat Man Singh @samrat.me · 19/08/2025
Attending this later today. Anyone else I know going?
100
Samrat Man Singh @samrat.me · 12/06/2025
Great presentations and conversation at the Elixir Berlin Meetup today 1/ Lukas talked about his big bag of Postgres tricks and techniques #elixirlang
230
Reposted by Samrat Man Singh
Paulo Valente @polvalente.social · 11/05/2025
I've just released Handoff, a new Elixir library for distributed function graph execution. hexdocs.pm/handoff Among other things, the library enables distributed Nx computations (anyone said distributed inference?) A huge part of this was sponsored by tvlabs.ai!
hexdocs.pm
Handoff v0.1.0 — Documentation
25715
Reposted by Samrat Man Singh
José Valim @josevalim.bsky.social · 29/04/2025
Introducing Tidewave: tidewave.ai While working on our web apps, we run code, query the database, read logs, search docs… but our AI tools are limited to reading code. Tidewave closes this gap by introducing Runtime Intelligence, for Phoenix and Rails. More coming soon, check out the website!
tidewave.ai
Tidewave
517760
Samrat Man Singh @samrat.me · 27/03/2025
Demo: Making phone calls from Elixir I'm working on a Twilio plugin for the Membrane multimedia framework. The demo shows an outbound call, but receiving calls works too. #ElixirLang www.youtube.com/watch?v=4dhl...
youtube.com
Making phone calls from Elixir using Twilio
YouTube video by Samrat Man Singh
3100
Samrat Man Singh @samrat.me · 26/03/2025
Testing Voice AI flows can become tedious fast But... you can just simulate conversations using another voice agent. Then, evaluate how the conversation went.
020
Samrat Man Singh @samrat.me · 21/03/2025
Got a small, standalone Python script working to use the new OpenAI transcription models(`gpt-4o-transcribe` and `gpt-4o-mini-transcribe`) using the Realtime WebSocket connection: samrat.me/standalone-o...
samrat.me
Standalone OpenAI transcription Python script
OpenAI announced some new audio models yesterday, including new transcription models(gpt-4o-transcribe and gpt-4o-mini-transcribe). This model performs better than Whisper, though because they are bui...
001
Samrat Man Singh @samrat.me · 20/03/2025
OpenAI's new TTS looks(and sounds) pretty great for the price. Also, I hope this pushes other providers to just price API usage by minute. Every other TTS provider(ElevenLabs, Cartesia, etc) currently have monthly credits pricing.
110
Samrat Man Singh @samrat.me · 20/03/2025
Phoenix now comes with DaisyUI. Looks like a great addition for non-designers(like me) #ElixirLang
43510
Samrat Man Singh @samrat.me · 09/03/2025
New #ElixirLang tool LivebookTools lets you work on Livebook in your own editor and opens MCP access to cell outputs(so Cursor, etc) can automatically iterate on the code if the cell has errors github.com/thmsmlr/live...
github.com
GitHub - thmsmlr/livebook_tools: Powertools for livebook.dev — AI Code Editing, MCP Servers, and Running Livebooks from the CLI
Powertools for livebook.dev — AI Code Editing, MCP Servers, and Running Livebooks from the CLI - thmsmlr/livebook_tools
1112
Reposted by Samrat Man Singh
Lars Wikman @lawik.bsky.social · 04/03/2025
What does talk-prep look like? Bug-fixin' mostly @samrat.me darling, you have a PR :D github.com/samrat/kokor...
github.com
Fix concatenation issue for tensors by lawik · Pull Request #5 · samrat/kokoro
Nx.concatenate requires the same shape and very frequently a random chunk of text would not be the right shape. So it would blow up. The concatenate was avoidable so instead of a complex padding sc...
111
Samrat Man Singh @samrat.me · 04/03/2025
Pushed my first @replicate.com model, SmolVLM2 by @hf.co (@pcuenq.hf.co et al.) Will push the 500M and 2.2B models soon as well.
040
Samrat Man Singh @samrat.me · 01/03/2025
Voice models are getting scary good. This one feels very human: www.sesame.com/research/cro...
sesame.com
Crossing the uncanny valley of conversational voice
At Sesame, our goal is to achieve “voice presence”—the magical quality that makes spoken interactions feel real, understood, and valued.
010
Samrat Man Singh @samrat.me · 20/02/2025
I wrote up a post on how you can run AI models on Elixir that aren't yet supported by Bumblebee samrat.me/running-ml-m... #MyElixirStatus #ElixirLang
samrat.me
Running ML models in Elixir using Pythonx
I just discovered Pythonx, which runs a Python interpreter in the same OS process as Elixir. Looks like it also wraps uv so it sets up a virtual environment with all the Python dependencies your code...
1225
Samrat Man Singh @samrat.me · 20/02/2025
Wow, this looks super useful for running models that aren't yet supported in Bumblebee(among other things) #ElixirLang github.com/livebook-dev...
github.com
GitHub - livebook-dev/pythonx: Python interpreter embedded in Elixir
Python interpreter embedded in Elixir. Contribute to livebook-dev/pythonx development by creating an account on GitHub.
072
Reposted by Samrat Man Singh
David Bernheisel @david.bernheisel.com · 07/02/2025
Holy smokes this is awesome, a new debugger for Phoenix LiveView. Think React devtools, but not a chrome extension. github.com/software-man... #ElixirLang
515040
Reposted by Samrat Man Singh
Xenova @xenova.bsky.social · 07/02/2025
We did it! Kokoro TTS (v1.0) can now run 100% locally in your browser w/ WebGPU acceleration. Real-time text-to-speech without a server. ⚡️ Generate 10 seconds of speech in ~1 second for $0. What will you build? 🔥
1236
Reposted by Samrat Man Singh
Samrat Man Singh @samrat.me · 05/02/2025
Interested in how to build voice AI apps in Elixir? Here's a blog post I wrote about building a Membrane pipeline that orchestrates audio/video communication between a browser and Google Gemini #ElixirLang blog.swmansion.com/building-a-m...
blog.swmansion.com
Building a Membrane Pipeline to Talk to Google Gemini
Elixir, together with the Membrane framework, is great for building pipelines that enable seamless communication between users and LLMs.
171
Samrat Man Singh @samrat.me · 05/02/2025
Interested in how to build voice AI apps in Elixir? Here's a blog post I wrote about building a Membrane pipeline that orchestrates audio/video communication between a browser and Google Gemini #ElixirLang blog.swmansion.com/building-a-m...
blog.swmansion.com
Building a Membrane Pipeline to Talk to Google Gemini
Elixir, together with the Membrane framework, is great for building pipelines that enable seamless communication between users and LLMs.
171
Reposted by Samrat Man Singh
Lars Wikman @lawik.bsky.social · 04/02/2025
Had some fun generating speech using the Elixir Kokoro implementation by @samrat.me. Made a script for typing stuff and getting the talky-talk. github.com/samrat/kokor... So a bit of ONNX, some Erlang Ports, Membrane :D #elixirlang
github.com
Mix.install-based example beyond raw audio · Issue #4 · samrat/kokoro
This will start prompting your terminal for input and speak it to your default audio output. I have this other example unrelated to TTS that includes working with files and MP3s. #!/usr/bin/env eli...
1103
Samrat Man Singh @samrat.me · 31/01/2025
Reworking the Livebook for Kokoro(🔊 text-to-speech model). Now, you get a text input to input text you want read out loud(or whispered) to you. #MyElixirStatus #ElixirLang
093
Samrat Man Singh @samrat.me · 26/01/2025
Writing up a blog post about this. Not sure how much of it should be an introduction to Membrane. #ElixirLang
051
Samrat Man Singh @samrat.me · 25/01/2025
Elixir bindings for Kokoro TTS github.com/samrat/kokoro #ElixirLang
github.com
GitHub - samrat/kokoro: Elixir bindings to Kokoro-82M text-to-speech model
Elixir bindings to Kokoro-82M text-to-speech model - samrat/kokoro
191
Samrat Man Singh @samrat.me · 07/01/2025
Oops, forgot to tag #ElixirLang
050
Samrat Man Singh @samrat.me · 07/01/2025
More voice AI exploration: Bumblebee doesn't currently support text-to-speech models, but managed to get Kokoro TTS working with Ortex Demo 👇 youtu.be/VFKX6Af9gs4
youtu.be
Elixir text-to-speech with Kokoro
YouTube video by Samrat Man Singh
1142
Reposted by Samrat Man Singh
antirez @antirez.bsky.social · 07/01/2025
Posted on HN. Feel like sharing here as well.
8536
Samrat Man Singh @samrat.me · 04/01/2025
I've been building a small voice AI app. So far, both OpenAI Realtime and Gemini Multimodal Live seem very unreliable with function calling. And Gemini insists that it did the function call😅
000
Samrat Man Singh @samrat.me · 30/12/2024
Got Gemini Multimodal Live API working with Membrane WebRTC. Here's me having a short chat with it #ElixirLang youtu.be/JxWE3pxyGqA
youtu.be
Talking to Gemini Multimodal Live with Membrane WebRTC
YouTube video by Samrat Man Singh
091
Samrat Man Singh @samrat.me · 29/12/2024
Boring title, but this is a delightful read on China, travel and life www.dwarkeshpatel.com/p/notes-on-c...
dwarkeshpatel.com
Notes on China
Last month, I spent 2 weeks in China - I visited Beijing, Chengdu, Emeishan, Chongqing, Shanghai, and Hangzhou.
000
Samrat Man Singh @samrat.me · 22/12/2024
Trying to add interruption support to github.com/membranefram... (the API already returns events for when it detects it got interrupted, but I'm having trouble stopping playback 🤔) Currently trying to wrap my head around Membrane's manual demand mode. #ElixirLang
github.com
membrane_demo/livebooks/openai_realtime_with_membrane_webrtc/openai_realtime_with_membrane_webrtc.livemd at master · membraneframework/membrane_demo
Examples of using the Membrane Framework. Contribute to membraneframework/membrane_demo development by creating an account on GitHub.
010
Samrat Man Singh @samrat.me · 13/12/2024
Current status: In Chulilla, Spain on a climbing trip.
030
Reposted by Samrat Man Singh
Paulo Valente @polvalente.social · 28/11/2024
This also makes use of MLX's lazy evaluation to provide JIT compilation of Nx functions. The README says this, but just set it as your Nx backend and compiler, and it just works!
073
Samrat Man Singh @samrat.me · 28/11/2024
The MLX(Apple Silicon) backend for Nx is now public on Github: #ElixirLang
14714
Reposted by Samrat Man Singh
Paulo Valente @polvalente.social · 25/11/2024
The homepage example from Bumblebee on using BERT is now running on EMLX! We should hopefully be releasing the library in the next few days. We're just missing a really small set of Nx.Backend calbacks and some housekeeping stuff
32010
Reposted by Samrat Man Singh
Samrat Man Singh @samrat.me · 22/11/2024
Looking for my next job! - Based in Berlin 🇩🇪, but also open to remote. - I've been most excited about #ElixirLang lately, but also open to other tech stacks(I've worked with Clojure, Rust, JS/TS) Some stuff I've worked on recently below👇. (And I'd appreciate a repost :))
12818
Reposted by Samrat Man Singh
Paulo Valente @polvalente.social · 24/11/2024
Ok, so I took this Axon example (hexdocs.pm/axon/your_fi...) for a spin on EMLX! A bit slower than Nx.BinaryBackend (runs the loop in 5s), but this is a simple model which really doesn't take advantage of a native platform. Next target is to get full Nx API coverage so we can run Bumblebee on it.
061
Samrat Man Singh @samrat.me · 23/11/2024
Finished reading "The MANIAC" by Benjamín Labatut. Wrote a short review: samrat.me/book-review-... #booksky
samrat.me
Book review: The MANIAC by Benjamín Labatut
Historical fiction about von Neumann and AI. This felt different than other historical novels I've read because as far as I could tell, there was no fictional plotlines introduced to the history. The ...
120
Reposted by Samrat Man Singh
Paulo Valente @polvalente.social · 23/11/2024
That's funny... I could swear we started this endeavor 3 days ago, not 3 weeks! Jokes aside, big shout out to @samrat.me and @uwucocoa.moe who are taking MLX coverage by stride. We're almost at a point where we can run an Axon model! Bonus: this will be plug and play with Sharding
45 failures out of 1243 tests
1124
Samrat Man Singh @samrat.me · 22/11/2024
Looking for my next job! - Based in Berlin 🇩🇪, but also open to remote. - I've been most excited about #ElixirLang lately, but also open to other tech stacks(I've worked with Clojure, Rust, JS/TS) Some stuff I've worked on recently below👇. (And I'd appreciate a repost :))
12818
Samrat Man Singh @samrat.me · 21/11/2024
GPU go brrrr, with MLX and Nx #ElixirLang
090
Samrat Man Singh @samrat.me · 20/11/2024
Any Zed users here? What do you use for AI code suggestions? The sidebar chat is really helpful, but I also would like the inline suggestions.
110
Samrat Man Singh @samrat.me · 19/11/2024
Implemented `Nx.sum` for the MLX backend. Took way longer than I'd expected 😅 #ElixirLang
260
Samrat Man Singh @samrat.me · 18/11/2024
Making some progress towards an MLX backend for Nx #ElixirLang
1184
Samrat Man Singh @samrat.me · 15/11/2024
Does this exist: vector(embeddings) search interface for fonts? Google Fonts does have a "Feeling" filter, but when I'm looking at a font, I want to find similar fonts.
000
Reposted by Samrat Man Singh
Gordon Guthrie @foundationsofthedigitalstate.com · 14/11/2024
Looking for work - 22 years #Erlang, 8 years #ElixirLang Done startups, big corps, got the dizzy heights of VP Eng with 350 staff, worked on small teams - wanna do cool shit Seeing as the BEAM community is blowing up here This is the stuff I know do read it and share it
35728
Samrat Man Singh @samrat.me · 14/11/2024
Interesting. The Remotion devs have shared a system prompt that teaches LLMs about the library. Seems to work really well with Sonnet too-- different kind of "text-to-video". www.remotion.dev/docs/system-...
remotion.dev
Remotion System Prompt for LLMs | Remotion | Make videos programmatically
This is a prompt that you can give to Large Language Models to teach them the mechanics and rules of Remotion.
000
Samrat Man Singh @samrat.me · 12/11/2024
Adding multimodal support for the instructor_ex Gemini adapter. Gemini Flash downsamples to 1 FPS, but it's pretty impressive to see it understand video #ElixirLang
020
Samrat Man Singh @samrat.me · 10/11/2024
Started reading this yesterday. It's a historical novel about John von Neumann's life. So far, it's very interesting.
010
Reposted by Samrat Man Singh
Chris, The 0.5x Engineer @llcoolchris.dev · 10/11/2024
What do me people use for tracing for Phoenix App? #ElixirLang
001
Samrat Man Singh @samrat.me · 06/11/2024
I was looking for a FLAME-like API that worked with existing nodes in a cluster. ("FLAME, but without autoscaling") Here's my attempt at creating that using `pg` and DynamicSupervisors: samrat.me/elixir-distr... #ElixirLang
samrat.me
Implementing distributed pooling in Elixir
In Elixir, once you have clustering set up, it's ridiculously easy to run some code on another node in your cluster: Node.spawn(:"another_beam_instance@10.0.1.2", fn -> # This runs on a different ...
0214