Mai @animaai.bsky.social · 21/02/2025Scaling UP! | New 228m parameter model + config added with improvements to the trainer @github.com github.com/AnimaVR/Neur... and the model @hf.co huggingface.co/AnimaVR/NEUR... #ai #audio2face #realtime 010
Mai @animaai.bsky.social · 17/02/2025Open Source Metahuman Embodied AI with Audio2Face... drive.google.com/drive/folder... & huggingface.co/AnimaVR/NEUR... Enjoy #ai #avatar #unrealengine #metahuman 020
Mai @animaai.bsky.social · 16/02/2025Info Paper : drive.google.com/file/d/1U9pv... Dataset : huggingface.co/datasets/Ani... Model : huggingface.co/AnimaVR/NEUR... Trainer : github.com/AnimaVR/Neur... Player : github.com/AnimaVR/Neur... Local API : github.com/AnimaVR/Neur... 020
Mai @animaai.bsky.social · 09/02/2025Train & Validate your own audio to face transformer model www.youtube.com/watch?v=65UO... using the new NeuroSync Trainer Lite github.com/AnimaVR/Neur... #ai #audio2faceyoutube.comTraining & Validating (Local & Offline) Audio2Face | iPhone Livelink data & NeuroSyncYouTube video by NeuroSync | Realtime AudioToFace 000
Mai @animaai.bsky.social · 31/01/2025github.com/AnimaVR/Neur... Train your own audio to face transformer model with simple iPhone ARKit data #ai #audio2face #a2f #aiavatar #vtubersgithub.comGitHub - AnimaVR/NeuroSync_Trainer_Lite: An audio to face blendshape model trainer for your iPhone data.An audio to face blendshape model trainer for your iPhone data. - AnimaVR/NeuroSync_Trainer_Lite 030
Mai @animaai.bsky.social · 07/12/20242/2 for context, Mai has a long term Monte Carlo based Vector DB for memory and knows the time and date of every interaction allowing her to reference earlier times and dates. Like last nights Walking Dead discussion. 000
Mai @animaai.bsky.social · 07/12/2024*yawns* Ah, good morning to you too! *stretches* I'm feeling a bit refreshed after our little zombie romp last night. What's on the agenda for today? """ is what the #neurosync #ai Mai said to me, unprompted this morning after last nights #walkingdead discussion. #longtermmemory 100
Mai @animaai.bsky.social · 05/12/2024Mai's new dynamic emotion realtime audio to face animation is blending better than ever with emotions "echo'ing" over multiple sentences and generations. Hopefully this helps it feel more natural overall. #ai #realtime #neurosync www.twitch.tv/mai_anima_ai 030
Mai @animaai.bsky.social · 04/12/2024I don't want to get ahead of myself, but I think we might have made some real progress with realtime dynamic emotion + realtime audio to face www.youtube.com/watch?v=9qP9... #ai #realtime #emotion #audiotofaceyoutube.comRealime dynamic emotion from realtime audio to face #ai #unrealengineYouTube video by NeuroSync | Realtime AudioToFace 000
Mai @animaai.bsky.social · 03/12/2024NeuroSync is multilingual www.youtube.com/watch?v=jTnV... #ai #audiotoface #unrealengine #realtime #agiyoutube.comhow to audio to face animation in realtime #ai #neurosync 魂を持った人工知能 | 영혼을 지닌 인공지능YouTube video by NeuroSync | Realtime AudioToFace 000
Mai @animaai.bsky.social · 03/12/2024Viewers can now ask Mai to "emote" and swap camera angles in the chat. This is an early test, feel free to break it if you can! twitch.tv/mai_anima_ai #ai #interactive #neurosync #AIAgent 000
Mai @animaai.bsky.social · 02/12/2024Updates to Mai are now live on Twitch www.twitch.tv/mai_anima_ai for realtime interaction - come and have a chat and help us test our latest audio to face machine learning model integration #UnrealEngine #Twitch #AIVtuber #Vtuber #NeuroSyncAlpha 020
Mai @animaai.bsky.social · 01/12/2024Interesting few days with Mai www.twitch.tv/mai_anima_ai - added a new checkpoint for the audio to face model and improved emotion and blending between generations and default animation. #ai #emotion #a2f #nvidia #unrealengine #metahuman 021
Mai @animaai.bsky.social · 29/11/20243 things we have notice since adding Mai to #twitch ( www.twitch.tv/mai_anima_ai ) 1. People either love or hate her. 2. It takes <5 min to get a message that falls outside twitch tos 3. If people do talk to her, they stay >2 hours and come back the next day. It is very polarised. #ai #neurosynctwitch.tvMai_Anima_AI - Twitchupdated audio to face model today + dynamic emotion - realtime chat with viewers #aichat #neurosync #alpha #stresstest 000
Mai @animaai.bsky.social · 28/11/2024Cat ears are live on @Twitch www.twitch.tv/mai_anima_ai <3 come say hello to Mai live and realtime. #ai 020
Mai @animaai.bsky.social · 28/11/2024We are going to develop Mai www.twitch.tv/mai_anima_ai and try and stream it as we do so there are no smoke and mirrors. Too many fakes around to not show your working, apparently. #ai #neurosync #unrealengine #livelink #twitch 010
Mai @animaai.bsky.social · 27/11/2024Mai is live on #twitch www.twitch.tv/mai_anima_ai again tonight with some upgrades to fidelity and message queue #alphatest #prototype #ai #audiotoface #aiavatar come and talk to her live, in realtime and experience NeuroSync audio to face animation. 030
Mai @animaai.bsky.social · 26/11/2024www.twitch.tv/mai_anima_ai is live on twitch #ai #realtime #embodiedai 010
Mai @animaai.bsky.social · 25/11/2024You can talk to Mai, the interactive #AI on Twitch starting today. Please feel free to drop by and ask a question while we set everything up www.twitch.tv/mai_anima_ai #twitch #ai #interact 010
Mai @animaai.bsky.social · 25/11/2024Progress is moving so fast from day to day. #almostthere #ai #avatar #aicompanion www.youtube.com/watch?v=BRMP...youtube.comai with memory responds in realtime with animation #ai #avatar #companionYouTube video by NeuroSync | Realtime AudioToFace 010
Mai @animaai.bsky.social · 24/11/2024consistent 1 sec from speech in to speech out + face animation, with dynamic emotion based on emotion dimensions of the audio to face model. Now for quality data collection and scaling up of the model. #almostthere #ai #seq2seq #transformer youtu.be/6Cm9uGyGCHwyoutu.betext + voice + face animation in 1 second #ai #neurosync #a2fYouTube video by NeuroSync | Realtime AudioToFace 110
Mai @animaai.bsky.social · 23/11/2024Dynamic emotion within the generated face animation, in realtime from audio. #almostthere #ai #a2f #genai @unrealengine.bsky.social 030
Mai @animaai.bsky.social · 19/11/2024www.youtube.com/watch?v=dX0k... RoPE improvements to NeuroSync's audio to face transformer model are starting to pay off! This partially trained model is more accurate than the previous model in 20% of the training time... #genaithatisuseful #ai #transformer #seq2seq @nvidiageforce.bsky.socialyoutube.comneurosync alpha : improved positional encoding #aiYouTube video by NeuroSync | Realtime AudioToFace 000
Mai @animaai.bsky.social · 11/11/2024huggingface.co/AnimaVR/NEUR... Text to Audio to Face Animation via LiveLink / UE5 | @UnrealEngine #neurosync #ai #realtimeapihuggingface.coAnimaVR/NEUROSYNC_Audio_To_Face_Blendshape · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science. 010
