iiinova — where your digital self keeps evolving

Huge thanks to co-authors @yikeli.bsky.social, Iran R. Roman, @davidpoeppel.bsky.social, and to the Interspeech reviewers for the perfect 4/4 score! 🙌 Can’t wait to present and discuss how this bridges machine and human perception! See you in Rotterdam!

💥 Key Impact 3: This paves the way for advances in #CognitiveComputing and audio-related brain–computer (#BCI) applications (e.g., sound/speech reconstruction).

100

💥 Key Impact 2: STM features link directly to brain processing, offering a more interpretable, biologically grounded representation.

100

💥 Key Impact 1: Without any pretraining, our STM-based DNN matches popular spectrogram-based models on speech, music, and environmental sound classification.

100

David Poeppel @davidpoeppel.bsky.social · 31/05/2025

While spectrogram-based audio DNNs excel, they’re often bulky, compute-heavy, hard to interpret, and data-hungry. We explored an alternative: training a DNN on spectrotemporal modulation (#STM) features—an approach inspired by how the human auditory cortex processes sound.

100

Reposted by Andrew Chang

Our Interspeech2025 contrib (for geeks) arxiv.org/pdf/2505.23509 Audio DNNs: impressive performance on machine listening tasks. But most representations are computationally costly & uninterpretable. Let's try something different:

arxiv.org

1144

Reposted by Andrew Chang

Haley Kragness @haleykrag.bsky.social · 14/03/2025

why DO babies dance? when do they start dancing? what counts as dancing, anyway (and how can we measure it)? out online today in CDPS, @lkcirelli.bsky.social and i attempt to integrate what is known about the development of dance journals.sagepub.com/doi/epub/10.... (2/4)

1101

Andrew Chang @candrew123.bsky.social · 12/03/2025

I have emailed @interspeech.bsky.social, but it would be great if you could also reach out to them at pco@interspeech2025.org if this concerns you as well, so they understand that this will affect many people. I’m sure none of us want to be stuck writing a rebuttal in a hotel at #ICASSP!

000

Andrew Chang @candrew123.bsky.social · 12/03/2025

@interspeech.bsky.social just changed its rebuttal period to April 4-11, which overlaps with #ICASSP. Given the overlap in research communities, I believe many researchers who submitted to #Interspeech2025 will also be attending #ICASSP2025. Could it be at least a week later?

100

What's next? We are currently working on (1) refining our ML model by combining active learning and semi-supervised learning approaches and (2) experimenting with new human-computer interaction designs to mitigate negative experiences during videoconferencing. 7/end

Beyond improving technical aspects like signal quality and latency of a videoconferencing system, social dynamics can deeply affect user experience. Our research paves the way for future enhancements by predicting and preventing conversational derailments in real time. 6/n

100

One surprising insight: awkward silences—those long gaps in turn-taking—were more detrimental to conversational fluidity and enjoyment than chaotic overlaps or interruptions. 5/n

100

We used multimodal ML on 100+ person-hours of videoconferences, modeling voice, facial expressions, and body movements. Key result: ROC-AUC 0.87 in predicting unfluid and unenjoyable moments and classifying various disruptive events, such as gaps and interruptions. 4/n

100

Andrew Chang @candrew123.bsky.social · 21/02/2025

Videoconferencing has become essential in our professional and personal lives, especially post-pandemic. Yet, we've all experienced the “derailed” moments, such as awkward pauses and uncoordinated turn-taking, and that can make virtual meetings less effective and enjoyable. 3/n

100

There is an excellent cross-cultural study on this topic by @norijacoby.bsky.social. A lay summary of the paper can be found here: www.aesthetics.mpg.de/en/research/...

aesthetics.mpg.de

Perception of pitch is culturally influenced

Study on cross-cultural music perception published in Current Biology

Andrew Chang @candrew123.bsky.social · 21/02/2025

Thanks for your comment. Yes there are several recent studies suggesting that chroma is not really an innate or universal property of pitch perception. Our study cannot answer this question, but we indeed found that the effect of chroma is much weaker than height.

000

In short: By combining machine learning and MEG, we show how the brain’s dynamic pitch representation echoes ideas proposed over 100 years ago. Feels like completing a full circle in music cognitive neuroscience! Huge thanks to my collaborators! End/n

090

The helix model reflects the idea that pitches separated by an octave (e.g., the repeating piano keys) are perceived as inherently similar. This concept was first explored in the early 1900s by Géza Révész, laying the groundwork for modern music cognition! 🧠🎹 6/n

180

The brain doesn’t process pitch in an unstructured way. Typically, it represents pitches in a mostly linear structure—think piano keyboard layout. BUT—just 0.3 seconds after hearing a sound, something wild happens: the brain briefly represents pitch in a helix-like structure! 5/n

1162

This animation shows the reconstruction of how the brain dynamically represents musical pitches. The pitches that are closer in space are perceived as more similar at a given moment. 4/n

120

We used machine learning to decode how the brain represents musical pitches during an #MEG scan. Our model reconstructed how the brain represents the similarity between different pitches and how this representation changes over time. 3/n

110

Why does pitch matter? It’s essential not just for music, but for speech perception & sound segregation too! Understanding how our brain dynamically encodes pitch is a major research in auditory cognitive neuroscience. 2/n

130

000

100

110

This animation shows the reconstruction of how the brain dynamically represents musical pitches. The pitches that are closer in space are perceived as more similar at a given moment. 4/n

100

100

Andrew Chang @candrew123.bsky.social · 28/01/2025

100

I missed the perfect chance to name my new paper ‘Giant Steps.’ I won't be able to rest in peace. @davidpoeppel.bsky.social @xiangbin-teng.bsky.social