iiinova — where your digital self keeps evolving

Reposted by Shan-Yuan Teng

Pedro Lopes @pedrolopes.org · 19/06/2025

A pleasure to host Jun Rekimoto at the Human-Computer Integration Lab (lab.plopes.org) where he gave a talk about "Human-AI Integration". Inspiring as always and thanks for staying for a full day of demos and giving insightful feedback to many of our lab members. (thanks Romain for co-organizing!)

Jun Rekimoto giving a talk next to my lab's banner that says Human Computer Integration (lab name and my motto for 15+ years), which is really nice to see! The talk was very inspiring and you can see his energy in his way of gesturing at the slide.

Full lab sitting and watching Jun Rekimoto giving a talk next to my The talk was very inspiring and you can see his energy in his way of gesturing at the slide.

091

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

Want to try? We are excited to demonstrate the device during Interactivity at #CHI25 and we will present the paper on Wednesday, 30 Apr, 10 am "Sensing and Haptics". See video, paper, and links to program: seeingwiththehands.com

seeingwiththehands.com

Seeing with the Hands

A sensory substitution that supports manual interactions

010

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

We further let participants *choose* which tactile perspective to use for a handshaking task. All chose to *use both devices*, and most stated that the eyes' provides an overview, and the hands' provides details. We were really impressed by how they were able to fluently utilize these new senses!

A photo showing two people are shaking their hands. Blue rays extned from the head and from the hand. Call-outs from both consist of close up photos overlaid with a grid of red and white dots.

110

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

Our user studies including Blind & Low Vision participants focus on daily tasks (e.g., grasping). Without extensive training (~15 min), most completed without touching unintended objects. Compared to using the eyes' perspective, participants found the hands' provides a more ergonomic way of seeing.

A collage of study photos in which each shows a different person while blindfolded, reaching their hand for different tasks in front of a table with different objects.

100

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

In contrast to the more traditional way of sensory substitution which captures vision from the *eyes’ perspective*, we propose seeing from the *hands' perspective*, and explore its unique benefits for manual tasks, e.g., hands are natural and easy to move around.

A person crouches near a counter and reaches their left hand into a cabinet where a mug is. A blue light indicating the direction of their gaze, and another blue light indicating the direction which the hand is facing. An inset from the hand shows a tactile image on the back of the hand, represented by a grid of red and green dots.

200

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

“Seeing with the Hands” is the latest #CHI25 research from our lab (@pedrolopes.org) with Gene S-H Kim and Xuanyou Liu. We explore a sensory substitution that enables a flexible way of seeing (vision-to-electrotactile), e.g., hover an object and feel its shape before grasping if one cannot see.

This over-the-shoulder shot shows a person reaching for a black kettle on a table with their right hand. On the back of their right hand, a device is attached and consists of strips. A call-out in the top left corner shows a close up photo of the kettle, overlaid with a grid of dots in white and red colors. The red dots approximately overlap with the kettle image.

1122

Shan-Yuan Teng @tengshanyuan.info · 18/03/2025

I am excited to announce that I will defend my PhD next week on March 24th 11:00 am (Chicago Time). You are welcome to join on Zoom, and learn about my PhD work on innovating haptic devices (2019-2025)! Event info: defense.tengshanyuan.info

defense.tengshanyuan.info

Shan-Yuan Teng’s PhD defense

Enabling haptic experiences anywhere, anytime

0131

Reposted by Shan-Yuan Teng

Jennifer Ouellette @jenlucpiquant.bsky.social · 20/01/2025

Robotic hand helps pianists overcome “ceiling effect." Passive training with robotic exoskeleton hand even led to motor improvements in the untrained hand. arstechnica.com/science/2025...

arstechnica.com

Robotic hand helps pianists overcome “ceiling effect”

Passive training with robotic exoskeleton hand even led to motor improvements in the untrained hand.

3209

Reposted by Shan-Yuan Teng

Alex Mazursky @alexmazursky.bsky.social · 14/01/2025

🎉 Workshop at #CHI2025: "Sensorimotor Devices: Coupling Sensing and Actuation to Augment Bodily Experience" If you’re passionate about sensorimotor interaction, wearables, or motion-coupled feedback, join us! 🗓️ Deadline: Feb 13, 2025 AoE 🔗 sensorimotordevices.github.io

sensorimotordevices.github.io

Sensorimotor Devices: Coupling Sensing and Actuation to Augment Bodily Experience

CHI 2025 Workshop - Yokohama, Japan

193

Shan-Yuan Teng @tengshanyuan.info · 06/12/2024

Being an HCI researcher is not easy! It was nice hosting a panel at UChicago CS and hearing from our kind faculty members about cultivating culture, volunteering, dealing with failure, and more.

A group of students is attending a panel titled "How to Thrive in HCI Academia Without Losing Your Mind" in a seminar setting with four speakers at the front.

2112

Reposted by Shan-Yuan Teng

Pedro Lopes @pedrolopes.org · 03/12/2024

Join us for people and technology seminar on Friday with a fun group and topic! Thanks @tengshanyuan.info for coming up with this one!

Poster for Friday's people and tech. Check info on slack for a textual information of the same poster.

0103

Reposted by Shan-Yuan Teng

Tan Gemicioglu @tgemi.bsky.social · 25/11/2024

What if you could learn to play a new musical piece in just a few practice sessions? In my new paper, we show that using haptic gloves to passively rehearse piano pieces can speed up learning by 49.7%, and negating forgetting between practice sessions.

141

Shan-Yuan Teng @tengshanyuan.info · 25/11/2024

A fresh start on Bluesky: I am Shan-Yuan, a PhD candidate passionate about "haptics" (touch, texture, force), which we have mostly given up with touchscreens & VR/AR headsets. I re-envision and build new hardware that enables fun and dexterous computing interactions (hoping to start a new lab!).

You can enjoy haptics while charging devices with my arm-wear! (beautifully shot by John Zich at University of Chicago)

6705

Reposted by Shan-Yuan Teng

Pedro Lopes @pedrolopes.org · 23/11/2024

A really fun day with many new friends in the #Chicago area who do #hardware based #HCI #research! Nivedita Arora Karan Ahuja Ken Nakagaki Craig Schultz and their respective amazing teams! (Thanks Yudai Tanaka for organizing us at UChicagoCS)

0181