iiinova — where your digital self keeps evolving

iiinova is part of the Atmosphere — an open, public network where you own your identity.

Shan-Yuan Teng

@tengshanyuan.info

Assistant Professor at National Taiwan University (NTU, Taipei). PhD, University of Chicago (Human-Computer Interaction, Virtual/Augmented Reality, Wearable, Haptics) lab.tengshanyuan.info

Posts Replies Media

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

We further let participants *choose* which tactile perspective to use for a handshaking task. All chose to *use both devices*, and most stated that the eyes' provides an overview, and the hands' provides details. We were really impressed by how they were able to fluently utilize these new senses!

A photo showing two people are shaking their hands. Blue rays extned from the head and from the hand. Call-outs from both consist of close up photos overlaid with a grid of red and white dots.

110 1

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

Our user studies including Blind & Low Vision participants focus on daily tasks (e.g., grasping). Without extensive training (~15 min), most completed without touching unintended objects. Compared to using the eyes' perspective, participants found the hands' provides a more ergonomic way of seeing.

A collage of study photos in which each shows a different person while blindfolded, reaching their hand for different tasks in front of a table with different objects.

100 1

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

In contrast to the more traditional way of sensory substitution which captures vision from the *eyes’ perspective*, we propose seeing from the *hands' perspective*, and explore its unique benefits for manual tasks, e.g., hands are natural and easy to move around.

A person crouches near a counter and reaches their left hand into a cabinet where a mug is. A blue light indicating the direction of their gaze, and another blue light indicating the direction which the hand is facing. An inset from the hand shows a tactile image on the back of the hand, represented by a grid of red and green dots.

200 2

Shan-Yuan Teng @tengshanyuan.info · 23/04/2025

“Seeing with the Hands” is the latest #CHI25 research from our lab (@pedrolopes.org) with Gene S-H Kim and Xuanyou Liu. We explore a sensory substitution that enables a flexible way of seeing (vision-to-electrotactile), e.g., hover an object and feel its shape before grasping if one cannot see.

This over-the-shoulder shot shows a person reaching for a black kettle on a table with their right hand. On the back of their right hand, a device is attached and consists of strips. A call-out in the top left corner shows a close up photo of the kettle, overlaid with a grid of dots in white and red colors. The red dots approximately overlap with the kettle image.

1122 12

Shan-Yuan Teng @tengshanyuan.info · 06/12/2024

Being an HCI researcher is not easy! It was nice hosting a panel at UChicago CS and hearing from our kind faculty members about cultivating culture, volunteering, dealing with failure, and more.

A group of students is attending a panel titled "How to Thrive in HCI Academia Without Losing Your Mind" in a seminar setting with four speakers at the front.

2112 11

Shan-Yuan Teng @tengshanyuan.info · 25/11/2024

A fresh start on Bluesky: I am Shan-Yuan, a PhD candidate passionate about "haptics" (touch, texture, force), which we have mostly given up with touchscreens & VR/AR headsets. I re-envision and build new hardware that enables fun and dexterous computing interactions (hoping to start a new lab!).

You can enjoy haptics while charging devices with my arm-wear! (beautifully shot by John Zich at University of Chicago)

6705 70