A Kinect based vibrotactile feedback system to assist the visually impaired

Kumar Yelamarthi; Brian P. Dejong; Kevin Laubhan

doi:10.1109/MWSCAS.2014.6908495

A Kinect based vibrotactile feedback system to assist the visually impaired

Kumar Yelamarthi, Brian P. Dejong, Kevin Laubhan

Engineering & Technology, School Of

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

13 Scopus citations

Abstract

This paper presents a Microsoft Kinect based vibrotactile feedback system to aid in navigation for the visually impaired. The lightweight wearable system interprets the visual scene and presents obstacle distance and characteristic information to the user. The scene is converted into a distance map using the Kinect, then processed and interpreted using an Intel Next Unit of Computing (NUC). That information is then converted via a microcontroller into vibrotactile feedback, presented to the user through two four-by-four vibration motor arrays woven into gloves. The system is shown to successfully identify, track, and present closest objects, closest humans, multiple humans, and perform distance measurements.

Original language	English
Title of host publication	2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	635-638
Number of pages	4
ISBN (Electronic)	9781479941346, 9781479941346
DOIs	https://doi.org/10.1109/MWSCAS.2014.6908495
State	Published - Sep 23 2014
Event	2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014 - College Station, United States Duration: Aug 3 2014 → Aug 6 2014

Publication series

Name	Midwest Symposium on Circuits and Systems
ISSN (Print)	1548-3746

Conference

Conference	2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014
Country/Territory	United States
City	College Station
Period	08/3/14 → 08/6/14

Keywords

blind
kinect sensor
navigation assistance
tactile feedback
visually impaired

Access to Document

10.1109/MWSCAS.2014.6908495

Cite this

Yelamarthi, K., Dejong, B. P., & Laubhan, K. (2014). A Kinect based vibrotactile feedback system to assist the visually impaired. In 2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014 (pp. 635-638). Article 6908495 (Midwest Symposium on Circuits and Systems). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/MWSCAS.2014.6908495

@inproceedings{5542504a73074ece91e9b9aa6de95aa5,

title = "A Kinect based vibrotactile feedback system to assist the visually impaired",

abstract = "This paper presents a Microsoft Kinect based vibrotactile feedback system to aid in navigation for the visually impaired. The lightweight wearable system interprets the visual scene and presents obstacle distance and characteristic information to the user. The scene is converted into a distance map using the Kinect, then processed and interpreted using an Intel Next Unit of Computing (NUC). That information is then converted via a microcontroller into vibrotactile feedback, presented to the user through two four-by-four vibration motor arrays woven into gloves. The system is shown to successfully identify, track, and present closest objects, closest humans, multiple humans, and perform distance measurements.",

keywords = "blind, kinect sensor, navigation assistance, tactile feedback, visually impaired",

author = "Kumar Yelamarthi and Dejong, {Brian P.} and Kevin Laubhan",

note = "Publisher Copyright: {\textcopyright} 2014 IEEE.; 2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014 ; Conference date: 03-08-2014 Through 06-08-2014",

year = "2014",

month = sep,

day = "23",

doi = "10.1109/MWSCAS.2014.6908495",

language = "English",

series = "Midwest Symposium on Circuits and Systems",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "635--638",

booktitle = "2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014",

}

Yelamarthi, K, Dejong, BP & Laubhan, K 2014, A Kinect based vibrotactile feedback system to assist the visually impaired. in 2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014., 6908495, Midwest Symposium on Circuits and Systems, Institute of Electrical and Electronics Engineers Inc., pp. 635-638, 2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014, College Station, United States, 08/3/14. https://doi.org/10.1109/MWSCAS.2014.6908495

A Kinect based vibrotactile feedback system to assist the visually impaired. / Yelamarthi, Kumar; Dejong, Brian P.; Laubhan, Kevin.
2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014. Institute of Electrical and Electronics Engineers Inc., 2014. p. 635-638 6908495 (Midwest Symposium on Circuits and Systems).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A Kinect based vibrotactile feedback system to assist the visually impaired

AU - Yelamarthi, Kumar

AU - Dejong, Brian P.

AU - Laubhan, Kevin

PY - 2014/9/23

Y1 - 2014/9/23

N2 - This paper presents a Microsoft Kinect based vibrotactile feedback system to aid in navigation for the visually impaired. The lightweight wearable system interprets the visual scene and presents obstacle distance and characteristic information to the user. The scene is converted into a distance map using the Kinect, then processed and interpreted using an Intel Next Unit of Computing (NUC). That information is then converted via a microcontroller into vibrotactile feedback, presented to the user through two four-by-four vibration motor arrays woven into gloves. The system is shown to successfully identify, track, and present closest objects, closest humans, multiple humans, and perform distance measurements.

AB - This paper presents a Microsoft Kinect based vibrotactile feedback system to aid in navigation for the visually impaired. The lightweight wearable system interprets the visual scene and presents obstacle distance and characteristic information to the user. The scene is converted into a distance map using the Kinect, then processed and interpreted using an Intel Next Unit of Computing (NUC). That information is then converted via a microcontroller into vibrotactile feedback, presented to the user through two four-by-four vibration motor arrays woven into gloves. The system is shown to successfully identify, track, and present closest objects, closest humans, multiple humans, and perform distance measurements.

KW - blind

KW - kinect sensor

KW - navigation assistance

KW - tactile feedback

KW - visually impaired

UR - http://www.scopus.com/inward/record.url?scp=84908479965&partnerID=8YFLogxK

U2 - 10.1109/MWSCAS.2014.6908495

DO - 10.1109/MWSCAS.2014.6908495

M3 - Conference contribution

AN - SCOPUS:84908479965

T3 - Midwest Symposium on Circuits and Systems

SP - 635

EP - 638

BT - 2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2014 IEEE 57th International Midwest Symposium on Circuits and Systems, MWSCAS 2014

Y2 - 3 August 2014 through 6 August 2014

ER -

A Kinect based vibrotactile feedback system to assist the visually impaired

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this