Title of Poster or Presentation

Accessibility Enhanced by Sound and Haptics

Submission Type

Poster

Degree Type

Masters

Discipline

Sciences

Department

Computer Sciences

Access Type

Open Access

Abstract or Description

The Accessibility Enhanced by Sound and Haptics (AESH) project is designed to analyze and refactor accessibility features within home gaming consoles using enhanced audio and haptic feedback to benefit those requiring the features. Initial tests gauged reactions and ease of use of the accessibility narrator by the test subject within the three major game consoles; PlayStation 4, Xbox One, and Nintendo Switch.

Research for haptic and audio response development continued with the Xbox One and was based on the ideas of psychological conditioning intended to invoke unconscious or semi-conscious responses to stimuli from the console. Audio development was based on core sound design techniques and audience response understanding. This relied on the idea of “bright” affirmative sounds and “dark” negative sounds. Haptic feedback research was based on video game control schemes and discussion about how users effectively interact with the controller to perform actions as well as receive feedback. Enhancements and modifications were considered beneficial and audio considered beneficial but unnecessary. Each feature is important but would be beneficial to add for accessibility features on operating systems as they will give users that need it an extra level of customization and eliminate some feelings of discouragement related to the stigma of using accessibility-based features.

Audio and Haptic Enhanced Accessibility Features KLM.pdf (87 kB)
KLM-GOMS Model for Xbox One Narrator Timing

Xbox One AESH Default.mp4 (89120 kB)
Default Narrator Playback

Xbox One AESH Shortened.mp4 (16970 kB)
Concise Narrator Playback

Creative Commons License

Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 License.

Share

COinS
 

Accessibility Enhanced by Sound and Haptics

The Accessibility Enhanced by Sound and Haptics (AESH) project is designed to analyze and refactor accessibility features within home gaming consoles using enhanced audio and haptic feedback to benefit those requiring the features. Initial tests gauged reactions and ease of use of the accessibility narrator by the test subject within the three major game consoles; PlayStation 4, Xbox One, and Nintendo Switch.

Research for haptic and audio response development continued with the Xbox One and was based on the ideas of psychological conditioning intended to invoke unconscious or semi-conscious responses to stimuli from the console. Audio development was based on core sound design techniques and audience response understanding. This relied on the idea of “bright” affirmative sounds and “dark” negative sounds. Haptic feedback research was based on video game control schemes and discussion about how users effectively interact with the controller to perform actions as well as receive feedback. Enhancements and modifications were considered beneficial and audio considered beneficial but unnecessary. Each feature is important but would be beneficial to add for accessibility features on operating systems as they will give users that need it an extra level of customization and eliminate some feelings of discouragement related to the stigma of using accessibility-based features.