Home
Resource
Let the robot do it for me: assessing voice as a modality for visual analytics for novice users
PDF
PDF format is widely accepted and good for printing.
Plug-in required
PDF-1(3.82 MB)
Citation & Export
View Usage Statistics
Staff View

Citation & Export
Hide

Simple citation

Pulliza, Jonathan Luis. Let the robot do it for me: assessing voice as a modality for visual analytics for novice users. Retrieved from https://doi.org/doi:10.7282/t3-rq3n-zz18

Export

Click here for information about Citation Management Tools at Rutgers.

Statistics
Hide

Description

TitleLet the robot do it for me: assessing voice as a modality for visual analytics for novice users
NamePulliza, Jonathan Luis (author); Shah, Chirag (chair); Wacholder, Nina (internal member); Aakhus, Mark (internal member); Tory, Melanie (outside member); Rutgers University; School of Graduate Studies
Date Created2020
Other Date2020-10 (degree)
SubjectVisual analytics, Communication, Information and Library Studies
Extent1 online resource (x, 167 pages) : illustrations
DescriptionThe growth of Visual Analytics (VA) systems has been driven by the need to explore and understand large datasets across many domains. Applications such as Tableau were developed with the goal of better supporting novice users to generate data visualizations and complete their tasks. However, novice users still face many challenges in using VA systems, especially in complex tasks outside of simple trend identification, such as exploratory tasks. Many of the issues stem from the novice users’ inability to reconcile their questions or representations of the data with the visualizations presented using the interactions provided by the system.

With the improvement in natural language processing technology and the increased prevalence of voice interfaces, there is a renewed interest in developing voice interactions for VA systems. The goal is to enable users to ask questions directly to the system or to indicate specific actions using natural language, which may better facilitate access to functions available in the VA system. Previous approaches have tended to build systems in a screen-only environment in order to encourage interaction through voice. Though they did produce significant results and guidance for the technical challenges of voice in VA, it is important to understand how the use of a voice system would affect novice users within their most common context instead of moving them into new environments. It is also important to understand when a novice user would choose to use a voice modality when the traditional keyboard and mouse modality is also available.

This study is an attempt to understand the circumstances under which novice users of a VA system would choose to interact with using their voice in a traditional desktop environment, and whether the voice system better facilitates access to available functionalities. Given the users choose the voice system, do they choose different functions than those with only a keyboard and a mouse? Using a Wizard of Oz set up in the place of an automated voice system, we find that the participants chose to use the voice system because of its convenience, ability to get a quick start on their work, and in some situations where they could not find a specific function in the interface. Overall function choices were not found to be significantly different between those who had access to the voice system versus those who did not, though there were a few cases where participants were able to access less common functions compared to a control group. Participants refrained from choosing voice because their previous experiences with voice systems had led them to believe all voice systems were not capable of addressing their task needs. They also felt using the voice system was incongruent with gaining mastery of the underlying VA system, as the convenience of using the voice system could lead to its use as a crutch. Participants then often chose to struggle with the visual interface instead of using the voice system for assistance.
NotePh.D.
NoteIncludes bibliographical references
Genretheses, ETD doctoral
Persistent URLhttps://doi.org/doi:10.7282/t3-rq3n-zz18
LanguageEnglish
CollectionSchool of Graduate Studies Electronic Theses and Dissertations
Organization NameRutgers, The State University of New Jersey
RightsThe author owns the copyright to this work.
Version 8.5.5
Rutgers University Libraries - Copyright ©2024