Entropy and Insight: Exploring how information theory can be used to quantify sensemaking in visual analytics

TR Number
Date
2018-06-29
Journal Title
Journal ISSN
Volume Title
Publisher
Virginia Tech
Abstract

With the dramatic increase and continued growth of digital information, developing Visual Analytic systems that support human cognition and insight generation are more necessary than ever before, but there is currently no content-agnostic method for measuring or com- paring how well a system facilitates analysis. Researchers in industry and academia are developing advanced tools that offer automated data analysis combined with support for human sense-making; tools for a wide variety of sense-making tasks are freely available. Now, the pressing question is: which tool works best, and for what? We show that using Shannon's entropy and self-information measures will provide a measure of the complexity reduction that results from an analyst's actions while sorting the information. Further, we demonstrate that reduced complexity can be linked to the knowledge gained. This is important, because a metric for objectively evaluating the success of current systems in generating insights would establish a standard that future tools could build on. This work could help guide researchers and developers in making the next generation of analytic tools, and in the age of big data the effect of such tools could potentially impact everyone.

Description
Keywords
Information Theory, Insight, HCI, Sensemaking, Visual Analytics
Citation
Collections