TY - JOUR
T1 - Evaluating event visualization
T2 - A usability study of COPLINK Spatio-Temporal Visualizer
AU - Chung, Wingyan
AU - Chen, Hsinchun
AU - Chaboya, Luis G.
AU - O'Toole, Christopher D.
AU - Atabakhsh, Homa
N1 - Funding Information:
This project has been partly supported by NSF Digital Government Program, “COPLINK Center: Information and Knowledge Management for Law Enforcement,” #9983304, July 2000–June 2003 and NSF Information Technology Research, “Developing A Collaborative Information and Knowledge Management Infrastructure,” NSF/IIS #0114011, September 2001–August 2004. We thank Detective Tim Petersen, Ty Buetow, Tom Cushna, Damien Daspit, Lt. Jenny Schroeder, Dan Casey, Karin D. Quiñones, all the student subjects and TPD crime analysts and criminal intelligence officers who participated in the user study for their support and assistance in this research.
PY - 2005/1
Y1 - 2005/1
N2 - Event visualization holds the promise of alleviating information overload in human analysis and numerous tools and techniques have been developed and evaluated. However, previous work does not specifically address either the coordination of event dimensions with the types of tasks involved or the way that visualizing different event dimensions can benefit human analysis. In this paper, we propose a taxonomy of event visualization and present a methodology for evaluating a coordinated event visualization tool called COPLINK Spatio-Temporal Visualizer (STV). The taxonomy encompasses various event dimensions, application domains, visualization metaphors, evaluation methods and performance measures. The evaluation methodology examines different event dimensions and different task types, thus juxtaposing two important elements of evaluating a tool. To achieve both internal and external validity, a laboratory experiment with students and a field study with crime analysis experts were conducted. Findings of our usability study show that STV could support crime analysis involving multiple, coordinated event dimensions as effectively as it could analyze individual, uncoordinated event dimensions. STV was significantly more effective and efficient than Microsoft Excel in performing coordinated tasks and was significantly more efficient in doing uncoordinated tasks related to temporal, spatial and aggregated information. Also, STV had compared favorably with Excel in completing uncoordinated tasks related to temporal and spatial information, respectively. Subjects' comments showed STV to be intuitive, useful and preferable to existing crime analysis methods.
AB - Event visualization holds the promise of alleviating information overload in human analysis and numerous tools and techniques have been developed and evaluated. However, previous work does not specifically address either the coordination of event dimensions with the types of tasks involved or the way that visualizing different event dimensions can benefit human analysis. In this paper, we propose a taxonomy of event visualization and present a methodology for evaluating a coordinated event visualization tool called COPLINK Spatio-Temporal Visualizer (STV). The taxonomy encompasses various event dimensions, application domains, visualization metaphors, evaluation methods and performance measures. The evaluation methodology examines different event dimensions and different task types, thus juxtaposing two important elements of evaluating a tool. To achieve both internal and external validity, a laboratory experiment with students and a field study with crime analysis experts were conducted. Findings of our usability study show that STV could support crime analysis involving multiple, coordinated event dimensions as effectively as it could analyze individual, uncoordinated event dimensions. STV was significantly more effective and efficient than Microsoft Excel in performing coordinated tasks and was significantly more efficient in doing uncoordinated tasks related to temporal, spatial and aggregated information. Also, STV had compared favorably with Excel in completing uncoordinated tasks related to temporal and spatial information, respectively. Subjects' comments showed STV to be intuitive, useful and preferable to existing crime analysis methods.
KW - COPLINK
KW - Crime analysis
KW - Evaluation methodology
KW - Event visualization
KW - Information visualization
KW - Intelligence analysis
KW - Law enforcement
KW - National security
KW - Spatio-Temporal Visualizer
KW - Taxonomy
KW - Usability
UR - http://www.scopus.com/inward/record.url?scp=10644268659&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=10644268659&partnerID=8YFLogxK
U2 - 10.1016/j.ijhcs.2004.08.005
DO - 10.1016/j.ijhcs.2004.08.005
M3 - Article
AN - SCOPUS:10644268659
SN - 1071-5819
VL - 62
SP - 127
EP - 157
JO - International Journal of Human Computer Studies
JF - International Journal of Human Computer Studies
IS - 1
ER -