Logo image
SDSS Log Viewer: Visual Exploratory Analysis of Large-Volume SQL Log Data
Conference proceeding

SDSS Log Viewer: Visual Exploratory Analysis of Large-Volume SQL Log Data

Jian Zhang, Chaomei Chen, Michael S. Vogeley, Danny Pan, Ani Thakar and Jordan Raddic
VISUALIZATION AND DATA ANALYSIS 2012, v 8294
01 Jan 2012

Abstract

Engineering, Electrical & Electronic Science & Technology Engineering Optics Physical Sciences Technology
User-generated Structured Query Language (SQL) queries are a rich source of information for database analysts, information scientists, and the end users of databases. In this study a group of scientists in astronomy and computer and information scientists work together to analyze a large volume of SQL log data generated by users of the Sloan Digital Sky Survey (SDSS) data archive in order to better understand users' data seeking behavior. While statistical analysis of such logs is useful at aggregated levels, efficiently exploring specific patterns of queries is often a challenging task due to the typically large volume of the data, multivariate features, and data requirements specified in SQL queries. To enable and facilitate effective and efficient exploration of the SDSS log data, we designed an interactive visualization tool, called the SDSS Log Viewer, which integrates time series visualization, text visualization, and dynamic query techniques. We describe two analysis scenarios of visual exploration of SDSS log data, including understanding unusually high daily query traffic and modeling the types of data seeking behaviors of massive query generators. The two scenarios demonstrate that the SDSS Log Viewer provides a novel and potentially valuable approach to support these targeted tasks.

Metrics

14 Record Views
6 citations in Scopus

Details

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Collaboration types
Domestic collaboration
Web of Science research areas
Engineering, Electrical & Electronic
Optics
Logo image