TY - GEN
T1 - DBMS metrology
T2 - 2013 ACM SIGMOD Conference on Management of Data, SIGMOD 2013
AU - Currim, Sabah
AU - Snodgrass, Richard T.
AU - Suh, Young Kyoon
AU - Zhang, Rui
AU - Johnson, Matthew Wong
AU - Yi, Cheng
PY - 2013
Y1 - 2013
N2 - It is surprisingly hard to obtain accurate and precise measurements of the time spent executing a query. We review relevant process and overall measures obtainable from the Linux kernel and introduce a structural causal model relating these measures. A thorough correlational analysis provides strong support for this model. Using this model, we developed a timing protocol, which (1) performs sanity checks to ensure validity of the data, (2) drops some query executions via clearly motivated predicates, (3) drops some entire queries at a cardinality, again via clearly motivated predicates, (4) for those that remain, for each computes a single measured time by a carefully justified formula over the underlying measures of the remaining query executions, and (5) performs post-analysis sanity checks. The resulting query time measurement procedure, termed the Tucson Protocol, applies to proprietary and open-source DBMSes.
AB - It is surprisingly hard to obtain accurate and precise measurements of the time spent executing a query. We review relevant process and overall measures obtainable from the Linux kernel and introduce a structural causal model relating these measures. A thorough correlational analysis provides strong support for this model. Using this model, we developed a timing protocol, which (1) performs sanity checks to ensure validity of the data, (2) drops some query executions via clearly motivated predicates, (3) drops some entire queries at a cardinality, again via clearly motivated predicates, (4) for those that remain, for each computes a single measured time by a carefully justified formula over the underlying measures of the remaining query executions, and (5) performs post-analysis sanity checks. The resulting query time measurement procedure, termed the Tucson Protocol, applies to proprietary and open-source DBMSes.
KW - Accuracy
KW - Repeatability
KW - Tucson Protocol
UR - http://www.scopus.com/inward/record.url?scp=84880547780&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84880547780&partnerID=8YFLogxK
U2 - 10.1145/2463676.2465331
DO - 10.1145/2463676.2465331
M3 - Conference contribution
AN - SCOPUS:84880547780
SN - 9781450320375
T3 - Proceedings of the ACM SIGMOD International Conference on Management of Data
SP - 421
EP - 432
BT - SIGMOD 2013 - International Conference on Management of Data
Y2 - 22 June 2013 through 27 June 2013
ER -