TY - JOUR
T1 - MapReduce SVM game
AU - Vineyard, Craig M.
AU - Verzi, Stephen J.
AU - James, Conrad D.
AU - Aimone, James B.
AU - Heileman, Gregory L.
N1 - Funding Information:
This research was possible in part by LDRD program support from Sandia National Laboratories. Sandia National Laboratories is a multi-program laboratory managed and operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin Corporation, for the U.S. Department of Energys National Nuclear Security Administration under contract DE-AC04-94AL85000.
Publisher Copyright:
© The Authors. Published by Elsevier B.V.
PY - 2015
Y1 - 2015
N2 - Despite technological advances making computing devices faster, smaller, and more prevalent in today's age, data generation and collection has outpaced data processing capabilities. Simply having more compute platforms does not provide a means of addressing challenging problems in the big data era. Rather, alternative processing approaches are needed and the application of machine learning to big data is hugely important. The MapReduce programming paradigm is an alternative to conventional supercomputing approaches, and requires less stringent data passing constrained problem decompositions. Rather, MapReduce relies upon defining a means of partitioning the desired problem so that subsets may be computed independently and recom-bined to yield the net desired result. However, not all machine learning algorithms are amenable to such an approach. Game-theoretic algorithms are often innately distributed, consisting of local interactions between players without requiring a central authority and are iterative by nature rather than requiring extensive retraining. Effectively, a game-theoretic approach to machine learning is well suited for the MapReduce paradigm and provides a novel, alternative new perspective to addressing the big data problem. In this paper we present a variant of our Support Vector Machine (SVM) Game classifier which may be used in a distributed manner, and show an illustrative example of applying this algorithm.
AB - Despite technological advances making computing devices faster, smaller, and more prevalent in today's age, data generation and collection has outpaced data processing capabilities. Simply having more compute platforms does not provide a means of addressing challenging problems in the big data era. Rather, alternative processing approaches are needed and the application of machine learning to big data is hugely important. The MapReduce programming paradigm is an alternative to conventional supercomputing approaches, and requires less stringent data passing constrained problem decompositions. Rather, MapReduce relies upon defining a means of partitioning the desired problem so that subsets may be computed independently and recom-bined to yield the net desired result. However, not all machine learning algorithms are amenable to such an approach. Game-theoretic algorithms are often innately distributed, consisting of local interactions between players without requiring a central authority and are iterative by nature rather than requiring extensive retraining. Effectively, a game-theoretic approach to machine learning is well suited for the MapReduce paradigm and provides a novel, alternative new perspective to addressing the big data problem. In this paper we present a variant of our Support Vector Machine (SVM) Game classifier which may be used in a distributed manner, and show an illustrative example of applying this algorithm.
KW - Game theory
KW - Machine learning
KW - MapReduce
KW - Support vector machine
UR - http://www.scopus.com/inward/record.url?scp=84939162855&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84939162855&partnerID=8YFLogxK
U2 - 10.1016/j.procs.2015.07.307
DO - 10.1016/j.procs.2015.07.307
M3 - Conference article
AN - SCOPUS:84939162855
SN - 1877-0509
VL - 53
SP - 298
EP - 307
JO - Procedia Computer Science
JF - Procedia Computer Science
IS - 1
T2 - INNS Conference on Big Data 2015
Y2 - 8 August 2015 through 10 August 2015
ER -