Swarm scalable storage system

John H. Hartman; Ian Murdock; Tammo Spalink

Swarm scalable storage system

John H. Hartman, Ian Murdock, Tammo Spalink

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

57 Scopus citations

Abstract

Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.

Original language	English (US)
Title of host publication	Proceedings - International Conference on Distributed Computing Systems
Publisher	IEEE
Pages	74-81
Number of pages	8
ISBN (Print)	0769502229
State	Published - 1999
Event	Proceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99) - Austin, TX, USA Duration: May 31 1999 → Jun 4 1999

Publication series

Name	Proceedings - International Conference on Distributed Computing Systems

Other

Other	Proceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99)
City	Austin, TX, USA
Period	5/31/99 → 6/4/99

ASJC Scopus subject areas

Software
Hardware and Architecture
Computer Networks and Communications

Cite this

@inproceedings{c787f8b7db1d4540942bfb408d116170,

title = "Swarm scalable storage system",

abstract = "Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.",

author = "Hartman, {John H.} and Ian Murdock and Tammo Spalink",

year = "1999",

language = "English (US)",

isbn = "0769502229",

series = "Proceedings - International Conference on Distributed Computing Systems",

publisher = "IEEE",

pages = "74--81",

booktitle = "Proceedings - International Conference on Distributed Computing Systems",

note = "Proceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99) ; Conference date: 31-05-1999 Through 04-06-1999",

}

TY - GEN

T1 - Swarm scalable storage system

AU - Hartman, John H.

AU - Murdock, Ian

AU - Spalink, Tammo

PY - 1999

Y1 - 1999

N2 - Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.

AB - Swarm is a storage system that provides scalable, reliable, and cost-effective data storage. Swarm is based on storage servers, rather than file servers; the storage servers are optimized for cost-performance and aggregated to provide high-performance data access. Swarm uses a striped log abstraction to store data on the storage servers. This abstraction simplifies storage allocation, improves file access performance, balances server loads, provides fault-tolerance through computed redundancy, and simplifies crash recovery. We have developed a Swarm prototype using a cluster of Linux-based personal computers as the storage servers and clients; the clients access the servers via the Swarm-based Sting file system. Our performance measurements show that a single Swarm client can write to two storage servers at 3.0 MB/s., while four clients can write to eight servers at 16.0 MB/s.

UR - http://www.scopus.com/inward/record.url?scp=0032639183&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032639183&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:0032639183

SN - 0769502229

T3 - Proceedings - International Conference on Distributed Computing Systems

SP - 74

EP - 81

BT - Proceedings - International Conference on Distributed Computing Systems

PB - IEEE

T2 - Proceedings of the 1999 19th IEEE International Conference on Distributed Computing Systems (ICDCS'99)

Y2 - 31 May 1999 through 4 June 1999

ER -

Swarm scalable storage system

Abstract

Publication series

Other

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this