Tuning and Predicting Consistency in Distributed Storage Systems

Tuning and Predicting Consistency in Distributed Storage Systems
Title Tuning and Predicting Consistency in Distributed Storage Systems PDF eBook
Author Shankha Subhra Chatterjee
Publisher
Pages 64
Release 2017
Genre Apache Cassandra
ISBN

Download Tuning and Predicting Consistency in Distributed Storage Systems Book in PDF, Epub and Kindle

Distributed storage systems are constrained by the finite speed of propagation of information. The CAP (which stands for consistency, availability, and partition tolerance) theorem states that in the presence of network partitions, a choice has to be made in between availability and consistency. However, even in the absence of failures, a trade-off between consistency and latency of operations (reads and writes) exists. Eventually consistent storage systems often sacrifice consistency for high availability and low latencies. One way to achieve fine-tuning in the consistency-latency trade-off space is to inject artificial delays to each storage operation. This thesis describes an adaptive tuning framework that is able to calculate the values of artificial delay to be injected to each storage operation to meet a specific target consistency. The framework is able to adapt nimbly to environmental changes in the storage system to maintain target consistency levels. It consists of a feedback loop which uses a technique called spectral shifting at each iteration to calculate the target value of artificial delay from a history of operations. The tuning framework is able to converge to the target value of artificial delay much faster than the state-of-art solution. This thesis also presents a probabilistic analysis of inconsistencies in eventually consistent distributed storage systems operating under weak (read one, write one) consistency settings. The analysis takes into account symmetrical (same for reads and writes) artificial delays which enable consistency-latency tuning. A mathematical formula for the percentage of inconsistent operations is derived from other environmental parameters pertaining to the storage system. The formula's predictions for the proportion of inconsistent operations match observations of the same from a stochastic simulator of the storage system running 10^6 operations (per experiment), and from a widely used key-value store (Apache Cassandra) closely.

Benchmarking, Consistency, Distributed Database Management Systems, Distributed Systems, Eventual Consistency

Benchmarking, Consistency, Distributed Database Management Systems, Distributed Systems, Eventual Consistency
Title Benchmarking, Consistency, Distributed Database Management Systems, Distributed Systems, Eventual Consistency PDF eBook
Author Bermbach, David
Publisher KIT Scientific Publishing
Pages 202
Release 2014-07-22
Genre Computers
ISBN 3731501864

Download Benchmarking, Consistency, Distributed Database Management Systems, Distributed Systems, Eventual Consistency Book in PDF, Epub and Kindle

Cloud storage services and NoSQL systems typically offer only "Eventual Consistency", a rather weak guarantee covering a broad range of potential data consistency behavior. The degree of actual (in-)consistency, however, is unknown. This work presents novel solutions for determining the degree of (in-)consistency via simulation and benchmarking, as well as the necessary means to resolve inconsistencies leveraging this information.

Consistent Distributed Storage

Consistent Distributed Storage
Title Consistent Distributed Storage PDF eBook
Author Vincent Gramoli
Publisher Springer Nature
Pages 176
Release 2022-05-31
Genre Computers
ISBN 3031020154

Download Consistent Distributed Storage Book in PDF, Epub and Kindle

Providing a shared memory abstraction in distributed systems is a powerful tool that can simplify the design and implementation of software systems for networked platforms. This enables the system designers to work with abstract readable and writable objects without the need to deal with the complexity and dynamism of the underlying platform. The key property of shared memory implementations is the consistency guarantee that it provides under concurrent access to the shared objects. The most intuitive memory consistency model is atomicity because of its equivalence with a memory system where accesses occur serially, one at a time. Emulations of shared atomic memory in distributed systems is an active area of research and development. The problem proves to be challenging, and especially so in distributed message passing settings with unreliable components, as is often the case in networked systems. We present several approaches to implementing shared memory services with the help of replication on top of message-passing distributed platforms subject to a variety of perturbations in the computing medium.

Benchmarking Eventually Consistent Distributed Storage Systems

Benchmarking Eventually Consistent Distributed Storage Systems
Title Benchmarking Eventually Consistent Distributed Storage Systems PDF eBook
Author David Bermbach
Publisher
Pages 198
Release 2020-10-09
Genre Computers
ISBN 9781013280405

Download Benchmarking Eventually Consistent Distributed Storage Systems Book in PDF, Epub and Kindle

Cloud storage services and NoSQL systems typically offer only ""Eventual Consistency"", a rather weak guarantee covering a broad range of potential data consistency behavior. The degree of actual (in-)consistency, however, is unknown. This work presents novel solutions for determining the degree of (in-)consistency via simulation and benchmarking, as well as the necessary means to resolve inconsistencies leveraging this information. This work was published by Saint Philip Street Press pursuant to a Creative Commons license permitting commercial use. All rights not granted by the work's license are retained by the author or authors.

Distributed Systems

Distributed Systems
Title Distributed Systems PDF eBook
Author Matthieu Perrin
Publisher Elsevier
Pages 190
Release 2017-03-25
Genre Computers
ISBN 0081023170

Download Distributed Systems Book in PDF, Epub and Kindle

Distributed Systems: Concurrency and Consistency explores the gray area of distributed systems and draws a map of weak consistency criteria, identifying several families and demonstrating how these may be implemented into a programming language. Unlike their sequential counterparts, distributed systems are much more difficult to design, and are therefore prone to problems. On a large scale, usability reminiscent of sequential consistency, which would provide the same global view to all users, is very expensive or impossible to achieve. This book investigates the best ways to specify the objects that are still possible to implement in these systems. Explores the gray area of distributed systems and draws a map of weak consistency criteria Investigates the best ways to specify the objects that are still possible to implement in these systems Presents a description of existing memory models and consistency criteria

Stabilization, Safety, and Security of Distributed Systems

Stabilization, Safety, and Security of Distributed Systems
Title Stabilization, Safety, and Security of Distributed Systems PDF eBook
Author Paul Spirakis
Publisher Springer
Pages 510
Release 2017-10-20
Genre Computers
ISBN 3319690841

Download Stabilization, Safety, and Security of Distributed Systems Book in PDF, Epub and Kindle

This book constitutes the refereed proceedings of the 19th International Symposium on Stabilization, Safety, and Security of Distributed Systems, SSS 2017, held in Boston, MA, USA, in November 2017. The 29 revised full papers presented together with 8 revised short papers were carefully reviewed and selected from 68 initial submissions. This year the Symposium was organized into three tracks reflecting major trends related to self-* systems: Stabilizing Systems: Theory and Practice: Distributed Computing and Communication Networks; and Computer Security and Information Privacy.

Consistency and Fault Tolerance of Distributed Storage Systems

Consistency and Fault Tolerance of Distributed Storage Systems
Title Consistency and Fault Tolerance of Distributed Storage Systems PDF eBook
Author Kathrin Sobe
Publisher
Pages 127
Release 2013
Genre
ISBN 9783844258899

Download Consistency and Fault Tolerance of Distributed Storage Systems Book in PDF, Epub and Kindle