Protocol- and Situation-aware Distributed Storage Systems

Protocol- and Situation-aware Distributed Storage Systems
Title Protocol- and Situation-aware Distributed Storage Systems PDF eBook
Author Ramnatthan Alagappan
Publisher
Pages 220
Release 2019
Genre
ISBN

Download Protocol- and Situation-aware Distributed Storage Systems Book in PDF, Epub and Kindle

We are dependent upon data in many aspects of our lives. Much of this data is stored and managed by distributed storage systems that run in data centers, powering many modern applications such as e-commerce, photo sharing, video streaming, search, social networking, messaging, collaborative editing, and even health-care and financial services. A distributed storage system stores copies of a piece of data on many nodes for fault-tolerance: even when a few nodes fail, the system can still provide access to data. Each of these nodes depends upon a local storage stack to safely store and manage user data. The local storage stack is complex, consisting of many hardware and software components. Due to this complexity, the storage layer is a place for many potential problems to arise. This dissertation examines the reliability and performance challenges that arise the interaction points between a distributed system and the local storage stack. In the first part of this thesis, we study how distributed storage systems react to storage faults: cases where the storage device may return corrupted data or errors. We focus on replicated state machine systems, an important class of distributed systems. We find that none of the existing approaches used in current systems can safely handle storage faults, leading to data loss and unavailability. Using the insights gained in our study, we design corruption-tolerant replication (CTRL), a protocol-aware recovery approach for RSM systems. CTRL exploits protocol-specific knowledge of how RSM systems operate, to ensure safety and high availability in the presence of storage faults without impacting performance. In the second part, we study the performance and reliability properties of replication protocols used by distributed systems. We find there exists a dichotomy with respect to how and where current approaches store system state. One approach writes data to the storage stack synchronously, whereas the other buffers the data in volatile memory. The choice of whether data is written synchronously to the storage device or not greatly influences the system's robustness to crash failures and its performance. We show that existing approaches either provide robustness to crashes or performance, but not both. Thus, we introduce situation-aware updates and crash recovery, a dynamic protocol that, depending upon the situation, writes either synchronously or asynchronously to the storage devices, achieving both strong reliability and high performance. In the final part of this thesis, we study the effects of file-system crash behaviors in distributed storage systems. We build protocol-aware crash explorer or PACE, a tool that can model and reason about file-system crash behaviors in distributed systems under a special correlated crash failure scenario. Our study reveals that the correctness of update and recovery protocols of many distributed systems hinges upon how the local file-system state is updated by each replica. We perform a detailed analysis of the vulnerabilities, showing their serious consequences and prevalence on commonly used file systems. We finally point to possible solutions to the problems discovered.

Data Intensive Distributed Computing: Challenges and Solutions for Large-scale Information Management

Data Intensive Distributed Computing: Challenges and Solutions for Large-scale Information Management
Title Data Intensive Distributed Computing: Challenges and Solutions for Large-scale Information Management PDF eBook
Author Kosar, Tevfik
Publisher IGI Global
Pages 353
Release 2012-01-31
Genre Computers
ISBN 1615209727

Download Data Intensive Distributed Computing: Challenges and Solutions for Large-scale Information Management Book in PDF, Epub and Kindle

"This book focuses on the challenges of distributed systems imposed by the data intensive applications, and on the different state-of-the-art solutions proposed to overcome these challenges"--Provided by publisher.

Context-Aware Computing and Self-Managing Systems

Context-Aware Computing and Self-Managing Systems
Title Context-Aware Computing and Self-Managing Systems PDF eBook
Author Waltenegus Dargie
Publisher CRC Press
Pages 408
Release 2009-03-25
Genre Computers
ISBN 1420077724

Download Context-Aware Computing and Self-Managing Systems Book in PDF, Epub and Kindle

Bringing together an extensively researched area with an emerging research issue, Context-Aware Computing and Self-Managing Systems presents the core contributions of context-aware computing in the development of self-managing systems, including devices, applications, middleware, and networks. The expert contributors reveal the usefulness of contex

Enabling Context-Aware Web Services

Enabling Context-Aware Web Services
Title Enabling Context-Aware Web Services PDF eBook
Author Quan Z. Sheng
Publisher CRC Press
Pages 558
Release 2010-05-06
Genre Computers
ISBN 1439809860

Download Enabling Context-Aware Web Services Book in PDF, Epub and Kindle

With recent advances in radio-frequency identification (RFID) technology, sensor networks, and enhanced Web services, the original World Wide Web is continuing its evolution into what is being called the Web of Things and Services. Such a Web will support an ultimately interactive environment where everyday physical objects such as buildings, sidew

Protocols and Systems for Interactive Distributed Multimedia

Protocols and Systems for Interactive Distributed Multimedia
Title Protocols and Systems for Interactive Distributed Multimedia PDF eBook
Author Fernando Boavida
Publisher Springer
Pages 386
Release 2003-08-02
Genre Computers
ISBN 3540361669

Download Protocols and Systems for Interactive Distributed Multimedia Book in PDF, Epub and Kindle

This book constitutes the refereed proceedings of the Joint International Workshops on Interactive Distributed Multimedia Systems and Protocols for Multimedia Systems, IDMS/PROMS 2002, held in Coimbra, Portugal in November 2002.The 30 revised full papers presented were carefully reviewed and selected from 112 submissions. The papers are organized in topical sections on performance of protocols and applications, mobile multimedia systems, standards and related issues, quality of service, video systems and applications, resource management, and multimedia support.

Optimizations for Energy-aware, High-performance and Reliable Distributed Storage Systems

Optimizations for Energy-aware, High-performance and Reliable Distributed Storage Systems
Title Optimizations for Energy-aware, High-performance and Reliable Distributed Storage Systems PDF eBook
Author Cengiz Karakoyunlu
Publisher
Pages 0
Release 2016
Genre
ISBN

Download Optimizations for Energy-aware, High-performance and Reliable Distributed Storage Systems Book in PDF, Epub and Kindle

Networking and Information Technology Research and Development

Networking and Information Technology Research and Development
Title Networking and Information Technology Research and Development PDF eBook
Author National Science and Technology Council (U.S.). Subcommittee on Networking and Information Technology Research and Development
Publisher
Pages 40
Release 2006
Genre Computer networks
ISBN

Download Networking and Information Technology Research and Development Book in PDF, Epub and Kindle