Until now, the only way to capture, store, and effectively retain constantly growing amounts of enterprise data was to add more disk space to the storage infrastructure, an approach that can quickly become cost-prohibitive as information volumes continue to grow and capital budgets for infrastructure do not. In this IBM® Redbooks® publication, we introduce data deduplication, which has emerged as a key technology in dramatically reducing the amount of, and therefore the cost associated with storing, large amounts of data. Deduplication is the art of intelligently reducing storage needs through the elimination of redundant data so that only one instance of a data set is actually stored. Deduplication reduces data an order of magnitude better than common data compression techniques. IBM has the broadest portfolio of deduplication solutions in the industry, giving us the freedom to solve customer issues with the most effective technology. Whether it is source or target, inline or post, hardware or software, disk or tape, IBM has a solution with the technology that best solves the problem. This IBM Redbooks publication covers the current deduplication solutions that IBM has to offer: IBM ProtecTIER® Gateway and Appliance IBM Tivoli® Storage Manager IBM System Storage® N series Deduplication

This IBM® Redbooks® publication provides best practice guidance for planning, installing, configuring, and employing the IBM TS7600 ProtecTIER® family of products. It provides the latest best practices for the practical application of ProtecTIER Software Version 3.4. This latest release introduces the new ProtecTIER Enterprise Edition TS7650G DD6 model high performance server. This book also includes information about the revolutionary and patented IBM HyperFactor® deduplication engine, along with other data storage efficiency techniques, such as compression and defragmentation. The IBM System Storage® TS7650G ProtecTIER Deduplication Gateway and the IBM System Storage TS7620 ProtecTIER Deduplication Appliance Express are disk-based data storage systems: The Virtual Tape Library (VTL) interface is the foundation of ProtecTIER and emulates traditional automated tape libraries. For your existing ProtecTIER solution, this guide provides best practices and suggestions to boost the performance and the effectiveness of data deduplication with regards to your application platforms for your VTL and FSI (systems prior to version 3.4). When you build a ProtecTIER data deduplication environment, this guide can help IT architects and solution designers plan for the best option and scenario for data deduplication for their environments. This book can help you optimize your deduplication ratio, while reducing the hardware, power and cooling, and management costs. This Redbooks publication provides expertise that was gained from an IBM ProtecTIER System Client Technical Specialist (CTS), Development, and Quality Assurance teams. This planning should be done by the Sales Representative or IBM Business Partner, with the help of an IBM System CTS or IBM Solution Architect.

Continuing its commitment to developing and delivering industry-leading storage technologies, IBM® introduces Data Reduction Pools (DRP) and Deduplication powered by IBM SpectrumTM Virtualize, which are innovative storage features that deliver essential storage efficiency technologies and exceptional ease of use and performance, all integrated into a proven design. This book discusses Data Reduction Pools (DRP) and Deduplication and is intended for experienced storage administrators who are fully familiar with IBM Spectrum Virtualize, SAN Volume Controller, and the Storwize family of products.

This handbook brings together a variety of approaches to the uses of big data in multiple fields, primarily science, medicine, and business. This single resource features contributions from researchers around the world from a variety of fields, where they share their findings and experience. This book is intended to help spur further innovation in big data. The research is presented in a way that allows readers, regardless of their field of study, to learn from how applications have proven successful and how similar applications could be used in their own field. Contributions stem from researchers in fields such as physics, biology, energy, healthcare, and business. The contributors also discuss important topics such as fraud detection, privacy implications, legal perspectives, and ethical handling of big data.

As we move towards becoming a smarter planet and the world becomes more instrumented, interconnected, and intelligent, the demands for data center resources are increasing rapidly. Smaller and more densely packed servers providing greater amounts of computing power can substantially increase power and cooling needs, while growing data volumes necessitate larger storage and network bandwidth capacities. Environmental and regulatory requirements can introduce additional limits on carbon emissions and water consumption. To satisfy these demands while keeping costs in check, our data centers need to be smarter as well. Comprehensive views of data center inventories, operational and environmental conditions, and consumption across multiple capacity types that span both facilities and IT are required. You can achieve greater efficiency using hardware, software, services, and design both in facilities and IT, but you need a comprehensive data center strategy to tie them together and thus obtain a complete picture of your data center environments. This IBM® RedpaperTM publication discusses important considerations when creating and implementing your smarter data center strategy. Notable techniques, best practices, and technological advances that can become critical components of success are included, along with methods for bringing them together to gain in-depth knowledge of data center operations. With such insight comes increased resiliency, rapid responsiveness, profitable access to detailed analytics, and reliable planning for the future. Although not all-inclusive, this document provides a guide to getting started, points you to additional sources of information, and suggests ways IBM can partner with you in your pursuit of a smarter data center.

IBM® Real-time CompressionTM is fully integrated in the IBM XIV® Storage System Gen3 with software version 11.6. Real-time Compression provides the possibility to store 2 - 5 times more data per XIV system, without additional hardware. This technology also expands the storage-replication-related bandwidth, and can significantly decrease the total cost of ownership (TCO). Using compression for replication and for volume migration with IBM Hyper-Scale Mobility is faster, and requires less bandwidth for the interlink connections between the IBM XIV storage systems, because the data that is transferred through these links is already compressed. IBM Real-time Compression uses patented IBM Random Access Compression Engine (RACE) technology, achieving field-proven compression ratios and performance with compressible data. This IBM RedpaperTM publication helps administrators understand and implement IBM Real-time Compression on the IBM XIV Gen3 storage system.