Software Telemetry shows you how to efficiently collect, store, and analyze system and application log data so you can monitor and improve your systems. Summary In Software Telemetry you will learn how to: Manage toxic telemetry and confidential records Master multi-tenant techniques and transformation processes Update to improve the statistical validity of your metrics and dashboards Make software telemetry emissions easier to parse Build easily-auditable logging systems Prevent and handle accidental data leaks Maintain processes for legal compliance Justify increased spend on telemetry software Software Telemetry teaches you best practices for operating and updating telemetry systems. These vital systems trace, log, and monitor infrastructure by observing and analyzing the events generated by the system. This practical guide is filled with techniques you can apply to any size of organization, with troubleshooting techniques for every eventuality, and methods to ensure your compliance with standards like GDPR. About the technology Take advantage of the data generated by your IT infrastructure! Telemetry systems provide feedback on what’s happening inside your data center and applications, so you can efficiently monitor, maintain, and audit them. This practical book guides you through instrumenting your systems, setting up centralized logging, doing distributed tracing, and other invaluable telemetry techniques. About the book Software Telemetry shows you how to efficiently collect, store, and analyze system and application log data so you can monitor and improve your systems. Manage the pillars of observability—logs, metrics, and traces—in an end-to-end telemetry system that integrates with your existing infrastructure. You’ll discover how software telemetry benefits both small startups and legacy enterprises. And at a time when data audits are increasingly common, you’ll appreciate the thorough coverage of legal compliance processes, so there’s no reason to panic when a discovery request arrives. What's inside Multi-tenant techniques and transformation processes Toxic telemetry and confidential records Updates to improve the statistical validity of your metrics and dashboards Revisions that make software telemetry emissions easier to parse About the reader For software developers and infrastructure engineers supporting and building telemetry systems. About the author Jamie Riedesel is a staff engineer at Dropbox with over twenty years of experience in IT. Table of Contents 1 Introduction PART 1 TELEMETRY SYSTEM ARCHITECTURE 2 The Emitting stage: Creating and submitting telemetry 3 The Shipping stage: Moving and storing telemetry 4 The Shipping stage: Unifying diverse telemetry formats 5 The Presentation stage: Displaying telemetry 6 Marking up and enriching telemetry 7 Handling multitenancy PART 2 USE CASES REVISITED: APPLYING ARCHITECTURE CONCEPTS 8 Growing cloud-based startup 9 Nonsoftware business 10 Long-established business IT PART 3 TECHNIQUES FOR HANDLING TELEMETRY 11 Optimizing for regular expressions at scale 12 Standardized logging and event formats 13 Using more nonfile emitting techniques 14 Managing cardinality in telemetry 15 Ensuring telemetry integrity 16 Redacting and reprocessing telemetry 17 Building policies for telemetry retention and aggregation 18 Surviving legal processes

Software Telemetry is a guide to operating the telemetry systems that monitor and maintain your applications. It takes a big picture view of telemetry, teaching you to manage your logging, metrics, and events as a complete end-to-end ecosystem. You'll learn the base architecture that underpins any software telemetry system, allowing you to easily integrate new systems into your existing infrastructure, and how these systems work under the hood. Throughout, you'll follow three very different companies to see how telemetry techniques impact a greenfield startup, a large legacy enterprise, and a non-technical organization without any in-house development. You'll even cover how software telemetry is used by court processes--ensuring that when your first telemetry subpoena arrives, there's no reason to panic!

The Art and Science of Analyzing Software Data provides valuable information on analysis techniques often used to derive insight from software data. This book shares best practices in the field generated by leading data scientists, collected from their experience training software engineering students and practitioners to master data science. The book covers topics such as the analysis of security data, code reviews, app stores, log files, and user telemetry, among others. It covers a wide variety of techniques such as co-change analysis, text analysis, topic analysis, and concept analysis, as well as advanced topics such as release planning and generation of source code comments. It includes stories from the trenches from expert data scientists illustrating how to apply data analysis in industry and open source, present results to stakeholders, and drive decisions. - Presents best practices, hints, and tips to analyze data and apply tools in data science projects - Presents research methods and case studies that have emerged over the past few years to further understanding of software data - Shares stories from the trenches of successful data science initiatives in industry

The overwhelming majority of a software system’s lifespan is spent in use, not in design or implementation. So, why does conventional wisdom insist that software engineers focus primarily on the design and development of large-scale computing systems? In this collection of essays and articles, key members of Google’s Site Reliability Team explain how and why their commitment to the entire lifecycle has enabled the company to successfully build, deploy, monitor, and maintain some of the largest software systems in the world. You’ll learn the principles and practices that enable Google engineers to make systems more scalable, reliable, and efficient—lessons directly applicable to your organization. This book is divided into four sections: Introduction—Learn what site reliability engineering is and why it differs from conventional IT industry practices Principles—Examine the patterns, behaviors, and areas of concern that influence the work of a site reliability engineer (SRE) Practices—Understand the theory and practice of an SRE’s day-to-day work: building and operating large distributed computing systems Management—Explore Google's best practices for training, communication, and meetings that your organization can use

Nanosatellites: Space and Ground Technologies, Operations and Economics Rogerio Atem de Carvalho, Instituto Federal Fluminense, Brazil Jaime Estela, Spectrum Aerospace Group, Germany and Peru Martin Langer, Technical University of Munich, Germany Covering the latest research on nanosatellites Nanosatellites: Space and Ground Technologies, Operations and Economics comprehensively presents the latest research on the fast-developing area of nanosatellites. Divided into three distinct sections, the book begins with a brief history of nanosatellites and introduces nanosatellites technologies and payloads, also explaining how these are deployed into space. The second section provides an overview of the ground segment and operations, and the third section focuses on the regulations, policies, economics, and future trends. Key features: Payloads for nanosatellites Nanosatellites components design Examines the cost of development of nanosatellites. Covers the latest policies and regulations. Considers future trends for nanosatellites. Nanosatellites: Space and Ground Technologies, Operations and Economics is a comprehensive reference for researchers and practitioners working with nanosatellites in the aerospace industry.