Zusammenfassung: This book offers a comprehensive survey of shared-memory synchronization, with an emphasis on "systems-level" issues. It includes sufficient coverage of architectural details to understand correctness and performance on modern multicore machines, and sufficient coverage of higher-level issues to understand how synchronization is embedded in modern programming languages. The primary intended audience for this book is "systems programmers"--the authors of operating systems, library packages, language run-time systems, concurrent data structures, and server and utility programs. Much of the discussion should also be of interest to application programmers who want to make good use of the synchronization mechanisms available to them, and to computer architects who want to understand the ramifications of their design decisions on systems-level code

Bringing a deep-learning project into production at scale is quite challenging. To successfully scale your project, a foundational understanding of full stack deep learning, including the knowledge that lies at the intersection of hardware, software, data, and algorithms, is required. This book illustrates complex concepts of full stack deep learning and reinforces them through hands-on exercises to arm you with tools and techniques to scale your project. A scaling effort is only beneficial when it's effective and efficient. To that end, this guide explains the intricate concepts and techniques that will help you scale effectively and efficiently. You'll gain a thorough understanding of: How data flows through the deep-learning network and the role the computation graphs play in building your model How accelerated computing speeds up your training and how best you can utilize the resources at your disposal How to train your model using distributed training paradigms, i.e., data, model, and pipeline parallelism How to leverage PyTorch ecosystems in conjunction with NVIDIA libraries and Triton to scale your model training Debugging, monitoring, and investigating the undesirable bottlenecks that slow down your model training How to expedite the training lifecycle and streamline your feedback loop to iterate model development A set of data tricks and techniques and how to apply them to scale your training model How to select the right tools and techniques for your deep-learning project Options for managing the compute infrastructure when running at scale

This book constitutes the proceedings of the 18th International Symposium on Applied Reconfigurable Computing, ARC 2022, held as a virtual event, in September 2022. The 13 full papers presented in this volume were reviewed and selected from 16 submissions. The papers cover a broad spectrum of applications of reconfigurable computing, from driving assistance, data and graph processing acceleration, computer security to the societal relevant topic of supporting early diagnosis of Covid infectious conditions.

An NPR 2023 "Books We Love" Pick One of the Next Big Idea Club's Must-Read Books "An invaluable primer to arguably the most important driver of change for our future." —P. W. Singer, author of Burn-In An award-winning defense expert tells the story of today’s great power rivalry—the struggle to control artificial intelligence. A new industrial revolution has begun. Like mechanization or electricity before it, artificial intelligence will touch every aspect of our lives—and cause profound disruptions in the balance of global power, especially among the AI superpowers: China, the United States, and Europe. Autonomous weapons expert Paul Scharre takes readers inside the fierce competition to develop and implement this game-changing technology and dominate the future. Four Battlegrounds argues that four key elements define this struggle: data, computing power, talent, and institutions. Data is a vital resource like coal or oil, but it must be collected and refined. Advanced computer chips are the essence of computing power—control over chip supply chains grants leverage over rivals. Talent is about people: which country attracts the best researchers and most advanced technology companies? The fourth “battlefield” is maybe the most critical: the ultimate global leader in AI will have institutions that effectively incorporate AI into their economy, society, and especially their military. Scharre’s account surges with futuristic technology. He explores the ways AI systems are already discovering new strategies via millions of war-game simulations, developing combat tactics better than any human, tracking billions of people using biometrics, and subtly controlling information with secret algorithms. He visits China’s “National Team” of leading AI companies to show the chilling synergy between China’s government, private sector, and surveillance state. He interviews Pentagon leadership and tours U.S. Defense Department offices in Silicon Valley, revealing deep tensions between the military and tech giants who control data, chips, and talent. Yet he concludes that those tensions, inherent to our democratic system, create resilience and resistance to autocracy in the face of overwhelmingly powerful technology. Engaging and direct, Four Battlegrounds offers a vivid picture of how AI is transforming warfare, global security, and the future of human freedom—and what it will take for democracies to remain at the forefront of the world order.

This book presents the refereed proceedings of the Eighth Annual Workshop on Languages and Compilers for Parallel Computing, held in Columbus, Ohio in August 1995. The 38 full revised papers presented were carefully selected for inclusion in the proceedings and reflect the state of the art of research and advanced applications in parallel languages, restructuring compilers, and runtime systems. The papers are organized in sections on fine-grain parallelism, interprocedural analysis, program analysis, Fortran 90 and HPF, loop parallelization for HPF compilers, tools and libraries, loop-level optimization, automatic data distribution, compiler models, irregular computation, object-oriented and functional parallelism.