Inspired by MPEG-I and JPEG-PLENO standardization activities, this book is for readers who want to understand 3D representations and multi-camera video processing for novel immersive media applications. The authors address new challenges that arise beyond compression-only, such as depth acquisition and 3D rendering.

Get a broad overview of the different modalities of immersive video technologies—from omnidirectional video to light fields and volumetric video—from a multimedia processing perspective. From capture to representation, coding, and display, video technologies have been evolving significantly and in many different directions over the last few decades, with the ultimate goal of providing a truly immersive experience to users. After setting up a common background for these technologies, based on the plenoptic function theoretical concept, Immersive Video Technologies offers a comprehensive overview of the leading technologies enabling visual immersion, including omnidirectional (360 degrees) video, light fields, and volumetric video. Following the critical components of the typical content production and delivery pipeline, the book presents acquisition, representation, coding, rendering, and quality assessment approaches for each immersive video modality. The text also reviews current standardization efforts and explores new research directions. With this book the reader will a) gain a broad understanding of immersive video technologies that use three different modalities: omnidirectional video, light fields, and volumetric video; b) learn about the most recent scientific results in the field, including the recent learning-based methodologies; and c) understand the challenges and perspectives for immersive video technologies. - Describes the whole content processing chain for the main immersive video modalities (omnidirectional video, light fields, and volumetric video) - Offers a common theoretical background for immersive video technologies based on the concept of plenoptic function - Presents some exemplary applications of immersive video technologies

With the advent of consumer-market Virtual Reality (VR) technology, the next revolution in visual entertainment is already on the horizon: real VR will enable us to experience live-action movies, sports broadcasts, concert videos, etc. in true visual (and aural) immersion. This book provides a comprehensive overview of the algorithms and methods that make it possible to immerse into real-world recordings. It brings together the expertise of internationally renowned experts from academia and industry who present the state of the art in this fascinating, interdisciplinary new research field. Written by and for scientists, engineers, and practitioners, this book is the definitive reference for anyone interested in finding out about how to import the real world into head-mounted displays.

As virtual reality expands from the imaginary worlds of science fiction and pervades every corner of everyday life, it is becoming increasingly important for students and professionals alike to understand the diverse aspects of this technology. This book aims to provide a comprehensive guide to the theoretical and practical elements of virtual reality, from the mathematical and technological foundations of virtual worlds to the human factors and the applications that enrich our lives: in the fields of medicine, entertainment, education and others. After providing a brief introduction to the topic, the book describes the kinematic and dynamic mathematical models of virtual worlds. It explores the many ways a computer can track and interpret human movement, then progresses through the modalities that make up a virtual world: visual, acoustic and haptic. It explores the interaction between the actual and virtual environments, as well as design principles of the latter. The book closes with an examination of different applications, focusing on augmented reality as a special case. Though the content is primarily VR-related, it is also relevant for many other fields.

Annotation Get an introduction to the technologies, tools, and techniques for programming virtual reality on the latest generation of desktop and mobile VR hardware. With this hands-on guide, you'll learn essential development and production concepts, including UI design, stereo rendering, 3D input, and programming VR applications for native desktop, mobile and the web. You don't have to be a game development wizard or have 3D graphics experience to get started. If you have basic programming skills and some familiarity with mobile development, this book will help you gain a working knowledge of virtual reality through clear and simple examples.

Explore the latest features of Unity and build VR experiences including first-person interactions, audio fireball games, 360-degree media, art gallery tours, and VR storytelling Key FeaturesDiscover step-by-step instructions and best practices to begin your VR development journeyExplore Unity features such as URP rendering, XR Interaction Toolkit, and ProBuilderBuild impressive VR-based apps and games that can be experienced using modern devices like Oculus Rift and Oculus QuestBook Description This third edition of the Unity Virtual Reality (VR) development guide is updated to cover the latest features of Unity 2019.4 or later versions - the leading platform for building VR games, applications, and immersive experiences for contemporary VR devices. Enhanced with more focus on growing components, such as Universal Render Pipeline (URP), extended reality (XR) plugins, the XR Interaction Toolkit package, and the latest VR devices, this edition will help you to get up to date with the current state of VR. With its practical and project-based approach, this book covers the specifics of virtual reality development in Unity. You'll learn how to build VR apps that can be experienced with modern devices from Oculus, VIVE, and others. This virtual reality book presents lighting and rendering strategies to help you build cutting-edge graphics, and explains URP and rendering concepts that will enable you to achieve realism for your apps. You'll build real-world VR experiences using world space user interface canvases, locomotion and teleportation, 360-degree media, and timeline animation, as well as learn about important VR development concepts, best practices, and performance optimization and user experience strategies. By the end of this Unity book, you'll be fully equipped to use Unity to develop rich, interactive virtual reality experiences. What you will learnUnderstand the current state of virtual reality and VR consumer productsGet started with Unity by building a simple diorama scene using Unity Editor and imported assetsConfigure your Unity VR projects to run on VR platforms such as Oculus, SteamVR, and Windows immersive MRDesign and build a VR storytelling animation with a soundtrack and timelinesImplement an audio fireball game using game physics and particle systemsUse various software patterns to design Unity events and interactable componentsDiscover best practices for lighting, rendering, and post-processingWho this book is for Whether you're a non-programmer unfamiliar with 3D computer graphics or experienced in both but new to virtual reality, if you're interested in building your own VR games or applications, this Unity book is for you. Any experience in Unity will be useful but is not necessary.

Academic Press Library in Signal Processing, Volume 6: Image and Video Processing and Analysis and Computer Vision is aimed at university researchers, post graduate students and R&D engineers in the industry, providing a tutorial-based, comprehensive review of key topics and technologies of research in both image and video processing and analysis and computer vision. The book provides an invaluable starting point to the area through the insight and understanding that it provides. With this reference, readers will quickly grasp an unfamiliar area of research, understand the underlying principles of a topic, learn how a topic relates to other areas, and learn of research issues yet to be resolved. - Presents a quick tutorial of reviews of important and emerging topics of research - Explores core principles, technologies, algorithms and applications - Edited and contributed by international leading figures in the field - Includes comprehensive references to journal articles and other literature upon which to build further, more detailed knowledge