Perceptual Optimization and Complexity Reduction for Real-time Video Encoding

Download Perceptual Optimization and Complexity Reduction for Real-time Video Encoding PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 0 pages
Book Rating : 4.:/5 (125 download)

DOWNLOAD NOW!


Book Synopsis Perceptual Optimization and Complexity Reduction for Real-time Video Encoding by : Madhukar Bhat

Download or read book Perceptual Optimization and Complexity Reduction for Real-time Video Encoding written by Madhukar Bhat and published by . This book was released on 2021 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: This thesis explores perceptual optimization and complexity reduction towards improving video compression schemes in a real-time encoding framework context. Different strategies are proposed to address perceptual enhancements and complexity reduction. The work is divided into three main parts that tackle several aspects to improve real-time video encoding. The first contribution introduces a perceptual pre-processing filter based on a model of the Human Visual System. This preprocessing filter can be tuned and has been optimized for multiple viewing conditions. An investigation of different objective quality metric's accuracy in measuring the performance of pre-processing is also reported. The second part of the thesis proposes a machine learning classification-based methodology to adaptively predict and select the best encoding resolution in a single-pass encoding scenario. For this purpose, three different classifiers have been considered: Support Vector Machine, Random Forest (RF), and Multi-Layer Perceptron. Several objective quality metrics have been characterized and benchmarked for various quality ranges concerning the uncertainty of subjective quality ground-truth to evaluate and drive the perceptual gain at a given bitrate. Also, a new, subjectively more accurate RFbased fusion metric has been introduced for ground truth dataset annotation of classifiers. The final part focuses on tackling the most challenging encoding part of the new Versatile Video Coding (VVC) standard: the Multi-Type Tree partitioning decision. A new ML-based partitioning decision criteria is proposed covering all standard partitioning possibilities for both intra and inter, especially suitable for realtime hardware encoder. A CNN-based approach was considered, offering classifiers for different coding unit depth, shapes, and picture types.

Complexity-Aware High Efficiency Video Coding

Download Complexity-Aware High Efficiency Video Coding PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 3319257781
Total Pages : 246 pages
Book Rating : 4.3/5 (192 download)

DOWNLOAD NOW!


Book Synopsis Complexity-Aware High Efficiency Video Coding by : Guilherme Corrêa

Download or read book Complexity-Aware High Efficiency Video Coding written by Guilherme Corrêa and published by Springer. This book was released on 2015-12-29 with total page 246 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book discusses computational complexity of High Efficiency Video Coding (HEVC) encoders with coverage extending from the analysis of HEVC compression efficiency and computational complexity to the reduction and scaling of its encoding complexity. After an introduction to the topic and a review of the state-of-the-art research in the field, the authors provide a detailed analysis of the HEVC encoding tools compression efficiency and computational complexity. Readers will benefit from a set of algorithms for scaling the computational complexity of HEVC encoders, all of which take advantage from the flexibility of the frame partitioning structures allowed by the standard. The authors also provide a set of early termination methods based on data mining and machine learning techniques, which are able to reduce the computational complexity required to find the best frame partitioning structures. The applicability of the proposed methods is finally exemplified with an encoding time control system that employs the best complexity reduction and scaling methods presented throughout the book. The methods presented in this book are especially useful in power-constrained, portable multimedia devices to reduce energy consumption and to extend battery life. They can also be applied to portable and non-portable multimedia devices operating in real time with limited computational resources.

Optimization of Video Encoding for Computational Complexity Reduction and Performance Improvement

Download Optimization of Video Encoding for Computational Complexity Reduction and Performance Improvement PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 394 pages
Book Rating : 4.:/5 (19 download)

DOWNLOAD NOW!


Book Synopsis Optimization of Video Encoding for Computational Complexity Reduction and Performance Improvement by : 王瀚漓

Download or read book Optimization of Video Encoding for Computational Complexity Reduction and Performance Improvement written by 王瀚漓 and published by . This book was released on 2007 with total page 394 pages. Available in PDF, EPUB and Kindle. Book excerpt:

Real-Time Video Compression

Download Real-Time Video Compression PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 0585323135
Total Pages : 164 pages
Book Rating : 4.5/5 (853 download)

DOWNLOAD NOW!


Book Synopsis Real-Time Video Compression by : Raymond Westwater

Download or read book Real-Time Video Compression written by Raymond Westwater and published by Springer. This book was released on 2007-08-28 with total page 164 pages. Available in PDF, EPUB and Kindle. Book excerpt: Real-Time Video Compression: Techniques and Algorithms introduces the XYZ video compression technique, which operates in three dimensions, eliminating the overhead of motion estimation. First, video compression standards, MPEG and H.261/H.263, are described. They both use asymmetric compression algorithms, based on motion estimation. Their encoders are much more complex than decoders. The XYZ technique uses a symmetric algorithm, based on the Three-Dimensional Discrete Cosine Transform (3D-DCT). 3D-DCT was originally suggested for compression about twenty years ago; however, at that time the computational complexity of the algorithm was too high, it required large buffer memory, and was not as effective as motion estimation. We have resurrected the 3D-DCT-based video compression algorithm by developing several enhancements to the original algorithm. These enhancements make the algorithm feasible for real-time video compression in applications such as video-on-demand, interactive multimedia, and videoconferencing. The demonstrated results, presented in this book, suggest that the XYZ video compression technique is not only a fast algorithm, but also provides superior compression ratios and high quality of the video compared to existing standard techniques, such as MPEG and H.261/H.263. The elegance of the XYZ technique is in its simplicity, which leads to inexpensive VLSI implementation of any XYZ codec. Real-Time Video Compression: Techniques and Algorithms can be used as a text for graduate students and researchers working in the area of real-time video compression. In addition, the book serves as an essential reference for professionals in the field.

Communicating Pictures

Download Communicating Pictures PDF Online Free

Author :
Publisher : Academic Press
ISBN 13 : 0080993745
Total Pages : 561 pages
Book Rating : 4.0/5 (89 download)

DOWNLOAD NOW!


Book Synopsis Communicating Pictures by : David Bull

Download or read book Communicating Pictures written by David Bull and published by Academic Press. This book was released on 2014-07-19 with total page 561 pages. Available in PDF, EPUB and Kindle. Book excerpt: Communicating Pictures starts with a unique historical perspective of the role of images in communications and then builds on this to explain the applications and requirements of a modern video coding system. It draws on the author's extensive academic and professional experience of signal processing and video coding to deliver a text that is algorithmically rigorous, yet accessible, relevant to modern standards, and practical. It offers a thorough grounding in visual perception, and demonstrates how modern image and video compression methods can be designed in order to meet the rate-quality performance levels demanded by today's applications, networks and users.With this book you will learn: Practical issues when implementing a codec, such as picture boundary extension and complexity reduction, with particular emphasis on efficient algorithms for transforms, motion estimators and error resilience Conflicts between conventional video compression, based on variable length coding and spatiotemporal prediction, and the requirements for error resilient transmission How to assess the quality of coded images and video content, both through subjective trials and by using perceptually optimised objective metrics Features, operation and performance of the state-of-the-art High Efficiency Video Coding (HEVC) standard Covers the basics of video communications and includes a strong grounding in how we perceive images and video, and how we can exploit redundancy to reduce bitrate and improve rate distortion performance Gives deep insight into the pitfalls associated with the transmission of real-time video over networks (wireless and fixed) Uses the state-of- the-art video coding standard (H.264/AVC) as a basis for algorithm development in the context of block based compression Insight into future video coding standards such as the new ISO/ITU High Efficiency Video Coding (HEVC) initiative, which extends and generalizes the H.264/AVC approach

Academic Press Library in Signal Processing

Download Academic Press Library in Signal Processing PDF Online Free

Author :
Publisher : Academic Press
ISBN 13 : 0124201571
Total Pages : 505 pages
Book Rating : 4.1/5 (242 download)

DOWNLOAD NOW!


Book Synopsis Academic Press Library in Signal Processing by : David Bull

Download or read book Academic Press Library in Signal Processing written by David Bull and published by Academic Press. This book was released on 2014-06-12 with total page 505 pages. Available in PDF, EPUB and Kindle. Book excerpt: This fifth volume, edited and authored by world leading experts, gives a review of the principles, methods and techniques of important and emerging research topics and technologies in image and video compression and multimedia. With this reference source you will: Quickly grasp a new area of research Understand the underlying principles of a topic and its application Ascertain how a topic relates to other areas and learn of the research issues yet to be resolved Quick tutorial reviews of important and emerging topics of research in Image and Video Compression and Multimedia Comprehensive references to journal articles and other literature on which to build further, more specific and detailed knowledge Edited by leading people in the field who, through their reputation, have been able to commission experts to write on a particular topic

Video Coding for Mobile Communications

Download Video Coding for Mobile Communications PDF Online Free

Author :
Publisher : Elsevier
ISBN 13 : 0080520545
Total Pages : 321 pages
Book Rating : 4.0/5 (85 download)

DOWNLOAD NOW!


Book Synopsis Video Coding for Mobile Communications by : Mohammed Al-Mualla

Download or read book Video Coding for Mobile Communications written by Mohammed Al-Mualla and published by Elsevier. This book was released on 2002-05-13 with total page 321 pages. Available in PDF, EPUB and Kindle. Book excerpt: In order for wireless devices to function, the signals must be coded in standard ways so that the sender and the receiver can communicate. This area of video source coding is one of the key challenges in the worldwide push to deliver full video communications over wireless devices. Video Coding for Mobile Communications reviews current progress in this field and looks at how to solve some of the most important technology issues in the months and years ahead. The vision of being able to communicate from anywhere, at any time, and with any type of information is on its way to becoming reality. This natural convergence of mobile communications and multimedia is a field that is expected to achieve unprecedented growth and commercial success. Current wireless communication devices support a number of basic multimedia services (voice, messages, basic internet access), but have coding problems that need to be solved before "real-time" mobile video communication can be achieved. Addresses the emerging field of mobile multimedia communications

Information Security and Assurance

Download Information Security and Assurance PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 3642231411
Total Pages : 419 pages
Book Rating : 4.6/5 (422 download)

DOWNLOAD NOW!


Book Synopsis Information Security and Assurance by : Tai-Hoon Kim

Download or read book Information Security and Assurance written by Tai-Hoon Kim and published by Springer. This book was released on 2011-08-16 with total page 419 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the proceedings of the International Conference on Information Security and Assurance, held in Brno, Czech Republic in August 2011.

Signal and Information Processing, Networking and Computers

Download Signal and Information Processing, Networking and Computers PDF Online Free

Author :
Publisher : Springer Nature
ISBN 13 : 9811933871
Total Pages : 1534 pages
Book Rating : 4.8/5 (119 download)

DOWNLOAD NOW!


Book Synopsis Signal and Information Processing, Networking and Computers by : Jiande Sun

Download or read book Signal and Information Processing, Networking and Computers written by Jiande Sun and published by Springer Nature. This book was released on 2022-07-01 with total page 1534 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book collects selected papers from the 8th Conference on Signal and Information Processing, Networking and Computers held in Ji’nan, Shandong, China on September 13-17, 2021. It focuses on the current works of information theory, communication system, computer science, aerospace technologies and big data and other related technologies. Readers from both academia and industry of this field can contribute and find their interests from the book.

Intelligent Multimedia Technologies for Networking Applications: Techniques and Tools

Download Intelligent Multimedia Technologies for Networking Applications: Techniques and Tools PDF Online Free

Author :
Publisher : IGI Global
ISBN 13 : 1466628340
Total Pages : 530 pages
Book Rating : 4.4/5 (666 download)

DOWNLOAD NOW!


Book Synopsis Intelligent Multimedia Technologies for Networking Applications: Techniques and Tools by : Kanellopoulos, Dimitris

Download or read book Intelligent Multimedia Technologies for Networking Applications: Techniques and Tools written by Kanellopoulos, Dimitris and published by IGI Global. This book was released on 2013-01-31 with total page 530 pages. Available in PDF, EPUB and Kindle. Book excerpt: As ubiquitous multimedia applications benefit from the rapid development of intelligent multimedia technologies, there is an inherent need to present frameworks, techniques and tools that adopt these technologies to a range of networking applications. Intelligent Multimedia Technologies for Networking Applications: Techniques and Tools promotes the discussion of specific solutions for improving the quality of multimedia experience while investigating issues arising from the deployment of techniques for adaptive video streaming. This reference source provides relevant theoretical frameworks and leading empirical research findings and is suitable for practitioners and researchers in the area of multimedia technology.

MultiMedia Modeling

Download MultiMedia Modeling PDF Online Free

Author :
Publisher : Springer Nature
ISBN 13 : 3030377318
Total Pages : 860 pages
Book Rating : 4.0/5 (33 download)

DOWNLOAD NOW!


Book Synopsis MultiMedia Modeling by : Yong Man Ro

Download or read book MultiMedia Modeling written by Yong Man Ro and published by Springer Nature. This book was released on 2019-12-27 with total page 860 pages. Available in PDF, EPUB and Kindle. Book excerpt: The two-volume set LNCS 11961 and 11962 constitutes the thoroughly refereed proceedings of the 25th International Conference on MultiMedia Modeling, MMM 2020, held in Daejeon, South Korea, in January 2020. Of the 171 submitted full research papers, 40 papers were selected for oral presentation and 46 for poster presentation; 28 special session papers were selected for oral presentation and 8 for poster presentation; in addition, 9 demonstration papers and 6 papers for the Video Browser Showdown 2020 were accepted. The papers of LNCS 11961 are organized in the following topical sections: audio and signal processing; coding and HVS; color processing and art; detection and classification; face; image processing; learning and knowledge representation; video processing; poster papers; the papers of LNCS 11962 are organized in the following topical sections: poster papers; AI-powered 3D vision; multimedia analytics: perspectives, tools and applications; multimedia datasets for repeatable experimentation; multi-modal affective computing of large-scale multimedia data; multimedia and multimodal analytics in the medical domain and pervasive environments; intelligent multimedia security; demo papers; and VBS papers.

Low Complexity H.264 Video Encoder Design Using Machine Learning Techniques

Download Low Complexity H.264 Video Encoder Design Using Machine Learning Techniques PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 118 pages
Book Rating : 4.:/5 (429 download)

DOWNLOAD NOW!


Book Synopsis Low Complexity H.264 Video Encoder Design Using Machine Learning Techniques by : Paula Carrillo

Download or read book Low Complexity H.264 Video Encoder Design Using Machine Learning Techniques written by Paula Carrillo and published by . This book was released on 2008 with total page 118 pages. Available in PDF, EPUB and Kindle. Book excerpt: H.264/AVC encoder complexity is mainly due to variable size in Intra and Inter frames. This makes H.264/AVC very difficult to implement, especially for real time applications and mobile devices. The current technological challenge is to conserve the compression capacity and quality that H.264 offers but reduce the encoding time and, therefore, the processing complexity. This thesis applies machine learning technique for video encoding mode decisions and investigates ways to improve the process of generating more general low complexity H.264/AVC video encoders. The proposed H.264 encoding method decreases the complexity in the mode decision inside the Inter frames. Results show, at least, a 150% average reduction of complexity and, at most, 0.6 average increases in PSNR for different kinds of videos and formats.

Advances in Computer Communication and Computational Sciences

Download Advances in Computer Communication and Computational Sciences PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 9811368619
Total Pages : 753 pages
Book Rating : 4.8/5 (113 download)

DOWNLOAD NOW!


Book Synopsis Advances in Computer Communication and Computational Sciences by : Sanjiv K. Bhatia

Download or read book Advances in Computer Communication and Computational Sciences written by Sanjiv K. Bhatia and published by Springer. This book was released on 2019-05-21 with total page 753 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book includes key insights that reflect ‘Advances in Computer and Computational Sciences’ from upcoming researchers and leading academics around the globe. It gathers high-quality, peer-reviewed papers presented at the International Conference on Computer, Communication and Computational Sciences (IC4S 2018), which was held on 20-21 October, 2018 in Bangkok. The book covers a broad range of topics, including intelligent hardware and software design, advanced communications, intelligent computing techniques, intelligent image processing, and web and informatics. Its goal is to familiarize readers from the computer industry and academia with the latest advances in next-generation computer and communication technology, which they can subsequently integrate into real-world applications.

Complexity Reduction in HEVC Intra Coding and Comparison with H.264/AVC

Download Complexity Reduction in HEVC Intra Coding and Comparison with H.264/AVC PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 67 pages
Book Rating : 4.:/5 (881 download)

DOWNLOAD NOW!


Book Synopsis Complexity Reduction in HEVC Intra Coding and Comparison with H.264/AVC by : Vinoothna Gajula

Download or read book Complexity Reduction in HEVC Intra Coding and Comparison with H.264/AVC written by Vinoothna Gajula and published by . This book was released on 2014 with total page 67 pages. Available in PDF, EPUB and Kindle. Book excerpt: ITU-T (VCEG) and ISO/IEC (MPEG) collaborated and formed the joint collaborative team on video coding (JCT-VC) in April 2010 to develop the next-generation video coding (NGVC) standard.. HEVC standard doubles the coding efficiency and the approximately 50% less bit rate with respect to H.264/AVC, at nearly the same video quality at expense of increased complexity. In this thesis, a technique is proposed to reduce the complexity of HEVC intra coding to get better encoding time, involving two steps - first by optimizing the PU (prediction unit) size decision process using texture complexity analysis by intensity gradients and second to obtain the reduced prediction modes by applying a combination of rough mode decision (RMD) and most probable modes (MPM) thereby reducing the number of modes based on rate distortion optimization (RDO) followed by residual quad-tree (RQT) which is used to simplify the entire process The technique developed in this thesis achieved an average gain of 47.25% encoder time when implemented for several test sequences at very less loss in performance with high complexity reduction.

Perceiving Pixels and Bits

Download Perceiving Pixels and Bits PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 0 pages
Book Rating : 4.:/5 (135 download)

DOWNLOAD NOW!


Book Synopsis Perceiving Pixels and Bits by : Li-Heng Chen

Download or read book Perceiving Pixels and Bits written by Li-Heng Chen and published by . This book was released on 2022 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: The use of l [subscript p] norms has largely dominated the measurement of distortion in video encoding or loss in neural networks due to their simplicity and analytical properties. However, when used to assess the loss of visual information, these simple norms are not very consistent with human perception. Given the continuously growing demand for online videos, improving the performance of video compression in perceptual ways has become an important, yet challenging problem, as humans are the ultimate receiver of visual signals. The main contribution of this thesis is to provide new directions for optimization of components in video workflows, in which the topics of hybrid video codecs, resizer, and learned image compression models are covered. The first part of this thesis studies the chroma distortions in conventional video compression standards. It is empirically known that the chroma components are less sensitive to human perception, yet has not been studied as much in the application in video compression. To this end, we carried out a subjective experiment to understand the interplay between luma and chroma distortions. We also found that there is room for reducing bitrate consumption in modern video codecs by creatively increasing the compression factor on chroma channels. On the other hand, video downsampling is also a crucial module in adaptive streaming scenarios. This thesis introduces a new data-driven downsampling model realized using deep neural networks. Since the layers of convolutional neural networks can only be used to alter the resolutions of their inputs by integer scale factors, we seek new ways to achieve fractional scaling, which is crucial in many video processing applications. The second part of this thesis explores the perceptual aspect of optimizing learning-based lossy image compression models. Although numerous powerful perceptual models have been proposed to predict the perceived quality of a distorted picture, most other image quality indexes have never been adopted as deep network loss functions, because they are generally non-differentiable. To address this problem, we propose a new "proximal" approach, called the ProxIQA training, to optimize image analysis networks against quantitative perceptual models. We also describe a search-free resizing framework that can further improve the rate-distortion tradeoff of recent learned image compression models. Our approach is simple: compose a pair of differentiable downsampling/upsampling layers that sandwich a neural compression model. To determine resize factors for different inputs, we utilize another neural network jointly trained with the compression model, with the end goal of minimizing the rate-distortion objective. Among these, quantitative simulations and subjective quality studies show that the proposed methods yield significant improvements in coding efficiency. The thesis concludes with some remarks on future directions and open problems

Digital TV and Wireless Multimedia Communication

Download Digital TV and Wireless Multimedia Communication PDF Online Free

Author :
Publisher : Springer
ISBN 13 : 981104211X
Total Pages : 398 pages
Book Rating : 4.8/5 (11 download)

DOWNLOAD NOW!


Book Synopsis Digital TV and Wireless Multimedia Communication by : Xiaokang Yang

Download or read book Digital TV and Wireless Multimedia Communication written by Xiaokang Yang and published by Springer. This book was released on 2017-03-11 with total page 398 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book constitutes the refereed proceedings of the 13th International Forum of Digital TV and Wireless Multimedia Communication, IFTC 2016, held in Shanghai, China, in November 2016. The 38 revised full papers presented were carefully reviewed and selected from 102 submissions. The papers are organized in topical sections on image processing; audio processing; image and video compression; telecommunications.

Complexity Reduction of Motion Estimation in HEVC

Download Complexity Reduction of Motion Estimation in HEVC PDF Online Free

Author :
Publisher :
ISBN 13 :
Total Pages : 80 pages
Book Rating : 4.:/5 (933 download)

DOWNLOAD NOW!


Book Synopsis Complexity Reduction of Motion Estimation in HEVC by : Jayesh Dubhashi

Download or read book Complexity Reduction of Motion Estimation in HEVC written by Jayesh Dubhashi and published by . This book was released on 2015 with total page 80 pages. Available in PDF, EPUB and Kindle. Book excerpt: The High Efficiency Video Coding (HEVC) standard is the latest video coding project developed by the Joint Collaborative Team on Video Coding (JCT-VC) which involves the International Telecommunication Unit (ITU-T) Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG) standardization organizations. The HEVC standard is an optimization of the previous standard H.264/AVC (Advanced Video coding) with the bit-rate reduction of about 50% at the same visual quality. The most complex and time consuming process in the HEVC encoding is the motion estimation. The process involves finding the best matching block in the current frame by comparing it with a reference frame. Unlike, H.264 which had fixed sized blocks, HEVC has variable sized blocks which reduce the number of bits required by certain blocks in the frame where there is no motion change. But still the process of finding the best match is very time consuming and imposes computational complexity. Various algorithms like three-step search, diamond search and square search have been developed to reduce the computational complexity of the motion estimation module. The complexity can be further reduced by using an early termination technique to end the search process once it reaches a certain threshold. In this thesis, an algorithm is proposed for early termination of the search points by calculating a threshold. The algorithm is based on the predicted motion vector and the sum of absolute differences of the predicted motion vector for the search points. It is observed that if the prediction to the starting point is precise, then it can be used to calculate a threshold value and if any search point goes below the threshold, it can be declared as the best match. The experimental results based on the proposed algorithm tested on various video sequences show a reduction of the encoding time by about 5% to 17% with negligible Peak Signal to Noise Ratio (PSNR) loss ( less than 1 dB) as compared to the existing algorithm. The algorithm is more efficient for SD and HD resolution videos. The bit-rate increase is from 2% to 13.8 %. Metrics like Bjontegaard (BD)-PSNR and BD-Bit-rate are also used.