Spatial Concealment for Damaged Images Using H.264 (MPEG-4 AVC) Intra Prediction and Neighborhood Cliques

Intra prediction methods introduced by H.264/AVC and furthered by HEVC, beyond enhancing intra coding efficiency also provide a potent tool for spatial error/loss concealment and digital film restoration e.g. restoration of scratches. In this paper, a novel H.264/AVC intra prediction based algorithm for spatial concealment is introduced. — The proposed algorithm utilizes reliable intra prediction direction information from available neighboring regions in the same image (or video frame) and synthesizes intra prediction directions most suitable for erroneous/lost/damaged image regions. The synthesized intra prediction directions are used to conceal the underlying artifacts through pixel domain interpolation. — Distinguishing features of the current work contributing to its success are its use of (a) an accuracy assessment and consequent weighting of available neighbors' information, and (b) conditional propagation of available neighbors' information based on the concept of ‘neighborhood cliques’. Both features significantly improve the reliability of interpolation results. Proposed framework enables using both causal and non-causal information.

Published

2012-10

Content type

Original Research

Keywords

spatial concealment, image restoration, H.264/AVC, intra prediction

DOI

10.5594/M001441

ISBN

978-1-61482-952-2