DSBN: Detail-Structure Blending Network for video super-resolution

Haesoo Chung; Sang-hoon Lee; Nam Ik Cho

doi:10.1117/12.2590625

13 March 2021 DSBN: Detail-Structure Blending Network for video super-resolution

Haesoo Chung, Sang-hoon Lee, Nam Ik Cho

Proceedings Volume 11766, International Workshop on Advanced Imaging Technology (IWAIT) 2021; 1176607 (2021) https://doi.org/10.1117/12.2590625
Event: International Workshop on Advanced Imaging Technology 2021 (IWAIT 2021), 2021, Online Only

Abstract

Video super-resolution (VSR) aims to generate a high-resolution (HR) video by reconstructing each frame from the corresponding low-resolution (LR) frame and its neighboring ones. However, it is challenging to generate a clean HR frame due to displacement between the frames. To alleviate this problem, most existing approaches explicitly aligned neighboring frames to the reference. However, these methods tend to generate noticeable artifacts in the aligned results. In this paper, we propose a detail-structure blending network (DSBN), which structurally aligns the adjacent frames by blending the frames in deep-feature-domain. The DSBN extracts deep features from the reference frame and each neighboring frame separately, and blends the extracted detail and structure information to obtain the well-aligned results. Afterward, a simple reconstruction network generates a final HR frame using the aligned frames. Experimental results on the benchmark datasets demonstrate that our method produces high-quality HR results even from videos with non-rigid motions and occlusions.

Citation Download Citation

Haesoo Chung, Sang-hoon Lee, and Nam Ik Cho "DSBN: Detail-Structure Blending Network for video super-resolution", Proc. SPIE 11766, International Workshop on Advanced Imaging Technology (IWAIT) 2021, 1176607 (13 March 2021); https://doi.org/10.1117/12.2590625

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available