Unsupervised framerate upsampling from events

Hiroyuki Okuno; Chihiro Tsutake; Keita Takahashi; Toshiaki Fujii

doi:10.1117/12.3018663

2 May 2024 Unsupervised framerate upsampling from events

Hiroyuki Okuno, Chihiro Tsutake, Keita Takahashi, Toshiaki Fujii

Proceedings Volume 13164, International Workshop on Advanced Imaging Technology (IWAIT) 2024; 131641M (2024) https://doi.org/10.1117/12.3018663
Event: International Workshop on Advanced Imaging Technology (IWAIT) 2024, 2024, Langkawi, Malaysia

Abstract

An event camera adopts a bio-inspired sensing mechanism that can record the luminance changes over time. The recorded information, called events, are detected asynchronously at each pixel in the order of microseconds. Events are quite useful for framerate upsampling of a video, because the information between the low-framerate video frames (key-frames) can be supplemented from the events. We propose a method for framerate upsampling from events on the basis of an unsupervised approach; our method does not require ground-truth high-framerate videos for pre-training but can be trained solely on the key-frames and events taken from the target scene. We also report some promising experimental results with a fast moving scene captured by a DAVIS346 event camera.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Hiroyuki Okuno, Chihiro Tsutake, Keita Takahashi, and Toshiaki Fujii "Unsupervised framerate upsampling from events", Proc. SPIE 13164, International Workshop on Advanced Imaging Technology (IWAIT) 2024, 131641M (2 May 2024); https://doi.org/10.1117/12.3018663

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available