Multitask assessment of roads and vehicles network (MARVN)

Fang Yang; Meng Yi; Yiran Cai; Erik Blasch; Nichole Sullivan; Carolyn Sheaff; Genshe Chen; Haibin Ling

doi:10.1117/12.2305972

2 May 2018 Multitask assessment of roads and vehicles network (MARVN)

Fang Yang, Meng Yi, Yiran Cai, Erik Blasch, Nichole Sullivan, Carolyn Sheaff, Genshe Chen, Haibin Ling

Proceedings Volume 10641, Sensors and Systems for Space Applications XI; 106410D (2018) https://doi.org/10.1117/12.2305972
Event: SPIE Defense + Security, 2018, Orlando, FL, United States

Abstract

Vehicle detection in wide area motion imagery (WAMI) has drawn increasing attention from the computer vision research community in recent decades. In this paper, we present a new architecture for vehicle detection on road using multi-task network, which is able to detect and segment vehicles, estimate their pose, and meanwhile yield road isolation for a given region. The multi-task network consists of three components: 1) vehicle detection, 2) vehicle and road segmentation, and 3) detection screening. Segmentation and detection components share the same backbone network and are trained jointly in an end-to-end way. Unlike background subtraction or frame differencing based methods, the proposed Multitask Assessment of Roads and Vehicles Network (MARVN) method can detect vehicles which are slowing down, stopped, and/or partially occluded in a single image. In addition, the method can eliminate the detections which are located at outside road using yielded road segmentation so as to decrease the false positive rate. As few WAMI datasets have road mask and vehicles bounding box anotations, we extract 512 frames from WPAFB 2009 dataset and carefully refine the original annotations. The resulting dataset is thus named as WAMI512. We extensively compare the proposed method with state-of-the-art methods on WAMI512 dataset, and demonstrate superior performance in terms of efficiency and accuracy.

Conference Presentation

Citation Download Citation

Fang Yang, Meng Yi, Yiran Cai, Erik Blasch, Nichole Sullivan, Carolyn Sheaff, Genshe Chen, and Haibin Ling "Multitask assessment of roads and vehicles network (MARVN)", Proc. SPIE 10641, Sensors and Systems for Space Applications XI, 106410D (2 May 2018); https://doi.org/10.1117/12.2305972

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available