A scheme for racquet sports video analysis with the combination of audio-visual information

Liyuan Xing; Qixiang Ye; Weigang Zhang; Qingming Huang; Hua Yu

doi:10.1117/12.631382

24 June 2005 A scheme for racquet sports video analysis with the combination of audio-visual information

Liyuan Xing, Qixiang Ye, Weigang Zhang, Qingming Huang, Hua Yu

Proceedings Volume 5960, Visual Communications and Image Processing 2005; 59600S (2005) https://doi.org/10.1117/12.631382
Event: Visual Communications and Image Processing 2005, 2005, Beijing, China

Abstract

As a very important category in sports video, racquet sports video, e.g. table tennis, tennis and badminton, has been paid little attention in the past years. Considering the characteristics of this kind of sports video, we propose a new scheme for structure indexing and highlight generating based on the combination of audio and visual information. Firstly, a supervised classification method is employed to detect important audio symbols including impact (ball hit), audience cheers, commentator speech, etc. Meanwhile an unsupervised algorithm is proposed to group video shots into various clusters. Then, by taking advantage of temporal relationship between audio and visual signals, we can specify the scene clusters with semantic labels including rally scenes and break scenes. Thirdly, a refinement procedure is developed to reduce false rally scenes by further audio analysis. Finally, an exciting model is proposed to rank the detected rally scenes from which many exciting video clips such as game (match) points can be correctly retrieved. Experiments on two types of representative racquet sports video, table tennis video and tennis video, demonstrate encouraging results.

Citation Download Citation

Liyuan Xing, Qixiang Ye, Weigang Zhang, Qingming Huang, and Hua Yu "A scheme for racquet sports video analysis with the combination of audio-visual information", Proc. SPIE 5960, Visual Communications and Image Processing 2005, 59600S (24 June 2005); https://doi.org/10.1117/12.631382

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available