Power control of spectrum sharing for USVs via deep Q-networks

Shenghan Zhu; Song Liu; Siling Feng; Mengxing Huang; Bo Sun

doi:10.1117/12.2640882

13 October 2022 Power control of spectrum sharing for USVs via deep Q-networks

Shenghan Zhu, Song Liu, Siling Feng, Mengxing Huang, Bo Sun

Proceedings Volume 12287, International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022); 122871S (2022) https://doi.org/10.1117/12.2640882
Event: International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022), 2022, Wuhan, China

Abstract

It has been recognized that power control strategy of spectrum sharing for USVs(unmanned surface vessels) counts. The policy for power control of a major USV is proposed to increase profit of spectrum resources. In the environment of an USV sailing on the sea, it is essential for the major USV to communicate effectively with the minor USV. We propose a learning-based power control approach for the major USV to share the joint spectrum with the minor USV. Specifically, the major USV updates its transmitted power abide by a power control policy that is defined beforehand. The minor USV is unaware of the major USV’s condition of transmitting power. The proposed method exploiting the strengths of the Deep Q-Network (DQN), could help the minor USV adjust its transmitting power and make full use of the empty spectrum. Both can transmit information favourably accompanied by the satisfactory service quality. The results of our experiment show that the minor USV communicate with the major USV effectively through our method. Compared to the traditional reinforcement learning method DQN, our method achieves better results.

Citation Download Citation

Shenghan Zhu, Song Liu, Siling Feng, Mengxing Huang, and Bo Sun "Power control of spectrum sharing for USVs via deep Q-networks", Proc. SPIE 12287, International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022), 122871S (13 October 2022); https://doi.org/10.1117/12.2640882

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available