Prompt fine-tuning-based efficient federated foreign object detection of electric transmission line

Yijia Li; Haotian Sui; Tong Li; Junfeng An; Lei Zheng; Kai Liang; Xiuxian Zhang

doi:10.1117/12.2668259

20 April 2023 Prompt fine-tuning-based efficient federated foreign object detection of electric transmission line

Yijia Li, Haotian Sui, Tong Li, Junfeng An, Lei Zheng, Kai Liang, Xiuxian Zhang

Proceedings Volume 12602, International Conference on Electronic Information Engineering and Computer Science (EIECS 2022); 126021T (2023) https://doi.org/10.1117/12.2668259
Event: International Conference on Electronic Information Engineering and Computer Science (EIECS 2022), 2022, Changchun, China

Abstract

Foreign objects such as bird’s nests, honeycombs, kites, and plastics threaten the safety of electric transmission lines. Training a foreign object detection model with high generalization and accuracy needs to collect numerous data, which is usually unavailable because of data privacy and security. Federated learning is a promising solution but the total calculation amount is huge, and large number of gradient data will be transmitted in federated learning model updating. And because the data amount, training efficiency, and model accuracy are different at edge clients, it is not appropriate to aggregate clients’ edge models equally. To address the above mentioned problems, a prompt fine-tuning based efficient federated foreign object detection method of electric transmission line, which includes prompt federated fine-tuning mechanism and self-adaptive dynamic weighting aggregation strategy, is proposed in this paper. Prompt federated finetuning freezes the model backbone in edge client model training, and only the unfrozen parts of the model are transmitted and updated in the model aggregation phase. Self-adaptive dynamic weighting aggregation mechanism takes local data amount, edge model’s accuracy, and aggregation rounds into account when aggregating local models. Comprehensive experimental results demonstrate that the proposed method has not only better model accuracy but also faster training speed compared with other federated learning baselines on transmission line foreign object detection.

Citation Download Citation

Yijia Li, Haotian Sui, Tong Li, Junfeng An, Lei Zheng, Kai Liang, and Xiuxian Zhang "Prompt fine-tuning-based efficient federated foreign object detection of electric transmission line", Proc. SPIE 12602, International Conference on Electronic Information Engineering and Computer Science (EIECS 2022), 126021T (20 April 2023); https://doi.org/10.1117/12.2668259

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Education and training

Object detection

Machine learning

Process modeling

Performance modeling

Data privacy

Show All Keywords

Keywords/Phrases

Search In:

Publication Years