Real-time arbitrarily-shaped scene text spotting with weakly supervised points

Longyang Zhao; Shuhao Zhang; Zhi Xu

doi:10.1117/12.3026683

27 March 2024 Real-time arbitrarily-shaped scene text spotting with weakly supervised points

Longyang Zhao, Shuhao Zhang, Zhi Xu

Proceedings Volume 13105, International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2023); 131053Q (2024) https://doi.org/10.1117/12.3026683
Event: 3rd International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2023), 2023, Qingdao, China

Abstract

Recently, there has been widespread interest in arbitrary-shaped scene text spotting, showing notable progress in both speed and accuracy. However, common issues such as model complexity, slow inference speed, and challenges in deployment persist. For this reason, this paper proposes Weakly Supervised Point-collection Network (WSPNet) for arbitrarily shaped scene text, which adopts deformable convolutional single-shot network architecture to realize multi-branch parallel reading of text, and combines weakly supervised text line point sampling to realize sampling recognition and transcription of arbitrarily shaped text instances. To enhance the robustness of multi-scale fusion, we utilize the Text Feature Fusion (TFF) module to dynamically acquire key features at different scales during the fusion process. This approach aims to reduce discrepancies in scale fusion. Extensive experiments on arbitrarily shaped benchmarks show that WSPNet achieves competitive accuracy and speed. For example, the proposed method achieves an end-to-end text recognition F-measure of 63.4 on the Total-Text dataset at 35.5 FPS, which is competitive with the best results in terms of speed and accuracy balance.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Longyang Zhao, Shuhao Zhang, and Zhi Xu "Real-time arbitrarily-shaped scene text spotting with weakly supervised points", Proc. SPIE 13105, International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2023), 131053Q (27 March 2024); https://doi.org/10.1117/12.3026683

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Feature fusion

Education and training

Convolution

Deformation

Network architectures

Feature extraction

Image segmentation

Show All Keywords

Keywords/Phrases

Search In:

Publication Years