8 July 2023 Thangka mural style transfer based on progressive style-attentional network and multi-level loss function
Jie Fang, Hang Li, Ying Jia, Liqi Ji, Xin Chen, Nianyi Wang
Author Affiliations +
Abstract

Style transfer is a challenging computer vision task. As an important cultural heritage in the Tibetan region, Thangka murals cover history, culture, and religion. The stylistic recreation of Thangka images not only promotes better appreciation of Thangka art but also provides a new art form for Thangka. Two challenges prevent the existing methods from solving Thangka stylization problems: (1) feature point based attention networks ignore manifold alignment of features between content images and style images and are unable to achieve regional consistency of stylized Thangka images well. (2) Due to the lack of comprehensive understanding of content and style losses in previous studies, the style-content trade-off of the stylized Thangka is unable to be guaranteed. To solve these problems, we propose a progressive style-attentional network (PSANet) and a multi-level loss function strategy for Thangka style transfer. The proposed method consists of two parts: (1) a PSANet to align content manifolds and style manifolds. (2) A multi-level loss function strategy to achieve a balance between content and style of the stylized Thangka images and to ensure better content preservation. Qualitative and quantitative experiments show that our proposed method is able to achieve satisfactory stylized effects on Thangka images.

© 2023 SPIE and IS&T
Jie Fang, Hang Li, Ying Jia, Liqi Ji, Xin Chen, and Nianyi Wang "Thangka mural style transfer based on progressive style-attentional network and multi-level loss function," Journal of Electronic Imaging 32(4), 043007 (8 July 2023). https://doi.org/10.1117/1.JEI.32.4.043007
Received: 19 February 2023; Accepted: 26 June 2023; Published: 8 July 2023
Lens.org Logo
CITATIONS
Cited by 1 scholarly publication.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Semantics

Education and training

Image restoration

Histograms

Image processing

Image quality

Visualization

Back to Top