An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection

The process of designing fonts traditionally requires a great deal of manpower, taking up to one year to complete one style set. In computer vision (CV) and computer graphics (CG), the automatic generation of Chinese fonts with a large number of complex glyphs remains a challenging and persistent pr...

Full description

Bibliographic Details
Main Authors: Liu, Yu, Khalid, Fatimah binti, Wang, Cunrui, Mustaffa, Mas Rina binti, Azman, Azreen bin
Format: Article
Published: Elsevier 2024
Online Access:http://psasir.upm.edu.my/id/eprint/105692/
_version_ 1848864581924945920
author Liu, Yu
Khalid, Fatimah binti
Wang, Cunrui
Mustaffa, Mas Rina binti
Azman, Azreen bin
author_facet Liu, Yu
Khalid, Fatimah binti
Wang, Cunrui
Mustaffa, Mas Rina binti
Azman, Azreen bin
author_sort Liu, Yu
building UPM Institutional Repository
collection Online Access
description The process of designing fonts traditionally requires a great deal of manpower, taking up to one year to complete one style set. In computer vision (CV) and computer graphics (CG), the automatic generation of Chinese fonts with a large number of complex glyphs remains a challenging and persistent problem. In this article, we propose an end-to-end network for generating 9169 Chinese characters without the need for human intervention. Due to the similarity of the strokes of the Chinese characters, different strokes will be recognized as the same type of stroke, resulting in errors. In this article maps the semantic information of Chinese character stroke categories to different stages of the encoder and adjusts the stroke category semantics in specific channels to ensure the synthesis of correct strokes. A deformation attention Skip-connection module was designed to adapt to font generation tasks by learning offsets in features from the decoder and encoder, weights in a cross-channel interactive manner, and adaptively re-scaling features using the learned weights and offsets. There are only a few parameters involved in this method, but it provides significant performance improvements. Compared to the prior art, the method employed by us outperforms it in terms of generating commercial fonts and handwritten fonts, which can help font designers with font design and improve the efficiency of font libraries. © 2023 Elsevier Ltd
first_indexed 2025-11-15T13:51:06Z
format Article
id upm-105692
institution Universiti Putra Malaysia
institution_category Local University
last_indexed 2025-11-15T13:51:06Z
publishDate 2024
publisher Elsevier
recordtype eprints
repository_type Digital Repository
spelling upm-1056922024-02-13T04:10:14Z http://psasir.upm.edu.my/id/eprint/105692/ An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection Liu, Yu Khalid, Fatimah binti Wang, Cunrui Mustaffa, Mas Rina binti Azman, Azreen bin The process of designing fonts traditionally requires a great deal of manpower, taking up to one year to complete one style set. In computer vision (CV) and computer graphics (CG), the automatic generation of Chinese fonts with a large number of complex glyphs remains a challenging and persistent problem. In this article, we propose an end-to-end network for generating 9169 Chinese characters without the need for human intervention. Due to the similarity of the strokes of the Chinese characters, different strokes will be recognized as the same type of stroke, resulting in errors. In this article maps the semantic information of Chinese character stroke categories to different stages of the encoder and adjusts the stroke category semantics in specific channels to ensure the synthesis of correct strokes. A deformation attention Skip-connection module was designed to adapt to font generation tasks by learning offsets in features from the decoder and encoder, weights in a cross-channel interactive manner, and adaptively re-scaling features using the learned weights and offsets. There are only a few parameters involved in this method, but it provides significant performance improvements. Compared to the prior art, the method employed by us outperforms it in terms of generating commercial fonts and handwritten fonts, which can help font designers with font design and improve the efficiency of font libraries. © 2023 Elsevier Ltd Elsevier 2024 Article PeerReviewed Liu, Yu and Khalid, Fatimah binti and Wang, Cunrui and Mustaffa, Mas Rina binti and Azman, Azreen bin (2024) An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection. Expert Systems with Applications, 237 (pt.B). art. no. 121407. pp. 1-13. ISSN 0957-4174 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85171479079&doi=10.1016%2fj.eswa.2023.121407&partnerID=40&md5=f79f63759dadbc64ffdd3638c694d4d0 10.1016/j.eswa.2023.121407
spellingShingle Liu, Yu
Khalid, Fatimah binti
Wang, Cunrui
Mustaffa, Mas Rina binti
Azman, Azreen bin
An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection
title An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection
title_full An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection
title_fullStr An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection
title_full_unstemmed An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection
title_short An end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection
title_sort end-to-end chinese font generation network with stroke semantics and deformable attention skip-connection
url http://psasir.upm.edu.my/id/eprint/105692/
http://psasir.upm.edu.my/id/eprint/105692/
http://psasir.upm.edu.my/id/eprint/105692/