ArtsCreative WritingComputational ArtDigital ArtTypographyDeep LearningDigital WritingImage EditingOptical Character RecognitionCharacter-level RepresentationDigital Text AnalysisHandwriting RecognitionHandwritten Character RecognitionInitial Performance EvaluationNeural Style TransferStyle TransferUser Study Evaluation
Digital ink aims to combine handwriting’s flexibility and aesthetics with digital text’s searchability and editability, yet character recognition often sacrifices personalized appearance by conflating content and style. The authors introduce a generative neural network that disentangles style from content, enabling editable digital ink. The architecture is trained on a newly released handwritten dataset with fine‑grained character annotations, and the model learns to separate style and content for editable output. The model can synthesize arbitrary text while preserving user‑controlled visual style, supports style transfer without altering content, allows word‑level editing, and demonstrates promising results in an initial user evaluation.
Digital ink promises to combine the flexibility and aesthetics of handwriting and the ability to process, search and edit digital text. Character recognition converts handwritten text into a digital representation, albeit at the cost of losing personalized appearance due to the technical difficulties of separating the interwoven components of content and style. In this paper, we propose a novel generative neural network architecture that is capable of disentangling style from content and thus making digital ink editable. Our model can synthesize arbitrary text, while giving users control over the visual appearance (style). For example, allowing for style transfer without changing the content, editing of digital ink at the word level and other application scenarios such as spell-checking and correction of handwritten text. We furthermore contribute a new dataset of handwritten text with fine-grained annotations at the character level and report results from an initial user evaluation.
47
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Martı́n Abadi, Ashish Agarwal, Paul Barham et al. · arXiv (Cornell University) · 2016 · 9.8K citations · Full text
A Non-Local Algorithm for Image Denoising
Antoni Buades, B. Coll, Jean‐Michel Morel · 2005 · 7.1K citations