Skip to main content

Transforming Diagrams' Semantics to Text for Visually Impaired.

Cross, C., Cetinkaya, D. and Dogan, H., 2020. Transforming Diagrams' Semantics to Text for Visually Impaired. In: HCI International 2020, 19-24 July 2020, Denmark.

Full text available as:

Cross_Cetinkaya_Dogan_DUXU2020.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial.


Official URL:


Using models and diagrams is a very useful and effective tool for representing information and systems in a graphical form to communicate and understand them better. On the other hand, graphical representations bring extra cognitive load and the process for understanding the diagrams is long and tedious in most cases for the visually impaired. To solve this problem, semantics of the diagrams should be converted to a different format that is both human and machine readable as well as communicable for the visually impaired. Most existing diagramming tools are not easily usable for the visually impaired as a tool for creating and using diagrams. In this paper, we propose an online system for defining specific diagrams and converting their semantics to text which can have a speech output for the visually impaired. We present analysis and design of this online system as well as a proof of concept prototype implementation. The prototype system provides create, save, load and transform features and tested with participants to recreate the diagrams using the automatically generated text output. Our case study showed that the results are very promising and the proposed solution can provide a way to correctly and accurately represent the information in diagrams textually.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:Assistive technology · Modelling for visually impaired · Diagrams to text.
Group:Faculty of Science & Technology
ID Code:34468
Deposited By: Symplectic RT2
Deposited On:01 Sep 2020 12:32
Last Modified:14 Mar 2022 14:23


Downloads per month over past year

More statistics for this item...
Repository Staff Only -