Publication Details

Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation

DYTRYCH Jaroslav and SMRŽ Pavel. Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation. In: Proceedings of the 8th International Conference on Agents and Artificial Intelligence. Volume 2: ICAART. Setúbal: SciTePress - Science and Technology Publications, 2016, pp. 74-84. ISBN 978-989-758-172-4. Available from: http://www.scitepress.org/DigitalLibrary/PublicationsDetail.aspx?ID=5F3T%2fEA+bgg%3d&t=1
Czech title
Vzory interakce v počítačem asistovaném sémantickém anotování textu - empirické vyhodnocení
Type
conference paper
Language
english
Authors
URL
Keywords

Computer-assisted Tagging, Semantic Annotation, Event Extraction

Abstract

This paper examines user interface options and interaction patterns evinced in tools for computer-assisted semantic enrichment of text. It focuses on advanced annotation tasks such as hierarchical annotation of complex relations and linking entities with highly ambiguous names and explores how decisions on particular aspects of annotation interfaces influence the speed and the quality of computer-assisted human annotation processes. Reported experiments compare the 4A annotation system, designed and implemented by our team, to RDFaCE and GATE tools that all provide advanced annotation functionality. Results show that users are able to reach better consistency of event annotations in less time when using the 4A editor. A set of experiments is then conducted that employ 4A’s high flexibility and customizability to find an optimal amount of displayed information and its presentation form to reach best results in linking entities with highly ambiguous names. The last set of experiments then proves that 4A’s particular way of implementing the concept of semantic filtering speeds up event annotation processes and brings higher consistency when compared to alternative approaches.

Published
2016
Pages
74-84
Proceedings
Proceedings of the 8th International Conference on Agents and Artificial Intelligence
Series
Volume 2: ICAART
Conference
8th International Conference on Agents and Artificial Intelligence, Roma, IT
ISBN
978-989-758-172-4
Publisher
SciTePress - Science and Technology Publications
Place
Setúbal, PT
DOI
EID Scopus
BibTeX
@INPROCEEDINGS{FITPUB11401,
   author = "Jaroslav Dytrych and Pavel Smr\v{z}",
   title = "Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation",
   pages = "74--84",
   booktitle = "Proceedings of the 8th International Conference on Agents and Artificial Intelligence",
   series = "Volume 2: ICAART",
   year = 2016,
   location = "Set\'{u}bal, PT",
   publisher = "SciTePress - Science and Technology Publications",
   ISBN = "978-989-758-172-4",
   doi = "10.5220/0005695900740084",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/11401"
}
Back to top