TY - GEN
T1 - Testing the Annotation Consistency of Hallidayan Transitivity Processes
T2 - 18th Joint ACL - ISO Workshop on Interoperable Semantic Annotation, ISA 2022
AU - Dong, Min
AU - Liu, Xiaoyan
AU - Fang, Alex Chengyu
N1 - Publisher Copyright:
© European Language Resources Association (ELRA).
PY - 2022
Y1 - 2022
N2 - SFL seeks to explain identifiable, observable phenomena of language use in context through the application of a theoretical framework which models language as a functional, meaning making system (Halliday & Matthiessen 2004). Due to the lack of explicit annotation criteria and the divide between conceptual vs. syntactic criteria in practice, it has been a tough job to achieve consistency in the annotation of Hallidayn transitivity processes. The present study proposed that explicit structural and syntactic criteria should be adopted as a basis. Drawing on syntactic and grammatical features as judgement cues, we applied structurally oriented criteria for the annotation of the process categories and participant roles combining a set of interrelated syntactic variables and established the annotation criteria for contextualised circumstantial categories in structural as well as semantic terms. An experiment was carried out to test the usefulness of these annotation criteria, applying percent agreement and Cohen's kappa as measurements of interrater reliability between the two annotators in each of the five pairs. The results verified our assumptions, albeit rather mildly, and, more significantly, offered some first empirical indications about the practical consistency of transitivity analysis in SFL. In the future work, the research team expect to draw on the insights and experience from some of the ISO standards devoted to semantic annotation such as dialogue acts (Bunt et al. 2012) and semantic roles (ISO-24617-4, 2014).
AB - SFL seeks to explain identifiable, observable phenomena of language use in context through the application of a theoretical framework which models language as a functional, meaning making system (Halliday & Matthiessen 2004). Due to the lack of explicit annotation criteria and the divide between conceptual vs. syntactic criteria in practice, it has been a tough job to achieve consistency in the annotation of Hallidayn transitivity processes. The present study proposed that explicit structural and syntactic criteria should be adopted as a basis. Drawing on syntactic and grammatical features as judgement cues, we applied structurally oriented criteria for the annotation of the process categories and participant roles combining a set of interrelated syntactic variables and established the annotation criteria for contextualised circumstantial categories in structural as well as semantic terms. An experiment was carried out to test the usefulness of these annotation criteria, applying percent agreement and Cohen's kappa as measurements of interrater reliability between the two annotators in each of the five pairs. The results verified our assumptions, albeit rather mildly, and, more significantly, offered some first empirical indications about the practical consistency of transitivity analysis in SFL. In the future work, the research team expect to draw on the insights and experience from some of the ISO standards devoted to semantic annotation such as dialogue acts (Bunt et al. 2012) and semantic roles (ISO-24617-4, 2014).
KW - annotation consistency
KW - Hallidayan transitivity process
KW - structurally oriented criteria
UR - https://www.scopus.com/pages/publications/85145874909
M3 - 会议稿件
AN - SCOPUS:85145874909
T3 - Proceedings of the 18th Joint ACL - ISO Workshop on Interoperable Semantic Annotation, ISA 2022 at LREC 2022 Workshop - Language Resources and Evaluation Conference
SP - 53
EP - 60
BT - Proceedings of the 18th Joint ACL - ISO Workshop on Interoperable Semantic Annotation, ISA 2022 at LREC 2022 Workshop - Language Resources and Evaluation Conference
A2 - Bunt, Harry
PB - European Language Resources Association (ELRA)
Y2 - 20 June 2022
ER -