Dkpro Agreement

Category: Allgemein

@MISC{Meyer_dkproagreement:, author = {Christian M. Meyer and Margot Mieskes and Christian Stab and Iryna Gurevych}, title = {DKPro Agreement: to the Java open source library for measuring Inter-Rater Agreement}, year = {} In addition, you can separately add each of the modules described above (z.B. artifactId dkpro-statistics agreement). inter-rater agreement dkpro agreement open-source java library open-source software multiple diagnostic device data model identified annotation unit multiple inter-rater agreement mea-sures novel java implementation unified interface In this article we present a new Java implementation of several mea-sures inter-rater agreement that we provide as open source software. In addition to evaluating the reliability of coding tasks with S, pi, κ, α etc., we support in particular the standardization of tasks by measuring αU as the concordance of the boundaries of the identified annotation units. We offer a single interface and a single data model for both tasks, as well as several diagnostic tools for analyzing the results. 1 Christian M. Meyer, Margot Mieskes, Christian Stab and Iryna Gurevych: DKPro Agreement: In Open Source Java Library for Measuring Inter-Rater Agreement, in: Proceedings of the 25th International Conference on Computational Linguistics (COLING), pp. 105-109, August 2014, Dublin, Ireland. (Download) Please cite our COLING 2014 document if you use the software in your scientific work.

You can find a more detailed description of DKPro Statistics in our scientific articles: Before DKPro Statistics was available as open source software, DKPro Statistics was a research project at the Ubiquitous Knowledge Processing (UKP) Lab at the Technical University of Darmstadt. .