2020 · 13 citations · 13 references
ComputingComputer ScienceData ScienceComputer VisionNatural Language ProcessingTime Series AnalysisAction RecognitionAnnotationMotion AnalysisMotion CapturePattern RecognitionSequence LabelingActivity RecognitionAnnotation DesignDataset CurationDeploymentHuman Activity RecognitionMotion AnnotationOptical Motion CaptureTime Series Annotation
This contribution proposes an approach for annotating human actions and their coarse semantic descriptions for multichannel time-series. For this purpose, a new dataset that consists of Optical Motion Capturing and IMU time-series data for industrial deployment is created and annotated by 6 individuals. The expenditure of time for labelling, both classes and semantic attributes, and the annotation consistency are examined. The initial annotations are revised by a single domain expert to measure its effect on the overall between-individual consistency. Consistency measurements by means of Cohen's κ are analysed. The results give insights on the effort for dataset creation in the field of Human Activity Recognition for industrial application. The Cohen's κ for consistency assessment was moderate and substantial for the initial annotation, and it increased slightly after revision.
13
Interrater reliability: the kappa statistic
Marry L. McHugh · Biochemia Medica · 2012 · 18.6K citations · Full text
Interrater reliability: the kappa statistic.
Mary L. McHugh · PubMed · 2012 · 9.2K citations · Full text
SUN RGB-D: A RGB-D scene understanding benchmark suite
Shuran Song, Samuel P. Lichtenberg, Jianxiong Xiao · 2015 · 1.9K citations