An open-set detection evaluation methodology applied to language and emotion recognition
other
This paper introduces a detection methodology for recognition technologies in speech for which it is dif cult to obtain an abundance of non-target classes. An example is language recognition, where we would like to be able to measure the detection
capability of a single target language without confounding with the modeling capability of non-target languages. The evaluation framework is based on a cross validation scheme leaving the non-target class out of the allowed training material for the detector.
The framework allows us to use Detection Error Tradeoff curves properly. As another application example we apply the evaluation scheme to emotion recognition in order to obtain single-emotion detection performance assessment.
Index Terms: detection methodology, open-set evaluation, language, emotion.
capability of a single target language without confounding with the modeling capability of non-target languages. The evaluation framework is based on a cross validation scheme leaving the non-target class out of the allowed training material for the detector.
The framework allows us to use Detection Error Tradeoff curves properly. As another application example we apply the evaluation scheme to emotion recognition in order to obtain single-emotion detection performance assessment.
Index Terms: detection methodology, open-set evaluation, language, emotion.
Topics
Detection methodologyEmotionLanguageOpen-set evaluationError detectionFace recognitionInformation retrieval systemsLinguisticsQuery languagesSpeechSpeech recognitionTargetsApplication examplesCross validationsDetection capabilitiesDetection errorsDetection methodologyEmotionEmotion detectionsEmotion recognitionsEvaluation frameworksEvaluation methodologiesEvaluation schemesLanguageLanguage recognitionsModeling capabilitiesOpen-set evaluationRecognition technologiesTarget classesTarget languagesTradeoff curvesTraining materialsSpeech communicationemotionsfacial expressionslanguagedetection
TNO Identifier
19221
Source title
Interspeech 2007
Pages
338 - 341
Files
To receive the publication files, please send an e-mail request to TNO Repository.