Tasks

The following tasks have been featured in the Interspeech Computational Paralinguistics Challenge (ComParE) up to 2022 (including the editions prior to 2013 which have been run under individual names).

The tasks are listed in temporal order of appearance in the series since 2009 (bottom) to the latest ones (top).

# Classes: Either the number of classes for classification is given (“x” indicates that there have been multiple classification tasks), or an interval range in case of continuous tasks for regression.

In the right-most column, the final result by choosing the optimal number of participant-contributions at the end of each year’s Challenge is given. Note that in the meanwhile, higher results have often been reported in the literature. However, as after the end of each Challenge the test labels are often available to participants, we do not follow up on these.

Note that these performance measures by no means establish a sort of reference for  the problem addressed. They rather document the best result obtained at the end of each challenge by fusion of the n best participants’ engines for respective constellations which are characterised by the number of speakers, realism (spontaneous/acted), speaker idiosyncrasies, native language, acoustics, and many other conditions.

%UA: Percentage of Unweighted Accuracy (also named Unweighted Average Recall). As most paralinguistic real-world problems are marked by high class-imbalance, this competition measure computes the sum of recall (class-wise accuracy) and divides by the number of classes. Hence, for a two-class problem, chance level resembles 50% UA, for a three-class problem 33% UA, etc.

AUC: (Unweighted Average) Area under (Receiver Operating Characteristic) Curve. This measure is chosen for detection tasks.

CC: Spearman’s Correlation Coefficient (note that this subsumes Spearman). This measure is used in case of continuous modelling.

Year	Task	# Classes	%UA/*AUC/+CC/–PSDS
2023	Emotion Share	9x[0,1]	.641+
	Requests	2×2	75.6
2022	Vocalisations	6	44.0
	Stuttering	8	62.1
	Activity	8	75.9
	Mosquitoes	2	44.3–
2021	COVID-19 Cough	2	76.2
	COVID-19 Speech	2	72.9
	Escalation	3	63.9
	Primates	5	93.4
2020	Breathing	[-1,1]	.778+
	Elderly Emotion	2×3	63.8
	Masks	2	82.6
2019	Styrian Dialects	5	50.6
	Continuous Sleepiness	[1,10]	.391+
	Baby Sounds	5	63.9
	Orca Activity	2	.948*
2018	Affect: Atypical	4	45.0
	Affect: Self-Assessed	3	68.4
	(Infant) Crying	3	78.6
	Heart Beats	3	56.2
2017	Addressee	2	70.2
	Cold	2	71.0
	Snoring	4	58.5
2016	Deception	2	72.1
	Sincerity	[0,1]	.654+
	Native Language	11	82.2
2015	Nativeness	[0,1]	.433+
	Parkinson’s	[0,100]	.540+
	Eating Condition	7	62.7
2014	Cognitive Load	3	61.6
	Physical Load	2	71.9
2013	Social Signals	2×2	92.7*
	Conflict	2	85.9
	Emotion	12	46.1
	Autism	4	69.4
2012	Personality	5×2	70.4
	Likability	2	68.7
	Intelligibility of H&N Cancer Patients	2	76.8
2011	Intoxication	2	72.2
	Sleepiness	2	72.5
2010	Age	4	53.6
	Gender	3	85.7
	Interest	[-1,1]	42.8+
2009	Emotion	5	44.0
	Emotion	2	71.2