SiSEC

2010 Signal Separation Evaluation Campaign

Professionally produced music recordings

Test database

For details about each algorithm, click on the algorithm number.

All estimated source signals are made available under the terms of the same license as the mixture signals. For licensing information regarding the mixture signals, see the bottom of this page.

Average results

		vocals	drums	bass	guitar	piano	total
Algorithm 1 A. Ozerov, R. Blouet & C. Fevotte	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	1.6 7.4 6.4 3.2 24.8 38.0 45.6 45.2	3.9 8.5 9.9 3.9 33.0 52.0 62.6 46.0	-0.5 5.9 -0.8 -5.9 40.2 77.5 43.6 51.4	4.9 8.3 11.5 6.2 68.9 62.8 83.1 77.8	-2.5 2.9 -2.5 -1.4 15.3 22.4 34.7 26.2	1.3 6.7 4.7 0.9 31.7 49.0 49.9 46.3
Algorithm 2 J. Janer & R. Marxer	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	-1.1 7.5 Inf -2.1 21.3 39.0 89.6 3.7	- - - - - - - -	- - - - - - - -	- - - - - - - -	- - - - - - - -	- - - - - - - -
Algorithm 3 M. Spiertz	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	2.8 5.0 10.2 3.6 16.8 31.6 29.3 44.8	3.2 4.9 8.0 5.0 34.3 53.0 60.5 52.3	2.2 9.3 4.4 4.2 7.4 58.7 8.5 35.9	5.7 16.3 6.8 10.8 34.9 46.3 48.5 80.9	-2.3 1.7 -4.1 -0.9 9.0 16.9 11.6 33.0	2.2 6.2 6.2 3.9 18.7 40.9 30.4 45.4
STFT Ideal Binary Mask	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	6.2 22.1 22.3 6.2 22.6 51.1 61.4 21.2	6.3 24.6 23.2 6.2 34.6 64.2 74.3 32.4	6.0 20.9 21.0 5.7 12.3 49.8 49.0 8.0	11.8 23.8 20.3 12.3 61.4 70.0 82.3 66.7	1.1 9.9 16.6 0.0 17.0 41.1 54.8 15.4	5.8 20.8 21.2 5.6 24.9 53.6 62.0 23.2
Cochleagram Ideal Binary Mask	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	4.7 17.0 16.3 4.7 12.7 33.0 42.7 11.8	1.4 2.7 17.3 0.4 35.5 55.4 70.9 38.0	0.9 1.8 11.7 -2.3 23.3 26.1 59.2 24.9	8.6 14.6 15.1 9.8 30.9 44.3 65.3 36.9	0.8 5.9 12.2 -1.9 10.7 12.5 36.3 10.4	2.9 8.9 14.9 1.7 20.9 34.2 53.0 21.8

Detailed results

Tamy
"Que Pena Tanto Faz"
mix

Bearlin
"Roads"
mix

Glen Philips
"The Spirit of Shackleton"
mix

Nine Inch Nails
"The Good Soldier"
mix

Shannon Hurley
"Sunrise"
mix

Algorithm 1
A. Ozerov, R. Blouet & C. Fevotte

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
3.4	4.9
12.3	8.3
5.4	11.5
6.6	6.2

40.7	68.9
63.5	62.8
60.1	83.1
76.1	77.8

vocals	bass	piano
-2.2	0.0	-2.7
8.7	0.0	2.0
-1.6	-2.8	-5.7
3.1	-24.9	-0.2

18.1	98.2	12.5
26.9	99.2	13.9
36.2	89.6	25.5
36.1	94.2	25.5

vocals	drums	bass
3.3	2.3	-4.0
6.2	4.1	9.8
12.8	8.8	-3.7
3.9	1.4	3.1

19.5	31.9	14.3
38.9	45.2	68.8
42.3	64.7	28.6
34.2	40.6	32.9

vocals	drums
1.1	5.7
3.2	14.4
8.5	10.3
-1.0	7.0

30.2	27.9
33.2	52.5
64.7	53.8
36.1	46.7

vocals	drums	bass	piano
2.2	3.6	2.6	-2.3
6.4	7.0	8.0	3.8
7.0	10.7	4.2	0.6
3.5	3.2	4.0	-2.7

15.5	39.2	8.3	18.1
27.3	58.3	64.4	30.9
24.5	69.5	12.5	43.9
43.6	50.9	27.1	26.9

Algorithm 2
J. Janer & R. Marxer

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals
-3.0	-
-2.1	-
Inf	-
2.7	-

30.3	-
45.0	-
89.6	-
7.4	-

vocals
-0.6	-	-
9.1	-	-
Inf	-	-
-3.5	-	-

26.4	-	-
41.1	-	-
89.6	-	-
5.6	-	-

vocals
-0.3	-	-
5.9	-	-
Inf	-	-
-4.4	-	-

15.9	-	-
28.6	-	-
89.6	-	-
1.5	-	-

vocals
-2.6	-
10.2	-
Inf	-
-5.1	-

18.8	-
35.8	-
89.6	-
2.4	-

vocals
0.8	-	-	-
14.4	-	-	-
Inf	-	-	-
-0.4	-	-	-

15.2	-	-	-
44.3	-	-	-
89.6	-	-	-
1.4	-	-	-

Algorithm 3
M. Spiertz

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
4.1	5.7
6.2	16.3
10.4	6.8
5.3	10.8

17.8	34.9
54.7	46.3
16.9	48.5
82.5	80.9

vocals	bass	piano
2.6	5.3	-0.8
4.2	11.7	2.1
8.1	11.0	-1.2
4.3	5.9	-1.2

17.8	7.7	7.7
13.1	44.8	13.2
39.7	11.7	12.1
29.0	23.3	21.0

vocals	drums	bass
3.9	3.6	-2.0
5.7	5.7	7.5
15.1	7.8	-3.1
5.4	5.2	1.9

15.4	37.3	8.7
38.2	50.0	75.3
26.7	65.2	10.7
39.4	54.2	36.3

vocals	drums
1.1	1.2
1.8	1.8
10.0	5.9
0.2	3.4

25.2	25.0
29.3	48.2
55.4	48.3
34.8	44.9

vocals	drums	bass	piano
2.2	4.7	3.4	-3.8
6.9	7.2	8.8	1.4
7.1	10.5	5.4	-7.0
2.9	6.3	4.8	-0.6

8.0	40.6	5.8	10.4
22.5	60.9	56.0	20.7
7.8	68.0	3.2	11.0
38.4	57.9	48.0	45.1

STFT
Ideal Binary Mask

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
10.1	11.8
19.0	23.8
21.9	20.3
10.5	12.3

32.5	61.4
49.1	70.0
67.7	82.3
37.3	66.7

vocals	bass	piano
5.8	7.9	1.6
21.0	25.6	9.9
18.7	16.8	18.8
5.8	8.4	0.9

14.6	5.0	14.8
47.6	20.0	40.1
49.1	26.0	52.2
13.9	2.9	12.5

vocals	drums	bass
5.6	6.4	2.0
27.7	26.8	14.9
26.6	21.5	25.3
5.6	6.3	0.6

21.0	30.6	11.3
58.7	64.3	66.9
65.3	72.1	53.5
16.5	27.6	6.6

vocals	drums
1.5	5.1
18.6	26.9
26.1	26.1
0.9	5.1

29.3	37.9
50.6	61.7
72.6	76.8
24.4	34.6

vocals	drums	bass	piano
7.8	7.3	8.2	0.7
24.4	20.1	22.3	9.9
18.1	21.9	20.8	14.4
8.1	7.0	8.1	-0.9

15.4	35.5	20.6	19.2
49.6	66.7	62.4	42.0
52.1	73.9	67.6	57.4
13.8	34.9	14.4	18.3

Cochleagram
Ideal Binary Mask

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
7.5	8.6
14.5	14.6
15.1	15.1
8.1	9.8

11.9	30.9
25.9	44.3
37.8	65.3
13.0	36.9

vocals	bass	piano
4.6	0.3	1.1
16.6	0.5	6.9
13.5	5.5	13.2
4.8	-3.5	-0.0

7.1	24.0	9.3
31.6	13.1	10.9
25.6	60.0	33.0
7.2	25.1	8.6

vocals	drums	bass
3.9	1.1	0.7
24.0	2.9	3.0
21.3	16.5	18.5
3.8	-1.3	-4.2

15.7	26.2	15.6
38.8	45.3	29.4
54.5	64.2	52.7
12.9	27.2	13.2

vocals	drums
1.4	1.6
10.1	2.9
18.8	18.7
-0.0	1.6

17.6	37.5
36.1	59.0
57.7	72.8
14.4	40.0

vocals	drums	bass	piano
6.1	1.5	1.6	0.4
20.0	2.3	2.0	4.8
13.1	16.5	11.0	11.1
6.8	1.0	1.0	-3.7

11.2	42.8	30.4	12.1
32.8	61.8	35.9	14.1
38.1	75.6	64.8	39.7
11.5	46.8	36.5	12.1

All audio files are distributed under the terms different licenses, as listed below for each recodring:

Tamy - Que Pena Tanto Faz: Creative Commons Attribution Noncommercial (3.0)
Bearlin - Roads: Read License
Glen Philips - The Spirit of Shackleton Creative Commons Attribution 3.0
Nine Inch Nails - The Good Soldier Read License
Shannon Hurley - Sunrise Creative Commons Attribution-NonCommercial 3.0

Using these audio files for any purposes that are not scientific research is explicitly prohibited.