SiSEC

2011 Signal Separation Evaluation Campaign

Professionally produced music recordings

Development database

For details about each algorithm, click on the algorithm number.

All estimated source signals are made available under the terms of the same license as the mixture signals. For licensing information regarding the mixture signals, see the bottom of this page.

Average results

		vocals	drums	bass	guitar	claps	total
Algorithm 1 (AUTO) Jean-Louis Durrieu	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	3.9 6.8 Inf 2.3 27.8 42.2 65.0 32.5	- - - - - - - -	- - - - - - - -	- - - - - - - -	- - - - - - - -	3.9 6.8 Inf 2.3 27.8 42.2 65.0 32.5
Algorithm 2 (USER) Jean-Louis Durrieu	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	4.8 7.7 Inf 3.9 29.5 40.3 66.2 34.9	- - - - - - - -	- - - - - - - -	- - - - - - - -	- - - - - - - -	4.8 7.7 Inf 3.9 29.5 40.3 66.2 34.9
Algorithm 3 Estefania Cano Ceron	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	-1.9 0.1 Inf -10.0 31.3 1.0 68.4 2.0	- - - - - - - -	- - - - - - - -	- - - - - - - -	- - - - - - - -	-1.9 0.1 Inf -10.0 31.3 1.0 68.4 2.0
Algorithm 4 Julian Becker	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	-6.3 -1.0 4.5 1.9 20.4 24.3 43.0 32.8	-7.9 -4.4 7.4 5.4 34.3 1.4 54.6 0.6	-10.9 -5.1 5.6 2.7 15.9 39.7 32.3 5.4	-8.1 -1.9 0.9 10.4 13.5 23.3 7.7 44.8	-14.3 -7.7 0.1 3.3 3.1 81.6 34.1 1.5	-9.5 -4.0 3.7 4.8 17.5 34.1 34.4 17.0
Algorithm 5 Ricard Marxer and Jordi Janer	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	3.1 9.4 16.2 1.4 23.7 14.4 72.4 12.2	-1.6 3.3 4.0 -5.7 19.4 51.5 66.1 1.9	- - - - - - - -	0.3 2.1 7.8 -5.4 18.1 23.9 76.5 7.1	- - - - - - - -	0.6 5.0 9.4 -3.2 20.4 29.9 71.7 7.1
Algorithm 6 Alexey Ozerov and Emmanuel Vincent	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	3.6 7.2 6.2 4.9 32.6 49.4 39.6 52.2	0.2 3.2 -2.7 3.9 22.8 41.8 28.3 43.8	1.9 7.5 2.5 5.2 20.8 30.4 58.0 5.0	4.6 7.1 8.7 8.1 21.1 39.6 16.4 58.3	0.7 1.5 8.9 -4.16 8.9 74.3 50.5 0.1	2.2 5.3 4.7 3.6 21.2 47.1 38.6 31.9
Algorithm 7 Hiroshi Sawada	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	10.3 17.4 14.7 12.9 47.8 72.6 68.3 42.7	- - - - - - - -	- - - - - - - -	10.1 15.0 16.4 12.4 56.8 73.9 66.1 59.5	- - - - - - - -	10.2 16.2 15.5 12.6 52.3 73.3 67.2 51.1
STFT Ideal Binary Mask	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	6.6 20.1 22.4 6.7 33.4 68.1 75.1 21.0	6.5 16.6 18.7 6.4 22.9 73.5 75.8 6.3	4.9 17.9 15.9 5.6 42.9 51.0 87.0 0.1	8.5 17.8 15.7 8.9 26.7 15.3 80.0 25.7	7.6 19.6 29.4 7.5 73.7 77.6 89.0 0.0	6.8 18.4 20.4 7.0 39.9 57.1 81.4 10.6
Cochleagram Ideal Binary Mask	SDRi (dB) ISRi (dB) SIRi (dB) SARi (dB) OPSi TPSi IPSi APSi	4.9 15.3 18.3 4.9 24.4 48.1 73.2 15.6	1.8 3.2 16.7 2.3 19.5 29.2 69.8 4.6	0.9 1.7 13.6 -1.1 39.6 5.2 80.7 0.3	4.5 7.0 11.4 5.3 22.6 4.9 85.1 10.6	7.9 17.7 26.0 8.0 20.2 62.1 75.7 19.0	4.0 9.0 17.2 3.9 25.3 29.9 76.9 10.0

Detailed results

Tamy
"Que Pena / Tanto Faz"
mix

Bearlin
"Roads"
mix

Another Dreamer
"The Ones We Love"
mix

vocals

drums

guitar

Fort Minor
"Remember the Name"
mix

"Ultimate NZ Tour"
mix

vocals

drums

bass

Algorithm 1 (AUTO)
Jean-Louis Durrieu

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals
5.7
9.1
Inf
5.6

29.6
43.0
65.2
35.1

vocals
2.4
4.8
Inf
-0.3

29.0
44.0
63.0
34.8

vocals
3.4
6.5
Inf
1.6

24.7
39.7
66.7
27.5

Algorithm 2 (USER)
Jean-Louis Durrieu

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals
6.2
9.7
Inf
6.2

31.1
39.4
67.7
36.5

vocals
3.7
6.2
Inf
2.2

28.9
47.8
63.5
35.8

vocals
4.4
7.2
Inf
3.4

28.4
33.5
67.4
32.3

Algorithm 3
Estefania Cano Ceron

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals
-2.9
-0.4
Inf
-12.1

25.0
1.6
67.3
3.5

vocals
-0.9
0.6
Inf
-7.8

37.7
0.3
69.6
0.5

Algorithm 4
Julian Becker

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	drums	guitar
-2.8	-4.6	-8.1
1.1	-2.4	-1.9
2.0	12.3	0.9
2.6	7.5	10.4

16.4	43.3	13.5
8.3	0.6	23.3
41.0	39.0	7.7
20.0	0.1	44.8

vocals	drums	bass	claps
-5.9	-10.5	-9.8	-14.3
-1.2	-5.1	-7.2	-7.7
9.4	3.4	8.0	0.1
1.9	3.4	7.0	3.3

28.9	31.0	22.2	3.1
36.5	3.5	4.8	81.6
63.0	59.5	40.5	34.1
37.1	0.6	3.8	1.5

vocals	drums	bass
-10.2	-8.8	-12.0
-2.9	-5.8	-3.0
2.3	6.5	3.1
1.0	5.4	-1.6

15.9	28.5	9.6
28.2	0.3	74.6
25.3	65.3	24.1
41.4	1.0	7.0

Algorithm 5
Ricard Marxer and Jordi Janer

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
7.1	0.3
20.0	2.1
12.1	7.8
8.5	-5.4

27.9	18.1
45.3	23.9
62.1	76.5
41.0	7.1

vocals	snare
3.3	-14.4
10.4	2.4
23.8	-8.1
1.8	-10.2

15.4	7.4
10.7	41.0
74.4	64.4
10.6	1.4

vocals	drums
3.4	-2.2
9.1	5.2
16.0	5.4
2.5	-5.9

18.9	21.3
10.6	60.5
77.4	59.8
7.0	0.1

vocals	drums
2.5	-2.9
4.7	3.1
19.0	1.7
0.5	-5.5

26.7	13.1
4.7	86.9
76.4	60.6
1.7	3.2

vocals	drums
-0.6	0.4
3.1	1.6
10.4	5.1
-6.3	-5.6

29.9	23.9
0.8	7.1
71.8	77.9
0.8	2.4

Algorithm 6
Alexey Ozerov and Emmanuel Vincent

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
8.7	8.5
14.1	13.0
12.1	13.1
11.7	11.7

41.0	22.6
61.5	59.9
54.4	23.9
58.8	69.5

vocals	bass	piano
3.2	3.4	0.8
6.5	6.5	1.3
5.0	6.4	5.8
5.4	3.6	-1.6

36.6	23.8	18.5
52.8	10.4	26.4
49.6	62.8	31.2
50.7	6.0	37.1

vocals	drums	guitar
2.2	-1.9	0.8
3.5	2.7	1.3
4.6	-7.6	4.4
2.6	5.6	4.5

27.9	24.4	19.6
34.0	12.1	19.3
26.7	44.2	8.9
45.5	15.4	47.2

vocals	drums	bass	claps
2.5	0.6	3.4	0.7
4.8	3.1	9.6	1.5
5.0	-3.2	2.9	8.9
3.0	3.2	8.5	-4.2

26.3	13.1	19.8	8.9
46.4	55.4	76.2	74.3
26.5	8.8	54.5	50.5
59.6	60.5	0.2	0.1

vocals	drums	bass
1.4	1.9	-1.1
7.2	3.9	6.4
4.1	2.7	-1.7
2.0	2.9	3.4

31.0	30.8	18.7
52.3	58.0	4.6
41.0	31.9	56.7
46.5	55.5	8.9

Algorithm 7
Hiroshi Sawada

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
10.3	10.1
17.4	15.0
14.7	16.4
12.9	12.4

47.8	56.8
72.6	73.9
68.3	66.1
42.7	59.5

STFT
Ideal Binary Mask

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

bass	vocals	piano
-	-	-
-	-	-
-	-	-
-	-	-

-	-	-
-	-	-
-	-	-
-	-	-

vocals	drums	guitar
8.5	8.8	8.5
15.5	17.1	17.8
18.4	20.1	15.7
9.0	8.9	8.9

30.2	19.3	26.7
64.6	60.1	15.3
76.7	76.8	80.0
22.7	16.1	25.7

vocals	drums	bass	claps
7.2	4.5	7.1	7.6
22.7	9.3	19.3	19.6
26.5	13.4	11.0	29.4
7.0	4.2	9.2	7.5

38.3	23.2	56.8	73.7
80.2	75.0	65.8	77.6
77.1	81.3	91.8	89.0
9.8	0.5	0.0	0.0

vocals	drums	bass
4.2	6.2	2.7
22.1	23.5	16.5
22.2	22.4	20.7
4.0	6.2	2.0

31.6	26.2	29.0
59.3	85.5	36.2
71.6	69.2	82.2
30.6	2.3	0.3

Cochleagram
Ideal Binary Mask

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

vocals	guitar
-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

bass	vocals	piano
-	-	-
-	-	-
-	-	-
-	-	-

-	-	-
-	-	-
-	-	-
-	-	-

vocals	drums	guitar
6.7	1.0	4.5
11.9	1.4	7.0
14.9	17.4	11.4
7.5	2.8	5.3

25.4	15.6	22.6
41.6	26.4	4.9
75.1	71.1	85.1
19.8	9.5	10.6

vocals	drums	bass	claps
5.6	2.2	0.4	7.9
16.1	3.3	0.5	17.7
22.6	14.1	9.9	26.0
5.2	1.8	-0.8	8.0

22.8	19.0	45.3	20.2
76.1	37.4	5.5	62.1
75.0	73.3	81.8	75.7
8.4	0.5	0.0	19.0

vocals	drums	bass
2.6	2.3	1.4
18.0	5.0	3.0
17.5	18.6	17.3
2.0	2.2	-1.4

25.1	23.9	33.9
26.6	23.9	4.9
69.7	64.9	79.7
18.7	3.8	0.5

All audio files are distributed under the terms different licenses, as listed below for each recodring:

Tamy - Que Pena Tanto Faz: Creative Commons Attribution Noncommercial (3.0)
Bearlin - Roads: Read License
Another Dreamer - The Ones We Love Creative Commons Attribution-NonCommercial 1.0
Fort Minor - Remember the Name Creative Commons Attribution-NonCommercial 2.5
Ultimate NZ Tour Creative Commons Attribution-Noncommercial-ShareAlike 3.0

Using these audio files for any purposes that are not scientific research is explicitly prohibited.