2008 Signal Separation Evaluation Campaign
Head-geometry mixtures of two speech sources in real environments

This webpage presents a small proportion of the results for the source spatial image estimation task. Other results (including those for the source signal estimation task) are available upon request.

For details about each algorithm, click on the algorithm number.

For summary results, see
E. Vincent, S. Araki and P. Bofill, "The 2008 Signal Separation Evaluation Campaign: A community-based approach to large-scale evaluation", in Proc. Int. Conf. on Independent Component Analysis and Signal Separation, 2009.

All audio files are made available under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 2.0 license. The authors of the dataset are Hendrik Kayser and Jörn Anemüller. The collection of the dataset was supported by the European Commission under IP DIRAC.

Anechoic chamber, target DOA: 0°
Interference DOA-160°
mix		-80°
mix		-40°
mix		-20°
mix		20°
mix		40°
mix		80°
mix		160°
mix
Algorithm 1
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
12.1
19.8
19.2
13.2		sim1
11.8
17.9
25.1
12.4		sim1
11.6
18.0
23.0
12.3		sim1
11.6
18.2
20.5
12.4		sim1
8.2
17.2
10.2
12.0		sim1
10.8
16.9
18.9
11.8		sim1
11.6
17.6
25.2
12.2		sim1
8.1
18.5
9.7
12.4
Algorithm 2
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
11.9
23.1
15.8
14.2		sim1
12.6
20.0
24.9
13.2		sim1
12.3
22.3
18.5
13.5		sim1
12.3
22.2
18.5
13.5		sim1
12.5
22.0
18.8
13.8		sim1
11.7
21.4
16.8
13.4		sim1
12.3
19.5
24.0
12.9		sim1
9.1
23.0
10.1
15.3
STFT
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
14.0
24.9
24.7
14.5		sim1
12.9
23.5
24.3
13.4		sim1
13.2
24.0
24.3
13.7		sim1
13.5
24.6
24.4
13.9		sim1
13.5
24.6
24.4
13.9		sim1
13.2
24.0
24.3
13.7		sim1
12.9
23.6
24.3
13.4		sim1
14.0
24.9
24.7
14.5
Cochleagram
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
11.1
20.4
19.8
11.7		sim1
10.2
18.7
19.8
10.7		sim1
10.6
19.3
19.9
11.1		sim1
10.7
19.6
19.9
11.2		sim1
10.7
19.6
19.9
11.2		sim1
10.6
19.3
19.9
11.1		sim1
10.2
18.7
19.8
10.7		sim1
11.1
20.4
19.8
11.7


Anechoic chamber, target DOA: 40°
Interference DOA-120°
mix		-40°
mix		0°
mix		20°
mix		60°
mix		80°
mix		120°
mix
Algorithm 1
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
14.4
23.7
25.5
15.0		sim1
14.2
23.4
25.3
14.8		sim1
11.7
18.2
19.6
13.3		sim1
9.1
11.0
20.9
12.7		sim1
5.2
14.6
5.5
12.6		sim1
4.8
5.6
19.7
9.4		sim1
3.4
19.6
3.3
14.8
Algorithm 2
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
14.1
23.1
24.8
14.8		sim1
13.9
23.2
24.0
14.6		sim1
11.6
15.1
23.2
13.7		sim1
12.4
15.7
22.1
14.9		sim1
5.0
5.8
15.2
11.9		sim1
6.7
7.4
24.0
12.9		sim1
2.3
4.0
4.6
10.9
STFT
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
13.7
25.1
24.2
14.3		sim1
13.6
24.8
24.2
14.2		sim1
14.0
25.3
24.6
14.5		sim1
13.9
25.3
24.6
14.3		sim1
13.3
24.0
24.4
13.7		sim1
13.2
23.8
24.3
13.6		sim1
13.7
24.6
24.5
14.1
Cochleagram
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
11.6
20.7
19.9
12.5		sim1
11.4
20.4
20.0
12.3		sim1
11.2
20.6
20.0
11.8		sim1
11.0
20.3
20.0
11.5		sim1
10.5
19.1
20.0
10.9		sim1
10.4
18.9
20.0
10.8		sim1
10.8
19.7
20.0
11.3


Anechoic chamber, target DOA: 80°
Interference DOA-160°
mix		-80°
mix		0°
mix		40°
mix		60°
mix		100°
mix		120°
mix		160°
mix
Algorithm 1
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
15.4
26.0
25.3
16.1		sim1
14.4
25.1
24.1
15.1		sim1
13.5
24.6
21.1
14.5		sim1
4.8
21.0
5.1
13.9		sim1
1.6
19.7
1.5
14.4		sim1
1.0
17.7
0.6
18.3		sim1
4.1
19.9
4.3
14.0		sim1
13.4
20.6
22.3
14.6
Algorithm 2
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
15.3
25.5
24.8
16.0		sim1
14.3
23.9
24.5
14.9		sim1
13.5
22.8
21.9
14.6		sim1
5.6
22.2
6.0
15.6		sim1
1.5
20.8
1.6
16.1		sim1
0.7
20.4
0.6
19.7		sim1
4.0
21.1
4.1
15.5		sim1
14.2
21.5
23.6
15.3
STFT
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
14.9
26.6
25.1
15.5		sim1
13.7
24.8
24.2
14.3		sim1
14.5
26.0
24.9
15.1		sim1
14.1
25.5
24.8
14.6		sim1
13.8
25.1
24.5
14.3		sim1
13.9
25.0
24.6
14.3		sim1
14.2
25.4
24.9
14.7		sim1
14.9
26.5
25.2
15.4
Cochleagram
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
12.1
22.5
19.9
13.0		sim1
11.2
20.5
19.8
12.0		sim1
11.6
21.5
20.1
12.3		sim1
11.2
20.7
20.2
11.7		sim1
10.9
20.0
20.2
11.4		sim1
11.0
20.0
20.3
11.4		sim1
11.3
20.7
20.3
11.8		sim1
11.9
22.1
20.1
12.6


Office room, target DOA: 0°
Interference DOA-80°
mix		-40°
mix		-20°
mix		-10°
mix		10°
mix		20°
mix		40°
mix		80°
mix
Algorithm 1
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
5.0
11.9
5.7
12.1		sim1
4.7
12.1
5.2
12.8		sim1
3.2
11.3
3.2
12.8		sim1
2.7
4.1
4.0
8.6		sim1
1.7
2.8
3.2
7.0		sim1
4.1
12.7
4.3
13.3		sim1
4.4
11.8
4.8
12.7		sim1
4.3
11.4
4.8
11.8
Algorithm 2
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
5.2
11.3
5.8
12.1		sim1
4.9
11.7
5.5
12.9		sim1
3.3
11.1
3.2
13.1		sim1
3.5
5.6
3.6
10.9		sim1
2.1
3.2
3.0
8.3		sim1
4.2
12.3
4.3
13.5		sim1
4.5
11.9
4.9
13.4		sim1
4.5
10.8
5.0
12.0
Algorithm 3
R. Weiss
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
3.9
14.8
4.3
12.6		sim1
4.1
14.7
4.4
13.4		sim1
2.2
13.5
2.1
13.7		sim1
1.2
1.8
5.0
4.9		sim1
0.9
1.4
2.9
4.0		sim1
3.1
14.1
3.2
13.7		sim1
3.8
14.3
4.1
13.3		sim1
4.5
13.6
4.9
12.2
STFT
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
13.2
24.1
24.6
13.7		sim1
13.3
23.8
24.2
13.9		sim1
13.2
24.2
24.0
13.7		sim1
13.2
24.9
23.8
13.7		sim1
13.3
23.9
24.0
13.8		sim1
13.6
24.5
24.9
14.1		sim1
12.9
23.7
23.8
13.6		sim1
12.9
23.3
24.5
13.4
Cochleagram
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
10.7
21.1
19.5
11.4		sim1
10.8
20.7
19.1
11.6		sim1
10.7
21.0
19.0
11.5		sim1
10.7
21.2
19.1
11.4		sim1
10.9
21.1
19.3
11.5		sim1
11.0
21.1
19.6
11.7		sim1
10.3
19.5
18.6
11.1		sim1
10.5
20.3
19.4
11.1


Office room, target DOA: 40°
Interference DOA-80°
mix		-40°
mix		0°
mix		20°
mix		30°
mix		50°
mix		60°
mix		80°
mix
Algorithm 1
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
4.2
5.8
8.0
10.2		sim1
5.6
11.2
6.2
12.8		sim1
3.0
4.1
7.3
9.1		sim1
2.5
3.7
5.9
8.6		sim1
2.0
5.8
1.6
11.9		sim1
2.7
4.0
6.1
8.2		sim1
3.7
9.2
3.8
11.4		sim1
2.3
3.7
3.3
7.5
Algorithm 2
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
4.7
6.3
8.6
10.6		sim1
6.5
10.9
7.7
12.9		sim1
3.1
4.2
7.1
9.5		sim1
2.8
4.0
5.3
9.4		sim1
2.6
4.8
2.7
11.0		sim1
3.6
5.7
4.7
10.5		sim1
3.8
8.9
3.7
11.9		sim1
2.5
4.0
3.4
8.0
Algorithm 3
R. Weiss
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
6.5
9.0
11.0
11.1		sim1
6.8
12.1
8.3
12.9		sim1
2.3
2.9
8.7
7.0		sim1
1.7
2.3
6.4
5.8		sim1
1.5
2.1
3.7
5.5		sim1
1.1
1.5
4.4
5.0		sim1
2.2
12.2
1.8
13.2		sim1
1.0
1.4
1.7
3.5
STFT
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
13.2
24.5
24.1
13.7		sim1
13.4
24.6
24.2
13.9		sim1
13.5
25.2
24.2
14.0		sim1
13.6
24.2
24.1
14.1		sim1
13.2
23.8
24.0
13.8		sim1
12.9
24.1
24.0
13.3		sim1
12.9
23.9
24.1
13.4		sim1
13.2
24.4
24.2
13.7
Cochleagram
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
11.3
21.1
19.9
12.0		sim1
11.5
21.3
19.5
12.3		sim1
11.2
21.7
19.7
11.9		sim1
11.2
21.7
19.5
11.9		sim1
10.9
21.0
19.6
11.6		sim1
10.6
20.9
19.6
11.2		sim1
10.6
21.0
19.5
11.3		sim1
10.8
21.3
19.6
11.4


Office room, target DOA: 80°
Interference DOA-80°
mix		-40°
mix		0°
mix		40°
mix		60°
mix		70°
mix		90°
mix
Algorithm 1
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
7.3
11.5
9.9
12.5		sim1
6.3
11.7
7.2
12.8		sim1
5.9
8.7
9.2
11.1		sim1
2.6
11.2
2.1
12.6		sim1
2.3
12.3
1.9
13.1		sim1
1.6
12.5
1.1
13.8		sim1
0.5
0.9
0.6
3.0
Algorithm 2
M. Mandel
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
7.5
11.8
9.7
12.8		sim1
6.9
11.3
8.6
13.3		sim1
5.6
8.7
7.9
11.3		sim1
3.0
10.8
2.5
13.0		sim1
2.4
12.3
2.0
13.4		sim1
1.6
11.9
1.0
14.1		sim1
0.5
0.8
0.5
3.7
Algorithm 3
R. Weiss
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
7.2
10.2
11.7
11.9		sim1
7.4
12.5
9.5
13.1		sim1
3.2
4.2
9.5
7.2		sim1
2.1
7.8
1.8
10.6		sim1
1.5
15.1
1.3
15.5		sim1
1.1
15.7
0.8
16.6		sim1
0.3
0.4
1.9
0.9
STFT
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
13.5
25.0
23.9
14.1		sim1
13.7
24.5
24.8
14.3		sim1
13.5
24.7
24.1
14.1		sim1
13.2
23.5
24.0
13.8		sim1
13.1
24.0
23.9
13.6		sim1
13.0
24.0
24.3
13.5		sim1
13.0
23.7
24.5
13.5
Cochleagram
Ideal Binary Mask
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)		sim1
11.2
21.1
19.2
12.0		sim1
11.3
21.2
19.2
12.2		sim1
11.1
21.4
19.0
11.9		sim1
10.3
19.9
18.3
11.1		sim1
10.5
20.0
18.7
11.2		sim1
10.6
20.8
19.2
11.2		sim1
10.3
20.2
18.7
11.1