2008 Signal Separation Evaluation Campaign
Professionally produced music recordings

For details about each algorithm, click on the algorithm number.

For summary results, see
E. Vincent, S. Araki and P. Bofill, "The 2008 Signal Separation Evaluation Campaign: A community-based approach to large-scale evaluation", in Proc. Int. Conf. on Independent Component Analysis and Signal Separation, 2009.

All estimated source signals are made available under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 2.0 license. For licensing information regarding the mixture signals, see the bottom of this page.

Tamy "Que Pena / Tanto Faz"
mix
Bearlin "Roads"(1)
mix
Algorithm 1
A. Ozerov & C. FĂ©votte

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
  5.1   6.3
  4.7   8.1
  3.6   5.3
11.7   8.3
  5.5 12.4
  8.1   9.0
sim1 sim2 sim3
  8.3   1.4   3.0
  8.5   1.5   2.4
  6.3 -3.0 -4.7
16.5   6.0   0.8
12.8   0.0   8.0
  6.7 -0.8 -1.2
Algorithm 2
A. Ozerov

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
  5.6   8.4
  4.7   8.5
  5.1   6.7
10.2 10.3
  6.9 10.8
  9.8 11.7
sim1 sim2 sim3
  9.7   3.8   1.3
10.1   4.0   0.7
  7.9   2.5   1.1
15.4   9.8   3.7
16.6   4.7   3.8
  8.2   5.3   1.0
Algorithm 3
J.-L. Durrieu

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
  7.6 11.1
  8.3 10.9
  7.8   9.4
12.9 21.8
18.9 14.0
  8.2 10.9
Algorithm 4
J.-L. Durrieu

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
  6.9   9.9
  7.2   9.7
  6.9   8.6
12.7 20.4
17.2 13.6
  7.0   9.8
Algorithm 5
M. Cobos

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
  6.1 11.7
  6.0 10.3
  6.4   8.0
10.6 22.4
19.5 11.9
  6.5 10.1
sim1 sim2 sim3
  8.8 -1.1   1.9
  8.8 -0.2   1.9
  6.7   2.5 -1.3
16.0   4.2   5.5
17.9 15.1   5.7
  7.0   1.5 -3.8
Algorithm 6
M. Vinyes

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
  3.6   3.9
  3.6   2.8
  4.9   4.2
  7.2   7.6
26.7 10.3
  5.3   4.0
sim1 sim2 sim3
  8.8   1.0   0.5
  8.9   0.4   0.6
  6.9   3.0 -0.2
16.1   5.4   3.6
17.5 10.4   8.2
  7.2   2.1 -4.0
Algorithm 7
P. Cancela
(intermediate results)

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
10.1   9.3
  9.0   8.9
  8.7   8.0
16.3 13.9
20.2 26.9
  8.6   7.5
Algorithm 8
P. Cancela

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
10.6   9.8
10.0   9.5
  9.7   8.6
15.7 14.6
23.0 25.2
  9.7   8.4
Algorithm 9
P. Cancela

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim2
  5.3
  6.0
  5.4
  9.8
17.7
  5.2
STFT
Ideal Binary Mask

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
11.7 13.2
12.3 14.1
10.1 11.8
19.0 23.8
21.9 20.3
10.5 12.3
sim1 sim2 sim3
12.7 10.4   3.0
13.3 10.5   4.7
10.6   8.2   3.7
19.8 17.1   7.3
16.4 18.9 18.8
12.0   8.5   3.2
Cochleagram
Ideal Binary Mask

mSER_L (dB)
mSER_R (dB)
SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)
sim1 sim2
  8.0   9.6
  8.9   9.4
  7.5   8.6
14.5 14.6
15.1 15.1
  8.1   9.8
sim1 sim2 sim3
-12.1   7.2   3.4
-11.2   6.8   4.0
  0.3   4.6   1.1
  0.5 16.6   6.9
  5.5 13.5 13.2
-3.5   4.8   0.0

(1) In this mixture, the SIR quantifies interference from the three target sources only while the SAR accounts both for other sources and for artifacts.

"Que Pena / Tanto Faz" by Tamy, Curvemusic 2007
Downloaded and modified by M. Vinyes from: http://ccmixter.org/curve/view/contest/sources
Licensed under Creative Commons Attribution Noncommercial (3.0)

"Roads" by Bearlin
Music & lyrics: Ignasi Calvo
Production: Sergi Vila & BEARLIN (Ignasi Calvo & Jordi Rabascall)
Mixing: Sergi Vila at Garatge Produccions
Personnel - Vocals: Jordi Rabascall - Acoustic piano, synthesizers and programming: Ignasi Calvo - Guitars: Xavier Fernandez de Mera - Acoustic drums: Carles Domingo Triquell - Acoustic bass: Pepe Curioni
Recording - Acoustic piano and acoustic guitar: 44.1 Recording Studio (Girona), by Toni Paris - Acoustic drums, percussion and acoustic bass: Palatzi estudis (Barcelona), by David Palatzi - Synthesizers, guitars, programming and effects: BadQstudios and Garatge Produccions (Barcelona)
Mastering: Music Lan Recording Studios (Girona), by Jordi Sole.
All files in this archive are copyrighted material from Bearlin (Ignasi Calvo and Jordi Rabascall). However, the use of these audio files for scientific research purposes is granted if credit is given to them as follows:


Using these audio files for any purposes that are not scientific research is explicitly prohibited.