Stefano Tommesani

  • Increase font size
  • Default font size
  • Decrease font size
Home Video Comparing background subtraction algorithms

Comparing background subtraction algorithms

The bgslibrary by Andrews Sobral includes over 30 background subtraction algorithms, a common C++ framework for comparing them, and an handy C++/MFC or Java app to see them running on video files or live feed from a webcam.

I have run all the background subtraction algorithms against a test sequence that is really hard, as the camera is slightly shaking and the trees are waving due to the strong wind, so building a reliable estimation of the background of this scene is definitely an hard task. The video sequence was also cropped so that it starts with moving objects already in the scene, to check how quickly the background subtraction algorithms react to permanent changes after the initialization. No filtering was performed on the results, as these videos are meant only to compare the relative performance of background subtraction algorithms.

BGSScreenShotEvery video highlighting an algorithm has the screen divided in quadrants:

  • the top-left quadrant shows the input video to be processed by the algorithm
  • the top-right quadrant shows the foreground mask (in white)
  • the bottom-left quadrant shows the estimated background; not every algorithm has an estimated background that can be displayed, so this quadrant may be blank
  • the bottom-right quadrant shows the name of the algortihm in the bgslibrary and the frame number

Summary of algorithms

Basic methods, mean and variance over time:

Static Frame Difference
Frame Difference
Weighted Moving Mean
Weighted Moving Variance
Adaptive Background Learning
Temporal Mean
Adaptive Median of McFarlane and Schofield (1995) paper link
Temporal Median of Cucchiara et al (2003) and Calderara et al (2006) paper link1 paper link2 paper link3

Fuzzy based methods:

Fuzzy Sugeno Integral (with Adaptive-Selective Update) of Hongxun Zhang and De Xu (2006) paper link
Fuzzy Choquet Integral (with Adaptive-Selective Update) of Baf et al (2008) paper link
Fuzzy Gaussian of Sigari et al (2008) paper link

Statistical methods using one gaussian:

Gaussian Average of Wren (1997) paper link
Simple Gaussian of Benezeth et al (2008) paper link

Statistical methods using multiple gaussians:

Gaussian Mixture Model of Stauffer and Grimson (1999) paper link
Gaussian Mixture Model of KadewTraKuPong and Bowden (2001)paper link
Gaussian Mixture Model of Zivkovic (2004) paper link1 paper link2
Gaussian Mixture Model of Zivkovic (2004) paper link1 paper link2
Gaussian Mixture Model of Baf et al (2008) paper link

Type-2 Fuzzy based methods:

Type-2 Fuzzy GMM-UM of Baf et al (2008) paper link
Type-2 Fuzzy GMM-UV of Baf et al (2008) paper link
Type-2 Fuzzy GMM-UM with MRF of Zhao et al (2012) paper link1 paper link2
Type-2 Fuzzy GMM-UV with MRF of Zhao et al (2012) paper link1 paper link2

Statistical methods using color and texture features:

Texture BGS of Heikkila et al. (2006) paper link
Multi-Layer BGS of Jian Yao and Jean-Marc Odobez (2007) paper link

Non-parametric methods:

Pixel-Based Adaptive Segmenter (PBAS) of Hofmann et al (2012) paper link
GMG of Godbehere et al (2012) paper link
VuMeter of Goyat et al (2006) paper link
KDE of Elgammal et al (2000) paper link

Methods based on eigen features:

Eigenbackground / SL-PCA of Oliver et al (2000) paper link

Neural and neuro-fuzzy methods:

Adaptive SOM of Maddalena and Petrosino (2008) paper link
Fuzzy Adaptive SOM of Maddalena and Petrosino (2010) paper link

Commercial, non-parametric methods:

ViBe of Barnich and Van Droogenbroeck (2011) paper link

 

The following table shows the computational load of each algorithm, computed as median and average microseconds per frame:

Algorithm Median
Average
Static Frame Difference 397 405
Frame Difference 392 399
Weighted Moving Mean 3120 3193
Weighted Moving Variance 7794 7824
Adaptive Background Learning 2878 2969
Temporal Mean 3713 3766
Adaptive Median of McFarlane and Schofield (1995) 1213 1420
Temporal Median of Cucchiara et al (2003) and Calderara et al 2415 11821
Fuzzy Sugeno Integral (with Adaptive-Selective Update) of Hongxun Zhang and De Xu (2006) 34786 35427
Fuzzy Choquet Integral (with Adaptive-Selective Update) of Baf et al (2008) 33840 34033
Fuzzy Gaussian of Sigari et al (2008) 6638 6642
Gaussian Average of Wren (1997) 2602 2633
Simple Gaussian of Benezeth et al (2008) 3537 3577
Gaussian Mixture Model of Stauffer and Grimson (1999) 5414 5459
Gaussian Mixture Model of KadewTraKuPong and Bowden (2001) 3631 3659
Gaussian Mixture Model of Zivkovic (2004) 4071 4123
Gaussian Mixture Model of Zivkovic (2004) 3411 3448
Gaussian Mixture Model of Baf et al (2008) 6295 6223
Type-2 Fuzzy GMM-UM of Baf et al (2008) 8153 8174
Type-2 Fuzzy GMM-UV of Baf et al (2008) 18185 16930
Type-2 Fuzzy GMM-UM with MRF of Zhao et al (2012) 34653 33502
Type-2 Fuzzy GMM-UV with MRF of Zhao et al (2012) 27040 25436
Texture BGS of Heikkila et al. (2006) 104996 105796
Multi-Layer BGS of Jian Yao and Jean-Marc Odobez (2007) 41743 41745
Pixel-Based Adaptive Segmenter (PBAS) of Hofmann et al (2012) 26613 27421
GMG of Godbehere et al (2012) 11985 11787
VuMeter of Goyat et al (2006) 4317 4422
KDE of Elgammal et al (2000) 7998 8155
Eigenbackground / SL-PCA of Oliver et al (2000) 9402 9510
Adaptive SOM of Maddalena and Petrosino (2008) 12285 12467
Fuzzy Adaptive SOM of Maddalena and Petrosino (2010) 13533 13718

All benchmarks performed on an Intel i3 2370. Code compiled with Microsoft Visual C++ 2012, using /O2 and /GL optimizations. Frame size is 320 x 190 pixels, 32-bit BGR format hosted inside OpenCV CV::Mat.

BSGBenchmark

Quote this article on your site

To create link towards this article on your website,
copy and paste the text below in your page.




Preview :


Powered by QuoteThis © 2008
Last Updated on Wednesday, 18 September 2013 23:26  
View Stefano Tommesani's profile on LinkedIn

Latest Articles

Castle on the hill of crappy audio quality 19 March 2017, 01.53 Audio
Castle on the hill of crappy audio quality
As the yearly dynamic range day is close (March 31st), let's have a look at one of the biggest audio massacres of the year, Ed Sheeran's "Castle on the hill". First time I heard the song, I thought my headphones just got
Necessary evil: testing private methods 29 January 2017, 21.41 Testing
Necessary evil: testing private methods
Some might say that testing private methods should be avoided because it means not testing the contract, that is the interface implemented by the class, but the internal implementation of the class itself. Still, not all
I am right and you are wrong 28 December 2016, 14.23 Web
I am right and you are wrong
Have you ever convinced anyone that disagreed with you about a deeply held belief? Better yet, have you changed your mind lately on an important topic after discussing with someone else that did not share your point of
How Commercial Insight changes R&D 06 November 2016, 01.21 Web
How Commercial Insight changes R&D
The CEB's Commercial Insight is based on three pillars: Be credible/relevant – Demonstrate an understanding of the customer’s world, substantiating claims with real-world evidence. Be frame-breaking – Disrupt the
Windows Forms smells funny, but... 07 April 2016, 15.38 Software
Windows Forms smells funny, but...
In the "2016 .NET Community Report" just released by Telerik, the answers to the question "What technology would you choose if building for Windows Desktop?" were as follows: So roughly half of new desktop developments would

Translate