Method DMSN (SDE) on the SBM-RGBD dataset

Contact name: Ihssane Houhou

Contact email: ihssane.houhou@univ-biskra.dz

Contact Institution: University of Biskra, Algeria / University of Technology Belfort-Montbeliard, France

Method processing time: ~4 fps using Python 3.6, Keras 2.3, Tensorflow-gpu 2.1, and Cuda 10.1 installed on a machine built with Intel i9 CPU 9th generation and GeForce RTX 2080 GPU under Windows 10 operating system

Link to the code: https://github.com/ihssanehouhou/DMSN

Reference: I. Houhou, A. Zitouni, Y. Ruichek, SE. Bekhouche, M. Kas, A. Taleb-Ahmed, RGBD deep multi-scale network for background subtraction, International Journal of Multimedia Information Retrieval, vol.11, pp.395-407, May, 2022.

Get all result files: here.

A) Sequence-by-sequence results

Name Recall Specificity FPR FNR PWC Precision F-Measure
Bootstrapping
BootStrapping_ds 0.9440 0.9986 0.0014 0.0560 0.6486 0.9864 0.9647
adl24cam0 0.9817 0.9998 0.0002 0.0183 0.1327 0.9964 0.9890
bear_front 0.8499 0.9987 0.0013 0.1501 4.0502 0.9956 0.9170
fall01cam0 0.9622 0.9993 0.0007 0.0378 0.2750 0.9880 0.9749
fall20cam0 0.9150 0.9992 0.0008 0.0850 0.5107 0.9848 0.9486
ColorCamouflage
Cespatx_ds 0.9658 0.9998 0.0002 0.0342 0.0883 0.9908 0.9781
Hallway 0.9587 0.9997 0.0003 0.0413 0.2463 0.9940 0.9760
colorCam1 0.9933 0.9993 0.0007 0.0067 0.2056 0.9975 0.9954
colorCam2 0.9197 0.9991 0.0009 0.0803 3.6918 0.9988 0.9576
DepthCamouflage
DCamSeq1 0.9716 0.9997 0.0003 0.0284 0.1842 0.9953 0.9833
DCamSeq2 0.9514 0.9994 0.0006 0.0486 0.2733 0.9856 0.9682
Despatx_ds 0.9603 0.9995 0.0005 0.0397 0.4098 0.9943 0.9770
Wall 0.9959 1.0000 0.0000 0.0041 0.0376 0.9999 0.9979
IlluminationChanges
ChairBox 0.9831 0.9991 0.0009 0.0169 0.2634 0.9926 0.9878
Ls_ds 0.0000 1.0000 0.0000 0.0000 0.0032 0.0000 0.0000
TimeOfDay_ds 0.0000 0.9987 0.0013 0.0000 0.1290 0.0000 0.0000
genSeq1 0.9885 0.9989 0.0011 0.0115 0.2437 0.9922 0.9903
IntermittentMotion
Shelves 0.9538 1.0000 0.0000 0.0462 0.0936 0.9983 0.9756
Sleeping_ds 0.9439 0.9987 0.0013 0.0561 1.2286 0.9947 0.9686
abandoned1 0.9893 1.0000 0.0000 0.0107 0.0285 0.9993 0.9943
abandoned2 0.9856 0.9996 0.0004 0.0144 0.2071 0.9973 0.9914
movedBackground1 0.9915 1.0000 0.0000 0.0085 0.0164 0.9974 0.9944
movedBackground2 0.9499 0.9975 0.0025 0.0501 0.5545 0.9629 0.9564
OutOfRange
MultiPeople1 0.9604 0.9994 0.0006 0.0396 0.3667 0.9925 0.9762
MultiPeople2 0.9880 0.9998 0.0002 0.0120 0.1183 0.9975 0.9927
TopViewLab1 0.9751 0.9995 0.0005 0.0249 0.1338 0.9846 0.9798
TopViewLab2 0.9842 0.9996 0.0004 0.0158 0.0955 0.9909 0.9875
TopViewLab3 0.9507 0.9995 0.0005 0.0493 0.1549 0.9759 0.9631
Shadows
Shadows_ds 0.8504 0.9992 0.0008 0.1496 0.9985 0.9851 0.9128
fall01cam1 0.9833 0.9985 0.0015 0.0167 0.2466 0.9777 0.9805
genSeq2 0.9898 0.9994 0.0006 0.0102 0.1702 0.9949 0.9923
shadows1 0.9895 0.9998 0.0002 0.0105 0.1666 0.9986 0.9940
shadows2 0.9960 0.9998 0.0002 0.0040 0.0731 0.9987 0.9973

B) Average results for each category

Name Recall Specificity FPR FNR PWC Precision F-Measure
Bootstrapping 0.9306 0.9991 0.0009 0.0694 1.1234 0.9902 0.9589
ColorCamouflage 0.9594 0.9995 0.0005 0.0406 1.0580 0.9953 0.9768
DepthCamouflage 0.9698 0.9996 0.0004 0.0302 0.2262 0.9938 0.9816
IlluminationChanges 0.4929 0.9992 0.0008 0.0071 0.1598 0.4962 0.4945
IntermittentMotion 0.9690 0.9993 0.0007 0.0310 0.3548 0.9916 0.9801
OutOfRange 0.9717 0.9996 0.0004 0.0283 0.1738 0.9883 0.9799
Shadows 0.9618 0.9993 0.0007 0.0382 0.3310 0.9910 0.9754
AVG. 0.8936 0.9994 0.0006 0.0350 0.4896 0.9209 0.9067