Method DMSN (SIE) on the SBM-RGBD dataset

Contact name: Ihssane Houhou

Contact email: ihssane.houhou@univ-biskra.dz

Contact Institution: University of Biskra, Algeria / University of Technology Belfort-Montbeliard, France

Method processing time: ~4 fps using Python 3.6, Keras 2.3, Tensorflow-gpu 2.1, and Cuda 10.1 installed on a machine built with Intel i9 CPU 9th generation and GeForce RTX 2080 GPU under Windows 10 operating system.

Link to the code: https://github.com/ihssanehouhou/DMSN

Reference: I. Houhou, A. Zitouni, Y. Ruichek, SE. Bekhouche, M. Kas, A. Taleb-Ahmed, RGBD deep multi-scale network for background subtraction, International Journal of Multimedia Information Retrieval, vol.11, pp.395-407, May, 2022.

Note: DMSN (SIE) results were obtained by using a different protocol (please check the referenced paper).

Get all result files: here.

A) Sequence-by-sequence results

Name Recall Specificity FPR FNR PWC Precision F-Measure
Bootstrapping
BootStrapping_ds 0.6596 0.9968 0.0032 0.3404 3.4901 0.9549 0.7803
adl24cam0 0.7798 0.9998 0.0002 0.2202 1.3541 0.9961 0.8748
bear_front 0.4778 0.9265 0.0735 0.5222 19.1692 0.6991 0.5676
fall01cam0 0.8954 0.9920 0.0080 0.1046 1.3322 0.8688 0.8819
fall20cam0 0.8464 0.9589 0.0411 0.1536 4.6858 0.5281 0.6504
ColorCamouflage
Cespatx_ds 0.5867 0.9994 0.0006 0.4133 0.9021 0.9540 0.7266
Hallway 0.3006 0.9938 0.0062 0.6994 4.2426 0.7275 0.4254
colorCam1 0.0000 1.0000 0.0000 1.0000 22.3980 0.4091 0.0001
colorCam2 0.0682 0.9997 0.0003 0.9318 42.2793 0.9940 0.1276
DepthCamouflage
DCamSeq1 0.8610 0.9936 0.0064 0.1390 1.3841 0.8877 0.8741
DCamSeq2 0.8047 0.9989 0.0011 0.1953 0.9604 0.9707 0.8800
Despatx_ds 0.9378 0.9900 0.0100 0.0622 1.4738 0.9034 0.9203
Wall 0.1569 0.9993 0.0007 0.8431 7.5907 0.9580 0.2696
IlluminationChanges
ChairBox 0.6589 0.9845 0.0155 0.3411 5.0953 0.8387 0.7380
Ls_ds 0.0000 0.9999 0.0001 0.0000 0.0107 0.0000 0.0000
TimeOfDay_ds 0.0000 0.9988 0.0012 0.0000 0.1223 0.0000 0.0000
genSeq1 0.9841 0.9961 0.0039 0.0159 0.5447 0.9730 0.9785
IntermittentMotion
Shelves 0.2864 0.9945 0.0055 0.7136 1.9347 0.5107 0.3670
Sleeping_ds 0.8446 0.9935 0.0065 0.1554 3.6378 0.9705 0.9032
abandoned1 0.9804 0.9999 0.0001 0.0196 0.0583 0.9963 0.9883
abandoned2 0.9616 0.9988 0.0012 0.0384 0.5738 0.9908 0.9760
movedBackground1 0.8938 0.9999 0.0001 0.1062 0.1642 0.9946 0.9415
movedBackground2 0.9426 0.9968 0.0032 0.0574 0.6695 0.9523 0.9474
OutOfRange
MultiPeople1 0.9167 0.9927 0.0073 0.0833 1.3252 0.9142 0.9154
MultiPeople2 0.9511 0.9882 0.0118 0.0489 1.4827 0.8774 0.9128
TopViewLab1 0.9508 0.9984 0.0016 0.0492 0.3156 0.9542 0.9525
TopViewLab2 0.9660 0.9987 0.0013 0.0340 0.2555 0.9675 0.9668
TopViewLab3 0.8402 0.9990 0.0010 0.1598 0.4420 0.9460 0.8900
Shadows
Shadows_ds 0.7498 0.9974 0.0026 0.2502 1.7787 0.9503 0.8383
fall01cam1 0.8783 0.9400 0.0600 0.1217 6.3918 0.4958 0.6338
genSeq2 0.8711 0.9985 0.0015 0.1289 1.5747 0.9861 0.9250
shadows1 0.9584 0.9984 0.0016 0.0416 0.7186 0.9900 0.9740
shadows2 0.5860 0.9996 0.0004 0.4140 5.7083 0.9952 0.7376

B) Average results for each category

Name Recall Specificity FPR FNR PWC Precision F-Measure
Bootstrapping 0.7318 0.9748 0.0252 0.2682 6.0063 0.8094 0.7510
ColorCamouflage 0.2389 0.9982 0.0018 0.7611 17.4555 0.7712 0.3199
DepthCamouflage 0.6901 0.9954 0.0046 0.3099 2.8522 0.9300 0.7360
IlluminationChanges 0.4107 0.9948 0.0052 0.0893 1.4433 0.4529 0.4291
IntermittentMotion 0.8182 0.9972 0.0028 0.1818 1.1730 0.9025 0.8539
OutOfRange 0.9250 0.9954 0.0046 0.0750 0.7642 0.9319 0.9275
Shadows 0.8087 0.9868 0.0132 0.1913 3.2344 0.8835 0.8217
AVG. 0.6605 0.9918 0.0082 0.2681 4.7041 0.8116 0.6913