C3D Model for Keras

readme.md

C3D Model for Keras

This is the C3D model used with a fork of Caffe to the Sports1M dataset migrated to Keras. Details about the network architecture can be found in the following arXiv paper:

Tran, Du, et al. "Learning Spatiotemporal Features With 3D Convolutional Networks." Proceedings of the IEEE International Conference on Computer Vision. 2015.

Content

Download: weights

Sports1M C3D Network to Keras.ipynb

Can you share your code about converting sport1m caffe model to its tensorflow version?　I tried to use this code https://github.com/ethereon/caffe-tensorflow, which did not support the video data layer. Thanks. @chuckcho

Hi Alberto,
Could you tell whether you convert the images to RGB as by default openCV cap reads them in GBR format.
Do you know on which of them conv3D was trained?
Thanks

Hi,
I have loaded your transfered model using bellow command:
model = model_from_json(open('./sports_1M.json', 'r').read())
and I have received this error:
ValueError: Improper config format.
Could you please tell are there any problems with .json file?

Hi, I have your same problem @MOHAMMAD-PY, did you found a solution for that?

is it possible to retrain the network again?

@smarinka Sorry for the delay, but the original model was trained in GBR format.

@albertomontesg: Thank you for your sharing! I am studying the Keras, I used the UCF101 dataset to run and get a result, now I want to use SVM to classify but I don't know how to prepare input file for C3D model in Keras. Could you please help me. Thank you so much!

Hi,

Could you specify the version of your python, your Keras, and Theano? I am running it here on June 14 2018. Now the latest version cannot be compatible with the old one, so when I read your model json file and h5 file, it shows error. It also shows error when I define the model structure by myself and load h5 file.

@ jian @jiang2764 Hi, have u fixed this problem? I have tried to convert caffe's model of 3D convolution by using https://github.com/ethereon/caffe-tensorflow , I also failed.
looking forward to any replies.

@albertomontesg Hi, Thank you for your great job. I have a problem loading the weights in my model. I thought it might be because I use tensorflow backend for my keras, so I decided to convert the weights, but I still get the same error:

ValueError: You are trying to load a weight file containing 0 layers into a model with 11 layers.

Could you please help where is the problem?

Hi,

Could you specify the version of your python, your Keras, and Theano? I am running it here on June 14 2018. Now the latest version cannot be compatible with the old one, so when I read your model json file and h5 file, it shows error. It also shows error when I define the model structure by myself and load h5 file.

hi, did you solve that?

Hi,
The links on weights and model to keras model you gave have some issues. Or my versions should be missmatched. Here are my libraries and versions

• caffe-gpu=1.0=py36h51fbcb3_4
• cudatoolkit=9.2=0
• cudnn=7.2.1=cuda9.2_0
• cupti=9.2.148=0
• ffmpeg=4.0=hcdf2ecd_0
• freeglut=3.0.0=hf484d3e_5
• gast=0.2.0=py36_0
• gflags=2.2.2=he6710b0_0
• jasper=2.0.14=h07fcdf6_1
• keras-applications=1.0.6=py36_0
• keras-base=2.2.4=py36_0
• keras-gpu=2.2.4=0
• keras-preprocessing=1.0.5=py36_0
• libboost=1.67.0=h46d08c1_4
• libglu=9.0.0=hf484d3e_1
• libopencv=3.4.2=hb342d67_1
• libopus=1.3=h7b6447c_0
• libprotobuf=3.6.1=hd408876_0
• lmdb=0.9.22=hf484d3e_1
• markdown=3.0.1=py36_0
• protobuf=3.6.1=py36he6710b0_0
• py-boost=1.67.0=py36h04863e7_4
• py-opencv=3.4.2=py36hb342d67_1
• python-gflags=3.1.2=py36_0
• python-leveldb=0.194=py36_1
• tensorboard=1.12.0=py36hf484d3e_0
• tensorflow=1.12.0=gpu_py36he74679b_0
• tensorflow-base=1.12.0=gpu_py36had579c0_0
• tensorflow-gpu=1.12.0=h0d30ee6_0
• termcolor=1.1.0=py36_1
• conda=4.5.12=py36_0
• conda-build=3.17.6=py36_0
• conda-env=2.6.0=1
• jupyter=1.0.0=py36_7
• jupyter_client=5.2.4=py36_0
• jupyter_console=6.0.0=py36_0
• jupyter_core=4.4.0=py36_0
• jupyterlab=0.35.3=py36_0
• jupyterlab_server=0.2.0=py36_0
• numpy=1.15.4=py36h7e9f1db_0
• numpy-base=1.15.4=py36hde5b4d6_0
• pillow=5.3.0=py36h34e0f95_0
• pip=18.1=py36_0
• python=3.6.7=h0371630_0
• scikit-image=0.14.1=py36he6710b0_0
• scikit-learn=0.20.1=py36hd81dba3_0
• scipy=1.1.0=py36h7c811a0_2
• pip:
  • keras==2.2.4

When using json model here is the error
ValueError: Improper config format:

When using previously created model (by adding layers manually) to lead h5 file weights here is the error
ValueError: You are trying to load a weight file containing 0 layers into a model with 11 layers.

Looks like the weights files cant be decoded properly. Any Idea on what to do?

@supun-kanda Based on this project: https://github.com/axon-research/c3d-keras
I created an updated version of the model (for keras 2.2.4): https://github.com/aslucki/C3D_Sport1M_keras
and weights.

@albertomontesg
Hi, I am facing this error. Did anyone else face this issue?

---

AttributeError Traceback (most recent call last)
in
22 weights_b = np.array(layer.blobs[1].data, dtype=np.float32)
23 weights_p = np.array(layer.blobs[0].data, dtype=np.float32).reshape(
---> 24 layer.blobs[0].num, layer.blobs[0].channels, layer.blobs[0].length,
25 layer.blobs[0].height, layer.blobs[0].width
26 )

AttributeError: length

I am new to caffe and getting attributes from blob using hpp files is sort of not understandable to me here.
Thanks in advance.

@albertomontesg
Is there any training code for the sports-1m dataset?

how can we use the C3D features to model violence detection on videos?