faster RCNN

[northeastsquare]

Hello , when will you open source faster RCNN, or any schedule? Thanks in advance.

[adeelwaris88]

Hi,
You can find fast-rcnn at below link.
https://github.com/rbgirshick/fast-rcnn

[wuqiangch]

Not fast-rcnn,it is faster-rcnn。

[drvoneinzbern]

I'd also like to try the faster-rcnn and the region-proposal-network. I've noticed that you've deleted the branch "faster-R-CNN" couple of days ago. Would you push the branch again to the remote? Thanks in advance.

[ShaoqingRen]

Hi, the branch "faster-R-CNN" in my caffe forked repo appears just because I've forked the latest caffe vesion and modifying it for faster r-cnn. I'm busy doing the modification, and updating faster r-cnn code for the new matlab interface in caffe.
Thanks very much for your patience :)

[drvoneinzbern]

Hi, I've checked out the faster-R-CNN branch and it compiled! Thanks a lot. The question is now, how to use it. Could you probably provide an example deploy file of the network and a pre-trained weight file? A short tutorial of how to train an region-proposal-network would also be nice. Thanks in advance again.

[ShaoqingRen]

Hi Davidsrao,

This branch is just the caffe part of faster R-CNN.

Main matlab code is ready and just waiting for legal procedures. We will release our code very soon.

Best,

Shaoqing

From: noreply@github.com [mailto:noreply@github.com] On Behalf Of Davidsrao
Sent: 2015年8月31日 22:02
To: ShaoqingRen/SPP_net
Cc: Shaoqing Ren
Subject: Re: [SPP_net] faster RCNN (#50)

Hi, I've checked out the faster-R-CNN branch and it compiled! Thanks a lot. The question is now, how to use it. Could you probably provide an example deploy file of the network and a pre-trained weight file? A short tutorial of how to train an region-proposal-network would also be nice. Thanks in advance again.

—
Reply to this email directly or view it on GitHub #50 (comment) . https://github.com/notifications/beacon/AGi7v6wSU_hikyYDZGseW8wpVFlZeOD_ks5otFXBgaJpZM4FQfKp.gif

[legolas123]

Great algorithm to bypass time consuming selective search.
I implemented faster-rcnn using caffe, but in the top 300 regions generated through caffenet or zeiler, I hardly get an exact patch fitting the ground truth box closely which is the case in selective search proposals. Although with VGG net I always get a proposal corresponding to the gt box. My observation is that with smaller net, the algorithm does the correct classification between object and background but lags in rectifying the coordinates through regression. So I also tried giving more weight to regression loss but with no success. So I feel with these proposals and smaller net I wont be getting the same MAP score for detection as I do with selective search region proposals.
Have you also experienced the same thing with smaller nets?

[yao5461]

@legolas123 @ShaoqingRen Could you share the prototxt files of Region-Proposal-Network. I'm not sure about the architecture.
This architecture is naturally implemented with an n × n conv layer followed by two sibling 1 × 1 conv layers (for reg and cls, respectively).
Thanks in advance.

[legolas123]

There you go.

name: "CaffeNet"

layer {
name: "conv1"
type: "Convolution"
bottom: "data"
top: "conv1"
param {
lr_mult: 0
decay_mult: 0
}
param {
lr_mult: 0
decay_mult: 0
}
convolution_param {
num_output: 96
kernel_size: 11
pad: 5
stride: 4
}
}
layer {
name: "relu1"
type: "ReLU"
bottom: "conv1"
top: "conv1"
}
layer {
name: "pool1"
type: "Pooling"
bottom: "conv1"
top: "pool1"
pooling_param {
pool: MAX
kernel_size: 3
pad: 1
stride: 2
}
}
layer {
name: "norm1"
type: "LRN"
bottom: "pool1"
top: "norm1"
lrn_param {
local_size: 5
alpha: 0.0001
beta: 0.75
}
}
layer {
name: "conv2"
type: "Convolution"
bottom: "norm1"
top: "conv2"
param {
lr_mult: 1
decay_mult: 1
}
param {
lr_mult: 2
decay_mult: 0
}
convolution_param {
num_output: 256
kernel_size: 5
pad: 2
group: 2
}
}
layer {
name: "relu2"
type: "ReLU"
bottom: "conv2"
top: "conv2"
}
layer {
name: "pool2"
type: "Pooling"
bottom: "conv2"
top: "pool2"
pooling_param {
pool: MAX
kernel_size: 3
pad: 1
stride: 2
}
}
layer {
name: "norm2"
type: "LRN"
bottom: "pool2"
top: "norm2"
lrn_param {
local_size: 5
alpha: 0.0001
beta: 0.75
}
}
layer {
name: "conv3"
type: "Convolution"
bottom: "norm2"
top: "conv3"
param {
lr_mult: 1
decay_mult: 1
}
param {
lr_mult: 2
decay_mult: 0
}
convolution_param {
num_output: 384
kernel_size: 3
pad: 1
}
}
layer {
name: "relu3"
type: "ReLU"
bottom: "conv3"
top: "conv3"
}
layer {
name: "conv4"
type: "Convolution"
bottom: "conv3"
top: "conv4"
param {
lr_mult: 1
decay_mult: 1
}
param {
lr_mult: 2
decay_mult: 0
}
convolution_param {
num_output: 384
kernel_size: 3
pad: 1
group: 2
}
}
layer {
name: "relu4"
type: "ReLU"
bottom: "conv4"
top: "conv4"
}
layer {
name: "conv5"
type: "Convolution"
bottom: "conv4"
top: "conv5"
param {
lr_mult: 1
decay_mult: 1
}
param {
lr_mult: 2
decay_mult: 0
}
convolution_param {
num_output: 256
kernel_size: 3
pad: 1
group: 2
}
}

layer {
name: "relu5"
type: "ReLU"
bottom: "conv5"
top: "conv5"
}

layer {
name: "conv6"
type: "Convolution"
bottom: "conv5"
top: "conv6"
param {
lr_mult: 1
decay_mult: 1
}
param {
lr_mult: 2
decay_mult: 0
}
convolution_param {
num_output: 256
kernel_size: 3
pad: 1
weight_filler {
type: "gaussian"
std: 0.01
}
bias_filler {
type: "constant"
value: 0
}
}
}

layer {
name: "relu6"
type: "ReLU"
bottom: "conv6"
top: "conv6"
}

layer {
name: "conv6_1"
type: "Convolution"
bottom: "conv6"
top: "conv6_1"
param {
lr_mult: 1
decay_mult: 1
}
param {
lr_mult: 2
decay_mult: 0
}
convolution_param {
num_output: 18
pad: 0
kernel_size: 1
weight_filler {
type: "gaussian"
std: 0.01
}
bias_filler {
type: "constant"
value: 0
}
}
}

layer {
name: "conv6_2"
type: "Convolution"
bottom: "conv6"
top: "conv6_2"
param {
lr_mult: 1
decay_mult: 1
}
param {
lr_mult: 2
decay_mult: 0
}
convolution_param {
num_output: 36
pad: 0
kernel_size: 1
weight_filler {
type: "gaussian"
std: 0.01
}
bias_filler {
type: "constant"
value: 0
}
}
}

layer {
name: "loss_cls"
type: "SoftmaxWithLoss"
bottom: "conv6_1"
bottom: "labels"
bottom: "loss_wts"
top: "loss_cls"
loss_weight: 1
}

layer {
name: "loss_bbox"
type: "SmoothL1Loss"
bottom: "conv6_2"
bottom: "bbox_targets"
bottom: "bbox_loss_weights"
top: "loss_bbox"
loss_weight: 1
}

[xmubingo]

@legolas123 Thanks!

[yao5461]

@legolas123 Thanks for your sharing! I'm trying to implement faster-rcnn using caffe, but I have some doubts about the input and output of Region-Proposal-Network. The dimensions of output layers are: cls_score->1*2k*H*W, bbox_pred->1*4k*H*W. So I guess the dimensions of data layer may be: labels->1*k*H*W, bbox_targets->1*4k*H*W. But that's wrong and I don't know how to design that.
The Caffe error information: Number of labels must match number of predictions; e.g., if softmax axis == 1 and prediction shape is (N, C, H, W), label count (number of labels) must be N*H*W, with integer values in {0, 1, ..., C-1}. Does it mean that the dimension of labels must be 1*H*W?
I'm a newbie about CNN and Caffe. Thanks in advance.

[ShaoqingRen]

Hi all,

We have released Faster RCNN code on https://github.com/ShaoqingRen/faster_rcnn , you can check it for more details.

[Elpidam]

Hello!
I'm here to mention a problem while doing "make runtest". I get an error about "Unknown V1LayerParameter layer type:40". You can see the snapshot below.

[MonPower]

@Elpidam @ShaoqingRen
I also meet the same error

[SunShineMin]

I have suffered the save issue above @ShaoqingRen @Elpidam @MonPower , and I found that it resulted from the UpgradeV1LayerType() in upgrade_proto.cpp, you have to add Reshape, ROIPooling and SmoothL1Loss type in it