Leaky_Relu in Caffe
<p>I'm trying to use Leaky_Relu layer in caffe and can't really figure out where to define it. From the layer definitions <a href="http://caffe.berkeleyvision.org/tutorial/layers.html" rel="noreferrer">here</a>, I can see that ReLu has an optional parameter called negative_slope which can be used to define a leaky_relu but I can't figure out where this negative_slope parameter goes into.</p>
<p>The ReLu definition looks like this:</p>
<pre><code>layer {
  name: &quot;relu1&quot;
  type: &quot;ReLU&quot;
  bottom: &quot;conv1&quot;
  top: &quot;conv1&quot;
}
</code></pre>
<p>I tried doing this but it threw me an error:</p>
<pre><code>layer {
  name: &quot;relu1&quot;
  type: &quot;ReLU&quot;
  negative_slope: 0.1
  bottom: &quot;conv1&quot;
  top: &quot;conv1&quot;
}
</code></pre>
<p>Any help is very much appreciated.</p>
<p>Thanks!</p>