Error with 8-bit Quantization in Tensorflow
<p>I have been experimenting with the new <a href="https://petewarden.com/2016/05/03/how-to-quantize-neural-networks-with-tensorflow/" rel="nofollow">8-bit quantization feature</a> available in TensorFlow. I could run the example given in the blog post (quantization of googlenet) without any issue and it works fine for me !!!</p>

<p>Now, I would like to apply the same for a simpler network. So I used a pre-trained network for CIFAR-10 (which is trained on Caffe), extracted its parameters, created corresponding graph in tensorflow, initialized the weights with this pre-trained weights and finally saved it as a GraphDef object. See this <a href="https://gist.github.com/abidrahmank/ba75c0e305b6d859117263af74c21599" rel="nofollow"><strong>IPython Notebook</strong></a> for full procedure.</p>

<p>Now I applied the 8-bit quantization with the tensorflow script as mentioned in the Pete Warden's blog:</p>

<pre><code>bazel-bin/tensorflow/contrib/quantization/tools/quantize_graph --input=cifar.pb  --output=qcifar.pb --mode=eightbit --bitdepth=8 --output_node_names="ArgMax"
</code></pre>

<p>Now I wanted to run the classification on this quantized network. So I loaded the new <code>qcifar.pb</code> to a tensorflow session and passed the image (the same way I passed it to original version). Full code can be found in this <strong><a href="https://gist.github.com/abidrahmank/d715ae0526b31dc6967ed44e36c713db" rel="nofollow">IPython Notebook.</a></strong></p>

<p>But as you can see at the end, I am getting following error: </p>

<p><strong><code>NotFoundError: Op type not registered 'QuantizeV2'</code></strong></p>

<p>Can anybody suggest what am I missing here?</p>