why is multi GPU tensorflow retraining not working
<p>I have been training my tensorflow retraining algorithm using a single GTX Titan and it works just fine, but when I try to use multiple gpus in the flower of retraining example it does not work and seems to only utilize one GPU when I run it in Nvidia SMI.  </p>

<p>Why is this happening as it does work with multiple gpus when retraining at Inception model from scratch but not during retraining?</p>