Ceph too many pgs per osd: all you need to know
<p>I am getting <em>both</em> of these errors at the same time. I can't decrease the pg count and I can't add more storage. </p>

<p>This is a new cluster, and I got these warning when I uploaded about 40GB to it. I guess because radosgw created a bunch of pools.</p>

<p>How can ceph have too many pgs per osd, yet have more object per pg than average with a too few pgs suggestion?</p>

<pre><code>HEALTH_WARN too many PGs per OSD (352 &gt; max 300); 
pool default.rgw.buckets.data has many more objects per pg than average (too few pgs?)

osds: 4 (2 per site 500GB per osd)
size: 2 (cross site replication)
pg:  64
pgp: 64
pools: 11
</code></pre>

<p>Using rbd and radosgw, nothing fancy. </p>