In zero field, there will be no net motion of charged particles because the system is not able to rotate. There will therefore be an average magnetic moment of zero. Since the distribution of motions does not depend on the magnetic field, the moment in thermal equilibrium remains zero in any magnetic field.