Without any applied electric field, in a solid, electrons and holes move around randomly. Therefore, on average there will be no overall motion of charge carriers in any particular direction over time.