Because the distance covered while applying a force to an object depends on the inertial frame of reference, so depends the work done. Due to Newton's law of reciprocal actions there is a reaction force; it does work depending on the inertial frame of reference in an opposite way. The total work done is independent of the inertial frame of reference.