The effect would be jarring if you were suddenly kicked from a 9Mbps lossless file down to a 128Kbps stream, but in reality it's more likely you'd jump between 9Mbps, 4Mbps, 2Mbps, et cetera in smaller increments.