The vast majority of photons that come anywhere near a particular atom are almost completely unaffected by that atom. The atom is almost completely transparent to most frequencies (colors) of photons.