In classical electromagnetism the two descriptions were equivalent. With the addition of quantum theory, though, the electromagnetic potentials Φ and A are seen as being more fundamental. Despite this, all observable effects end up being expressible in terms of the electromagnetic fields, E and B. This is interesting because, while you can calculate the electromagnetic field from the four-potential, due to gauge freedom the reverse is not true.