plans were underway to widen this street into an elegant thoroughfare so that the prince regent would be able to travel a more or less direct route from a park that would be built north of oxford street to his opulent carleton house just below pall mall .