Minecraft wiki entry for Minecarts, associated text: Running a track next to a wall makes no difference to the speed of progress, but an adjacent one-block-high wall significantly slows down a cart if the cart is pointed at the wall while entering a turn or "diagonal" section.