Across Victoria Harbor, connected by ferry and the MTR rail line, is the Kowloon peninsula with its hotels, nightlife, and almost non-stop shopping.
I don't recommend going to the Kowloon peninsula as it is very boring.