A number of companies offer underwater tours in glass-bottomed boats or submersible craft, or you can rent snorkel or scuba gear to get a closer look yourself.
Submersible access is the most expensive option.