Go to the ocean by boat!
There is a lake on the cliff in the northeast of the main island, where you are able to go after bombing the huge rock with dynamite. Remove the dirt and make a new river and waterfall! Ride a log down the river, and find another pile of dirt holding back the river. Remove the dirt again to make the river flow into the sea. Now you can go to the ocean by a boat.