We just got off Allure (hopefully similar comparison since it's Oasis class), and had CP-facing balconies. If the doors were closed and the handle locked, there was very little if any noise. I'm a light sleeper and had no issues.
If the handle was not fully locked and/or the door was ajar, there is definitely some background noise. For the most part it was nice music and not too much distracting noise.