Welcome. Based on what you have said, it appears that the Balcony and Concierge quotes are cruise only fares.
Are your quoted price differences per person?
Obviously you have to run the numbers to see if it worth it for you. You each get internet, gratuities paid, and a drink package. (AI) I know you said neither of you drink alcohol, but you do receive nonalcoholic drinks. Therefore it has some value. If you only drink ship’s tap water and the free nonalcoholic beverage, it has zero value.
if you decide the AI extra benefits has real value to you, then you might want to price the balcony and concierge with the AI included. Then you can understand the real cost to book Aqua Class.
This is an anomaly caused by the fact that Celebrity does not normally offer Cruise Only rates for Aqua Class and above categories. Therefore you might not be comparing “Apples to Apples”
Good luck.