Don't worry, you won't be an outcast.
We were in the YC last month (2nd time in YC), and truth be told, we spent most of our time "with the masses". YC "fine dining" just isn't for us, we don't drink and it was too windy for the private YC pool deck...our main source of food was buffet pizza. Also, in the theatre we prefer first row, so we didn't even sit in our "reserved YC seating" area.
If I sail on MSC again...unless I get a super great deal...it's gonna be in a "regular folks" cabin.