Back to the original question - yes, jeans are absolutely fine pre 6pm either for breakfast or lunch. No one really cares in my experience.
If in doubt, opt on the side of being smarter. I usually do chinos rather than jeans, but that’s a personal preference.
I’ve generally found the TA to be smarter than the Med and Caribbean sailings.