I don’t recall it being chilly in the dining room or anywhere else when we were on board in January but I always have a sweater or wrap handy if needed.
The only place I recall being chilly when dining was the one night we went to the outdoor venue during the evening as it was windy and they had blankets available to wrap up in.