Yes, this is one thing that you shouldn't overthink. Pay attention to forward or aft, pay attention to what is above and below your cabin. Pay attention to crew entrances near your cabin. On a tranatlantic, pay attention to whether you want sun or shade. But port or starboard otherwise doesn't matter that much.