Nassau go see the Queens staircase, forts, and the distillery.
St. Thomas go to Coki Beach for snorkeling or Megan’s Bay for beauty (stop at Utter Delite for a delicious Rum Shake) and if you rent a car go to Drake’s Seat the view is spectacular. Sorry just reread the OP and you want walking distance so visit Fort Christian.