I stayed with my parents at the Good Morning Copenhagen Star in 2018; it's not in either of your mentioned neighborhoods above, but you might be willing to consider it. We had a spacious corner triple, there was an elevator in the building, and the breakfast was very good. It's 2-3 blocks away from the central train station, 4 blocks from a Tivoli Gardens entrance, and there are supermarkets not too far away either. It's near some hostels, so you might encounter some drunk travelers on the sidewalks in the late evenings, but we didn't feel unsafe walking back late from Tivoli or from a quick trip to a supermarket.
Connecting from the hotel to the port involved a light rail ride and then a bus transfer, but I found Copenhagen's public transit to be easily navigable, even with luggage, so I don't imagine you'd have a problem either.