The Quartier Latin has some advantages, yet only you know if they are such for you:
The RER to CDG stops right there, thus you can reach the airport by oublic transportation without connections - very big advantage with luggage.
For many it is an quintessential Paris area, nourished by pictures, film and books from the fifties.
Many sights are walkable, so are restaurants and bars.