Thank God for late summer nights. This is the perfect post-dinner stroll.
Definitely walk from the Tate towards St Paul's Cathedral, the views are just stunning. But if you walk the reverse way you'll be looking at the rather unsightly Tate Modern and surrounding buildings. Takes about 15 minutes at a leisurely pace.
Nearest tubes: Southwark (Tate Modern) and St Paul's.