A clichéd tourist photo, but that's because it's an impressive view!
The gateway was added to the castle in ~1405 by Henry IV but is named after his famous father. The statue of John O'Gaunt (Duke of Lancaster 1362-1399, who probably only ever spent nine days in the city) was added in 1822.
The trees follow the line of a former moat.