There's a nice little pub called Ye Olde Spar Inn further up Abbey Street, as you are walking away from The Venue.
If you venture further into town, the Dolphin is nice. There's a couple of Weatherspoons too, The Babbington Arms and The Standing Order...
Also if you're getting the train, The Brunswick, near the station is a super nice real ale pub...