[He never wanted to go back, he only wanted to be away from Bruce. Now that his anger has died down, it doesn't matter. Besides, Batman would obviously insist on accompanying him.]

That would be a waste of time. I assume you'll want to see the library? As our time is limited, it may be best to go there first.