Former Vice President Joe Biden took a break from fundraising to visit the Stonewall Inn, a historic gay bar in New York City.

Biden’s presidential campaign posted a video of the visit, as Biden handed out beers to patrons from behind the bar.

“It all started here guys,” Biden said.

Other videos made the rounds on social media of the former Vice President taking selfies.

According to NBC News, Biden shook the hand of gay activist Mark Segal and said, “Thank you for your service.”

Biden’s surprise stop to the Stonewall Inn comes just three days after Taylor Swift gave a surprise performance  at the same historic gay bar to celebrate Pride Month.