Just a week after the release of a Complex magazine feature, in which Justin Bieber was quoted as saying he wants to live more like Jesus, the pop star was filmed on stage smoking marijuana and drinking alcohol.

TMZ reports the 21-year-old was performing in New Zealand on Thursday night with hip hop duo Rae Sremmurd, when he turned up a bottle of Hennessy.

Moments later, the singer lit up a joint and began smoking.

Watch the video below, where Bieber starts smoking marijuana at about the 2:00 mark:

For the October/November issue of Complex, Bieber spoke in-depth about getting his act together, and opened up about his faith.

“I just wanna honestly live like Jesus. Not be Jesus—I could never—I don’t want that to come across weird,” said Justin. “He created a pretty awesome template of how to love people and how to be gracious and kind.”

Bieber was subsequently accused of groping a Playboy model.