Daniel Craigwas a good sport whenQueen Elizabethonce made him the butt of a joke.

TheNo Time to Dieactor, 53, appeared onThe Late ShowWednesday night, telling host Stephen Colbert about his last go-round as James Bond in the Oscar-nominated movie. At one point, Colbert asked the star aboutdoing the sketch with the Queenthatairedduring the opening ceremony for the Olympics in London back in 2012.

“I understand that you may not be able to answer this question, but I’m gonna ask anyway: What’s she like in private?” he asked Craig.

The actor said, “Very funny. Wants to crack a joke, and cracked a joke about me. We’re having our photographs taken and she just went, ‘Oh no, he’s the one that doesn’t smile.’ Fair enough!”

Craig added that he was “rolling around on the floor” with her pet corgis as well. “They’re very friendly,” he recalled.

Getty (2)

Daniel Craig and Queen Elizabeth

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

Danny Boyle (Trainspotting) directed the 2012 sketch featuring Craig and the Queen. It’s a parody of the famous British spy films where Craig’s character picks up the Queen from Buckingham Palace. Stunt actors played them as they helicoptered across London and parachuted into the Olympics venue. To cheers,Queen Elizabeththen appeared on the steps of the VIP seats for her grand entrance at the Olympics.

Back in 2019, Angela Kelly, the Queen’s dresser and close confidant,shared how the iconic moment came to bein her bookThe Other Side of the Coin: The Queen, the Dresser and the Wardrobe.

Kelly was one of the first people to hear the pitch during a 2011 meeting with Boyle and Private Secretary Edward Young — and even presented the idea to the Queen directly.

“Having listened to Danny’s plan, I asked him and Edward to give me five minutes so that I could ask the Queen,” Kelly wrote. “I remember the look of shock on Danny’s face that I would be asking Her Majesty straight away, but there’s no point in waiting around with these things: if she said no, that would be the end of it.”

“I asked then if she would like a speaking part,” Kelly recalled. “Without hesitation, Her Majesty replied: ‘Of course I must say something. After all, he is coming to rescue me.’ "

She added, “I asked whether she would like to say: ‘Good evening, James,’ or: ‘Good evening, Mr. Bond,’ and she chose the latter, knowing the Bond films. Within minutes, I was back in Edward’s office delivering the good news to Danny — I think he almost fell off his chair when I said that the Queen’s only stipulation was that she could deliver that iconic line.”

source: people.com