Paul McCartney and Paul Simon both performed at the special Saturday Night Live 40th anniversary show on Sunday night, and even did a short duet.

McCartney and Simon, both frequent gests on the show, made a brief cameo during SNL 40‘s Hosts monologue before performing separately later on. During the monologue, Steve Martin was joined by an array of previous hosts – including Tom Hanks, Peyton Manning and Chris Rock – to debate who made the best hosts. McCartney and Simon tried to make a case for “musicians named Paul,” and performed a short duet of the Beatles’ classic “I’ve Just Seen A Face,” but were sent packing. “Told you we should’ve done ‘Sound of Silence,’” joked Simon as they walked off stage.

Paul Simon And Paul McCartney Perform On SNL 40

Later, Simon took to the stage to honor the Saturday Night Live band and perform “Still Crazy After All These Years.”

McCartney also performed, with an introduction by Keith Richards, singing his classic “Maybe I’m Amazed.”