Grande will serve as host for the Oct. 12 episode, with Nicks as the musical guest.
The hilarious skit also featured Sarah Sherman portraying Troye Sivan.
Yang opened up about his friendship with Kelce on the red carpet at the 2024 Emmys.
The pop star also appeared as musical guest, performing songs from her new album.
"I am pro romance. Yay romance," the pop star and TV show host wrote on Instagram.
Ariana Grande and Cynthia Erivo both welcomed the comedian to Oz on social media.