Lainey Wilson, Ingrid Andress, Madeline Edwards and Morgan Wade also featured in the performance of the 'Jagged Little Pill' classic.
The performance came as drag queens are being targeted by new bills around the U.S.
The star won his first-ever CMT Music Award earlier in the night.
The BLACKPINK singer's two-song release brought in more than 66% of the vote.
The veteran pop/rock star and the acclaimed country singer-songwriter brought a faithful version of the 'Tragic Kingdom' classic to life.
The star made her statements while accepting the CMT Equal Play Award, which was presented to her by Megan Thee Stallion
"Thank you to everyone who has been there to cheer me up, dried my tears, inspired me and made me grow," she said.
"Tonight's broadcast is dedicated to the ever-growing list of families, friends, survivors, witnesses and responders whose lives continue to forever be changed by gun violence," she said.
"Austin, I still love you!" Shelton raved to the Texas crowd.
The singer confirmed her relationship with the actor in a February episode of the Call Her Daddy podcast.
