The song was up for video of the year at this year's ceremony.
Lainey Wilson, Ingrid Andress, Madeline Edwards and Morgan Wade also featured in the performance of the 'Jagged Little Pill' classic.
The performance came as drag queens are being targeted by new bills around the U.S.
The star won his first-ever CMT Music Award earlier in the night.
The veteran pop/rock star and the acclaimed country singer-songwriter brought a faithful version of the 'Tragic Kingdom' classic to life.
The star made her statements while accepting the CMT Equal Play Award, which was presented to her by Megan Thee Stallion
"Tonight's broadcast is dedicated to the ever-growing list of families, friends, survivors, witnesses and responders whose lives continue to forever be changed by gun violence," she said.
"Austin, I still love you!" Shelton raved to the Texas crowd.
The singer confirmed her relationship with the actor in a February episode of the Call Her Daddy podcast.
From Megan Thee Stallion to Shania Twain to Jelly Roll and beyond, stars descended on the red carpet for the event.
