Johnson, Judd, LeAnn Rimes, Slash, Billy Gibbons, Paul Rodgers, Chuck Leavell and Warren Haynes all came together to honor the late Gary Rossington with a rousing performance.
The song was up for video of the year at this year's ceremony.
Lainey Wilson, Ingrid Andress, Madeline Edwards and Morgan Wade also featured in the performance of the 'Jagged Little Pill' classic.
The performance came as drag queens are being targeted by new bills around the U.S.
The star won his first-ever CMT Music Award earlier in the night.
The veteran pop/rock star and the acclaimed country singer-songwriter brought a faithful version of the 'Tragic Kingdom' classic to life.
The star made her statements while accepting the CMT Equal Play Award, which was presented to her by Megan Thee Stallion
"Tonight's broadcast is dedicated to the ever-growing list of families, friends, survivors, witnesses and responders whose lives continue to forever be changed by gun violence," she said.
"Austin, I still love you!" Shelton raved to the Texas crowd.
The singer confirmed her relationship with the actor in a February episode of the Call Her Daddy podcast.
