"When they start ripping the clothes off me, it gets a little bit on top," the former One Direction star explains.