When Steve Harvey accidentally called the wrong name at the 2015 Miss Universe pageant (Miss Columbia instead of Miss Philippines), he received a lot of backlash on social media. But apparently that was child’s play compared to what happened in reality.

The Family Feud host told Cigar Aficionado that he and his family had to get 24-hour security, and still do! Due to the mishap, he received countless amounts of death threats so serious it prompted him to take action.

“I have two armed guards [at his house] full-time to this day,” he said. The comedian also spoke out about quitting standup, his passion. “It was crazy to walk away from something that meant so much to me. Nothing can ever come close to what it feels like when you’re on stage and it’s 12,000 people and it’s you and a spotlight, a bar stool, a glass of water and a microphone. There’s nothing like that.”