If he does do it, the country will collapse in disorder. The fascists will run amok.
They may do that anyway. If Brexit goes ahead but we end up leaving on terms which requires free movement of people then the "facists" will think they have been betrayed and may run amok.
Then again if they get what they want from Brexit then they may feel emboldened and take to the streets to take more of their country back from the brown people