"...the party has either to come back from where we are right now, which is a very dangerous and toxic place, or the party will splinter and there will be a new conservative party that rises..."