The Settlers are shown to violently resist even their own government. They would continuously agitate trouble and unrest, and this would result in regular IDF interventions into Palestine to protect them and their interests. This would render any border meaningless, WHICH IS THEIR GOAL.
UN: Gaza could be 'uninhabitable' by 2020 if trends continue (AP)
from the article: Will Yair Lapid divide Jerusalem?