The Others/Hostiles whatever you call Ben's people are not in constant war with the survivors. They were content to leave them alone, until they crossed the line. Who have they actually killed? I believe Ben when he said they are the good guys. They are fighting the freighties, and the survivors have gotten caught up in that. I think the survivors could stay on the island and not be bothered.