Player have gather followers in order to fight the enemy attackers. They also gathered their own followers and once they have enough army they will try to kill you. So you have gather your own and kill other enemies to retain in power.