Naus is quite right. Neighbours can only grow as quickly as you allow them to. There are 2 ways to stunt their growth, one is to attack them, but that also stunts your growth especially if you have several villages to deal with and the introduction of Militia.
In my area I also had a lot of competition, I would farm and never get hauls more than 30/30/30. So with the help of the simulator i worked out that 2 spear can travel with 2 sword and you have no losses, no walls this early in the game. So I sent out exactly that to every barb in my 15x15. Sure i can only get hauls up to 80 but i was hardly getting more than that anyway. I made more sword and spear and started sending to all barbs every half an hour, so that for others farming they were getting hauls no better than 20/20/20. No wonder why I got the 100 plunders award way before anybody else got near. This caused many of them to restart and most of the others to give up farming. This allowed me to outgrow all my neighbours, then make lc and do the same, then noble a barb. 2 in fact, for which i received many flames, but by the time you were catted i had 8000 defensive troops of my own to call upon.
I saw the reports of the cats against you, the first attack consisted of 1000 axe and 500 lc and completely cleared all your defence (about 300 in total), the remaining attacks were considerably smaller but met no troops in your village so it was a sitting duck. At about the same time, an ex tutor member, Draztic sent me an attack of 1000 axe and 500 lc plus rams and did not even dent my level 18 wall, because I had made it a priority to be able to withstand such an attack. In order to have withstood that I nobled 2 barbs to produce troops.
This is what naus means by 'thinking outside the box'
Could you imagine Alex Ferguson fielding a team of strikers with no thought to the fact that at least occassionally they might need to defend? no of course not he would not have a job for long if he did.