You can just attack it.
On World 4 when a Tribe had an Army camp, they sent 6 LC at it when it was made and it was destroyed so I don't think you need the foes to send troops before you can attack, I believe it's like any normal village (in this case) where there are no rules on how you can attack it