They cost a lot, the nobleman. Make sure that first you have a good income of resources, a good troop count, and a good target.
Also, you want to make sure that the troop count is enough, since your taking another village you most vulnerable for attacks right then.