Doesn't matter if you didn't set an upkeep. It automatically takes out $10 every day, and when the town has no funds in its bank it will removed when taxes are collected. Everything that was owned by the town will be slowly reverted to what it looked like before it was claimed.

Edit: Dom beat me to it. :P