You can enable our Inventory Control setting for the product, and then for the "Limit product sales to" figure, you can either specify an in-stock quantity to prevent selling more than that many units online, or just enter 0 to make that product immediately unavailable for sale without having to delete the product nor remove its buttons from your site.