Can I automatically hide products when they are out of Stock?

Yes there is an option to do this, remember that it will also show products and publish them once stock is available, so you need to be aware that new products could go up before you are ready.