How can I delete a Site?

Yes, you can. There is an option to delete a wiki inside the Site Manager under "Extreme actions". Moreover for every site deletion there is an undo — you can easily restore previously deleted wiki.

Only a person who originally created the wiki (the founder) can delete it.