There is no way to hide the button. You can easily remove access from the Media Center Extender user accounts.
They are mcx-* accounts. When I used Extenders I would create a user group for extenders and change the ACLs for my media to be read-only for that group. I would explicitly add a Deny ACL for Delete to prevent inherited ACLs from allowing it.