If you do not need WooCommerce, then you can just deactivate the plugin and the cart icon will not appear.
If you do need woocommerce, I would not recommend you keep the cart icon in shop pages at least. You can hide them in specific page (if it not something related to shopping) by using the custom CSS in theme options –