Google supports different techniques that permits you to decide outside of crawling and indexing of your respective URLs. If you have to block some files, directories, or even your total web site from Google Search, look at our manual about strategies to prevent content from showing up in search effects. https://www.youtube.com/c/VenturaIT