In the beginning, site owners submitted the handle of the website page, or URL to the various search engines like google and yahoo, which would mail an internet crawler to crawl that web page, extract links to other web pages from it, and return info uncovered within the site to https://www.youtube.com/watch?v=V7lEomNLUOE&t=8s