Yes. Every crawl follows the site’s rules unless you own the domain.