Can we exclude all search and find urls similar to /robots.txt