.Google's Gary Illyes discloses Googlebot picks up web links rather than "observing" them, opposing formal paperwork.Googlebot collects hyperlinks rather than following all of them in real-time.Gary Illyes discussed this details in Google's 'Explore Off The Record' podcast.Google.com's records contradicts the real crawler habits.