.Google's Gary Illyes exposes Googlebot picks up web links rather than "observing" all of them, opposing main documents.Googlebot gathers links instead of observing all of them in real-time.Gary Illyes discussed this info in Google.com's 'Search Off The Record' podcast.Google's documentation opposes the genuine spider actions.