In this episode of Search Off the Record, Gary Illyes and Lizzi Sassman take a deep dive into crawling the web: what is a web crawler, and how does it really work? Listen along as the Search team is joined by an expert web developer in the SEO community, Dave Smart, for an in-depth and technical discussion of all things crawling, and maybe dispel some myths along the way.
Resources:
Episode transcript → https://goo.gle/sotr070-transcript
Managing your crawl budget → https://goo.gle/3IzRZxl
Dave Smart on LinkedIn → https://goo.gle/3wPSuRA
Tame the Bots → https://goo.gle/4cfCQ1P
Search Central Help Forum → https://goo.gle/sc-forum
Indexing API docs → https://goo.gle/3v8yVU0
Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.
#SOTRpodcast
Speaker: Gary Illyes, Lizzi Sassman
Products Mentioned: Search Off The Record
Popular Podcasts
1. The Podium
The Podium: An NBC Olympic and Paralympic podcast. Join us for insider coverage during the intense competition at the 2024 Paris Olympic and Paralympic Games. In the run-up to the Opening Ceremony, we’ll bring you deep into the stories and events that have you know and those you'll be hard-pressed to forget.
2. Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations.
3. In The Village
In The Village will take you into the most exclusive areas of the 2024 Paris Olympic Games to explore the daily life of athletes, complete with all the funny, mundane and unexpected things you learn off the field of play. Join Elizabeth Beisel as she sits down with Olympians each day in Paris.
© 2024 iHeartMedia, Inc.