Search engine spiders crawl websites and read the content on each page. However, some site designs are too complex for spiders to crawl and correctly index the pages. Some things that can confuse search engine spiders include:
- Flash websites
- Pages built in frames
- Sites that don’t have a sitemap
If you want to know if your site is easily crawled, try out this search engine simulator tool.