The Screaming Frog SEO Spider is a fast and advanced SEO site audit tool. Compare site structure, detect changes in key elements and metrics and use URL mapping to compare staging against production sites. Crawl Comparison – Compare crawl data to see changes in issues and opportunities to track technical SEO progress.Spelling & Grammar – Spell & grammar check your website in over 25 different languages.Structured Data & Validation – Extract & validate structured data against specifications and Google search features.Visualisations – Analyse the internal linking and URL structure of the website, using the crawl and directory tree force-directed diagrams and tree graphs.XML Sitemap Analysis – Crawl an XML Sitemap independently or part of a crawl, to find missing, non-indexable and orphan pages.AMP Crawling & Validation – Crawl AMP URLs and validate them, using the official integrated AMP Validator.Store & View HTML & Rendered HTML – Essential for analysing the DOM.Rendered Screen Shots – Fetch, view and analyse the rendered pages crawled.Custom robots.txt – Download, edit and test a site’s robots.txt using the new custom robots.txt.XML Sitemap Generation – Create an XML sitemap and an image sitemap using the SEO spider.External Link Metrics – Pull external link metrics from Majestic, Ahrefs and Moz APIs into a crawl to perform content audits or profile links.PageSpeed Insights Integration – Connect to the PSI API for Lighthouse metrics, speed opportunities, diagnostics and Chrome User Experience Report (CrUX) data at scale.Google Search Console Integration – Connect to the Google Search Analytics API and collect impression, click and average position data against URLs.
![pull links from website octoparse pull links from website octoparse](https://www.octoparse.com/media/1659/link-extractor-3.png)
Google Analytics Integration – Connect to the Google Analytics API and pull in user and conversion data directly during a crawl.Custom Extraction – Scrape any data from the HTML of a URL using XPath, CSS Path selectors or regex.
PULL LINKS FROM WEBSITE OCTOPARSE CODE
![pull links from website octoparse pull links from website octoparse](http://shamrockroseaussies.com/yahoo_site_admin/assets/images/DSC_0756.10500148_std.jpg)
Response Time – View how long pages take to respond to requests.Meta Keywords – Mainly for reference or regional search engines, as they are not used by Google, Bing or Yahoo.Meta Description – Missing, duplicate, long, short or multiple descriptions.Page Titles – Missing, duplicate, long, short or multiple title elements.Duplicate Pages – Discover exact and near duplicate pages using advanced algorithmic checks.
![pull links from website octoparse pull links from website octoparse](https://www.octoparse.com/media/1219/a.png)