Skip to content

Instantly share code, notes, and snippets.

@SuleymanAli

SuleymanAli/Screaming Frog CLI.md

Last active April 10, 2025 22:19
Show Gist options
  • Save SuleymanAli/b4f40d4766ce3d931b8363001653e823 to your computer and use it in GitHub Desktop.
Save SuleymanAli/b4f40d4766ce3d931b8363001653e823 to your computer and use it in GitHub Desktop.
Download ZIP
Screaming Frog SEO Spider CLI
Raw
bulk-export_options_list.md

sf --help bulk-export

    • Queued URLs
  • Links
    • Links:All Inlinks
    • Links:All Outlinks
    • Links:All Anchor Text
    • Links:External Links
    • Links:Internal Nofollow Outlinks
    • Links:Internal Outlinks With No Anchor Text
    • Links:Non-Descriptive Anchor Text In Internal Outlinks
    • Links:Follow & Nofollow Internal Inlinks To Page
    • Links:Internal Nofollow Inlinks Only
    • Links:Outlinks To Localhost
  • Web
    • Web:Screenshots
    • Web:All Page Source
    • Web:All PDF Documents
    • Web:All PDF Content
    • Web:All HTTP Request Headers
    • Web:All HTTP Response Headers
    • Web:All Cookies
  • Path Type
    • Path Type:Absolute
    • Path Type:Protocol-Relative
    • Path Type:Root-Relative
    • Path Type:Path-Relative
  • Security
    • Security:HTTP URLs Inlinks
    • Security:HTTPS URLs Inlinks
    • Security:Mixed Content
    • Security:Form URL Insecure
    • Security:Unsafe Cross-Origin Links
    • Security:Protocol-Relative Outlinks
  • Response Codes
    • Response Codes:Internal & External:Blocked by Robots.txt Inlinks
    • Response Codes:Internal & External:Blocked Resource Inlinks
    • Response Codes:Internal & External:No Response Inlinks
    • Response Codes:Internal & External:Success (2xx) Inlinks
    • Response Codes:Internal & External:Redirection (3xx) Inlinks
    • Response Codes:Internal & External:Redirection (JavaScript) Inlinks
    • Response Codes:Internal & External:Redirection (Meta Refresh) Inlinks
    • Response Codes:Internal & External:Client Error (4xx) Inlinks
    • Response Codes:Internal & External:Server Error (5xx) Inlinks
    • Response Codes:Internal:Internal Blocked by Robots.txt Inlinks
    • Response Codes:Internal:Internal Blocked Resource Inlinks
    • Response Codes:Internal:Internal No Response Inlinks
    • Response Codes:Internal:Internal Success (2xx) Inlinks
    • Response Codes:Internal:Internal Redirection (3xx) Inlinks
    • Response Codes:Internal:Internal Redirection (JavaScript) Inlinks
    • Response Codes:Internal:Internal Redirection (Meta Refresh) Inlinks
    • Response Codes:Internal:Internal Redirect Chain Inlinks
    • Response Codes:Internal:Internal Redirect Loop Inlinks
    • Response Codes:Internal:Internal Client Error (4xx) Inlinks
    • Response Codes:Internal:Internal Server Error (5xx) Inlinks
    • Response Codes:External:External Blocked by Robots.txt Inlinks
    • Response Codes:External:External Blocked Resource Inlinks
    • Response Codes:External:External No Response Inlinks
    • Response Codes:External:External Success (2xx) Inlinks
    • Response Codes:External:External Redirection (3xx) Inlinks
    • Response Codes:External:External Redirection (JavaScript) Inlinks
    • Response Codes:External:External Redirection (Meta Refresh) Inlinks
    • Response Codes:External:External Client Error (4xx) Inlinks
    • Response Codes:External:External Server Error (5xx) Inlinks
  • Content
    • Content:Exact Duplicates
    • Content:Near Duplicates
    • Content:Spelling & Grammar Errors
    • Content:Spelling & Grammar Errors Summary
  • Images
    • Images:All Image Inlinks
    • Images:Images Missing Alt Text Inlinks
    • Images:Images Missing Alt Attribute Inlinks
    • Images:Images Missing Alt Attribute & Text Inlinks
    • Images:Images Over X KB Inlinks
    • Images:Images with Alt Text Over X Characters
    • Images:Incorrectly Sized Images
    • Images:Missing Size Attributes
  • Canonicals
    • Canonicals:Contains Canonical Inlinks
    • Canonicals:Self Referencing Inlinks
    • Canonicals:Canonicalised Inlinks
    • Canonicals:Missing Inlinks
    • Canonicals:Multiple Inlinks
    • Canonicals:Multiple Conflicting Inlinks
    • Canonicals:Non-Indexable Canonical Inlinks
    • Canonicals:Canonical Is Relative Inlinks
    • Canonicals:Unlinked Inlinks
    • Canonicals:Outside Inlinks
  • Directives
    • Directives:Index Inlinks
    • Directives:Noindex Inlinks
    • Directives:Follow Inlinks
    • Directives:Nofollow Inlinks
    • Directives:None Inlinks
    • Directives:NoArchive Inlinks
    • Directives:NoSnippet Inlinks
    • Directives:Max-Snippet Inlinks
    • Directives:Max-Image-Preview Inlinks
    • Directives:Max-Video-Preview Inlinks
    • Directives:NoODP Inlinks
    • Directives:NoYDIR Inlinks
    • Directives:NoImageIndex Inlinks
    • Directives:NoTranslate Inlinks
    • Directives:Unavailable_After Inlinks
    • Directives:Refresh Inlinks
    • Directives:Outside Inlinks
  • JavaScript
    • JavaScript:Pages with Blocked Resources
    • JavaScript:Contains JavaScript Links
    • JavaScript:Pages with JavaScript Issues
  • AMP
    • AMP:All Inlinks
    • AMP:Non-200 Response Inlinks
    • AMP:Missing Non-AMP Return Link Inlinks
    • AMP:Missing Canonical to Non-AMP Inlinks
    • AMP:Non-Indexable Canonical Inlinks
    • AMP:Indexable Inlinks
    • AMP:Non-Indexable Inlinks
  • Structured Data
    • Structured Data:Contains Structured Data
    • Structured Data:Validation Errors
    • Structured Data:Validation Warnings
    • Structured Data:JSON-LD URLs
    • Structured Data:Microdata URLs
    • Structured Data:RDFa URLs
  • Sitemaps
    • Sitemaps:URLs in Sitemap Inlinks
    • Sitemaps:Orphan URLs Inlinks
    • Sitemaps:Non-Indexable URLs in Sitemap Inlinks
    • Sitemaps:URLs in Multiple Sitemaps Inlinks
  • Custom Search
    • Custom Search:All Inlinks
    • Custom Search:Filter 1 Inlinks
    • ...
    • Custom Search:Filter 100 Inlinks
  • Custom Extraction
    • Custom Extraction:All Inlinks
    • Custom Extraction:Extractor 1 Inlinks
    • ...
    • Custom Extraction:Extractor 100 Inlinks
  • URL Inspection
    • URL Inspection:Rich Results
    • URL Inspection:Referring Pages
    • URL Inspection:Sitemaps
  • Issues
    • Issues:All
    • Issues:Issue
    • Issues:Warning
    • Issues:Opportunity
Raw
export-custom-summary_options_list.md

sf --help export-custom-summary

  • General
    • Site Crawled
    • Date
    • Time
    • Total URLs Encountered
    • Total URLs Crawled
    • Total Internal blocked by robots.txt
    • Total External blocked by robots.txt
    • URLs Displayed
    • Total Internal URLs
    • Total External URLs
    • Total Internal Indexable URLs
    • Total Internal Non-Indexable URLs
    • Issues Total
    • Issues
    • Warnings
    • Opportunities
  • JavaScript
    • JavaScript:All
    • JavaScript:Uses Old AJAX Crawling Scheme URLs
    • JavaScript:Uses Old AJAX Crawling Scheme Meta Fragment Tag
    • JavaScript:Page Title Only in Rendered HTML
    • JavaScript:Page Title Updated by JavaScript
    • JavaScript:H1 Only in Rendered HTML
    • JavaScript:H1 Updated by JavaScript
    • JavaScript:Meta Description Only in Rendered HTML
    • JavaScript:Meta Description Updated by JavaScript
    • JavaScript:Canonical Only in Rendered HTML
    • JavaScript:Canonical Mismatch
    • JavaScript:Noindex Only in Original HTML
    • JavaScript:Nofollow Only in Original HTML
    • JavaScript:Contains JavaScript Links
    • JavaScript:Contains JavaScript Content
    • JavaScript:Pages with Blocked Resources
    • JavaScript:Pages with JavaScript Errors
    • JavaScript:Pages with JavaScript Warnings
    • JavaScript:Pages with Chrome Issues
  • H1
    • H1:All
    • H1:Missing
    • H1:Duplicate
    • H1:Over X Characters
    • H1:Multiple
    • H1:Alt Text in H1
    • H1:Non-Sequential
  • H2
    • H2:All
    • H2:Missing
    • H2:Duplicate
    • H2:Over X Characters
    • H2:Multiple
    • H2:Non-Sequential
  • Internal
    • Internal:All
    • Internal:HTML
    • Internal:JavaScript
    • Internal:CSS
    • Internal:Images
    • Internal:PDF
    • Internal:Flash
    • Internal:Other
    • Internal:Unknown
  • External
    • External:All
    • External:HTML
    • External:JavaScript
    • External:CSS
    • External:Images
    • External:PDF
    • External:Flash
    • External:Other
    • External:Unknown
  • AMP
    • AMP:All
    • AMP:Non-200 Response
    • AMP:Missing Non-AMP Return Link
    • AMP:Missing Canonical to Non-AMP
    • AMP:Non-Indexable Canonical
    • AMP:Indexable
    • AMP:Non-Indexable
    • AMP:Missing Tag
    • AMP:Missing/Invalid <!doctype html> Tag
    • AMP:Missing Tag
    • AMP:Missing Tag
    • AMP:Missing Canonical
    • AMP:Missing/Invalid Tag
    • AMP:Missing/Invalid Tag
    • AMP:Missing/Invalid AMP Script
    • AMP:Missing/Invalid AMP Boilerplate
    • AMP:Contains Disallowed HTML
    • AMP:Other Validation Errors
  • Canonicals
    • Canonicals:All
    • Canonicals:Contains Canonical
    • Canonicals:Self Referencing
    • Canonicals:Canonicalised
    • Canonicals:Missing
    • Canonicals:Multiple
    • Canonicals:Non-Indexable Canonical
    • Canonicals:Multiple Conflicting
    • Canonicals:Canonical Is Relative
    • Canonicals:Unlinked
    • Canonicals:Outside
  • Content
    • Content:All
    • Content:Spelling Errors
    • Content:Grammar Errors
    • Content:Near Duplicates
    • Content:Exact Duplicates
    • Content:Low Content Pages
    • Content:Readability Difficult
    • Content:Readability Very Difficult
    • Content:Lorem Ipsum Placeholder
    • Content:Soft 404 Pages
  • Custom Extraction
    • Custom Extraction:All
    • Custom Extraction:Extractor 1
    • ...
    • Custom Extraction:Extractor 100
  • Custom Search
    • Custom Search:All
    • Custom Search:Filter 1
    • ...
    • Custom Search:Filter 100
  • Directives
    • Directives:All
    • Directives:Index
    • Directives:Noindex
    • Directives:Follow
    • Directives:Nofollow
    • Directives:None
    • Directives:NoArchive
    • Directives:NoSnippet
    • Directives:Max-Snippet
    • Directives:Max-Image-Preview
    • Directives:Max-Video-Preview
    • Directives:NoODP
    • Directives:NoYDIR
    • Directives:NoImageIndex
    • Directives:NoTranslate
    • Directives:Unavailable_After
    • Directives:Refresh
    • Directives:Outside
  • Analytics
    • Analytics:All
    • Analytics:Sessions Above 0
    • Analytics:Bounce Rate Above 70%
    • Analytics:No GA Data
    • Analytics:Non-Indexable with GA Data
    • Analytics:Orphan URLs
  • Search Console
    • Search Console:All
    • Search Console:Clicks Above 0
    • Search Console:No Search Analytics Data
    • Search Console:Non-Indexable with Search Analytics Data
    • Search Console:Orphan URLs
    • Search Console:URL is Not on Google
    • Search Console:Indexable URL Not Indexed
    • Search Console:URL is on Google But Has Issues
    • Search Console:User-Declared Canonical Not Selected
    • Search Console:Page is Not Mobile Friendly
    • Search Console:AMP URL Invalid
    • Search Console:Rich Result Invalid
  • Hreflang
    • Hreflang:All
    • Hreflang:Contains hreflang
    • Hreflang:Non-200 hreflang URLs
    • Hreflang:Unlinked hreflang URLs
    • Hreflang:Missing Return Links
    • Hreflang:Inconsistent Language & Region Return Links
    • Hreflang:Non-Canonical Return Links
    • Hreflang:Noindex Return Links
    • Hreflang:Incorrect Language & Region Codes
    • Hreflang:Multiple Entries
    • Hreflang:Missing Self Reference
    • Hreflang:Not Using Canonical
    • Hreflang:Missing X-Default
    • Hreflang:Missing
    • Hreflang:Outside
  • Images
    • Images:All
    • Images:Over X KB
    • Images:Missing Alt Text
    • Images:Missing Alt Attribute
    • Images:Alt Text Over X Characters
    • Images:Background Images
    • Images:Incorrectly Sized Images
    • Images:Missing Size Attributes
  • Link Metrics
    • Link Metrics:All
  • Meta Description
    • Meta Description:All
    • Meta Description:Missing
    • Meta Description:Duplicate
    • Meta Description:Over X Characters
    • Meta Description:Below X Characters
    • Meta Description:Over X Pixels
    • Meta Description:Below X Pixels
    • Meta Description:Multiple
    • Meta Description:Outside
  • Meta Keywords
    • Meta Keywords:All
    • Meta Keywords:Missing
    • Meta Keywords:Duplicate
    • Meta Keywords:Multiple
  • PageSpeed
    • PageSpeed:All
    • PageSpeed:Eliminate Render-Blocking Resources
    • PageSpeed:Defer Offscreen Images
    • PageSpeed:Efficiently Encode Images
    • PageSpeed:Properly Size Images
    • PageSpeed:Minify CSS
    • PageSpeed:Minify JavaScript
    • PageSpeed:Reduce Unused CSS
    • PageSpeed:Reduce Unused JavaScript
    • PageSpeed:Serve Images in Next-Gen Formats
    • PageSpeed:Enable Text Compression
    • PageSpeed:Preconnect to Required Origins
    • PageSpeed:Reduce Server Response Times (TTFB)
    • PageSpeed:Avoid Multiple Page Redirects
    • PageSpeed:Preload Key Requests
    • PageSpeed:Use Video Formats for Animated Content
    • PageSpeed:Avoid Excessive DOM Size
    • PageSpeed:Reduce JavaScript Execution Time
    • PageSpeed:Serve Static Assets with an Efficient Cache Policy
    • PageSpeed:Minimize Main-Thread Work
    • PageSpeed:Ensure Text Remains Visible During Webfont Load
    • PageSpeed:Image Elements Do Not Have Explicit Width & Height
    • PageSpeed:Avoid Large Layout Shifts
    • PageSpeed:Avoid Serving Legacy JavaScript to Modern Browsers
    • PageSpeed:Request Errors
  • Pagination
    • Pagination:All
    • Pagination:Contains Pagination
    • Pagination:First Page
    • Pagination:Paginated 2+ Pages
    • Pagination:Pagination URL Not in Anchor Tag
    • Pagination:Non-200 Pagination URLs
    • Pagination:Unlinked Pagination URLs
    • Pagination:Non-Indexable
    • Pagination:Multiple Pagination URLs
    • Pagination:Pagination Loop
    • Pagination:Sequence Error
  • Response Codes
    • Response Codes:All
    • Response Codes:Blocked by Robots.txt
    • Response Codes:Blocked Resource
    • Response Codes:No Response
    • Response Codes:Success (2xx)
    • Response Codes:Redirection (3xx)
    • Response Codes:Redirection (JavaScript)
    • Response Codes:Redirection (Meta Refresh)
    • Response Codes:Client Error (4xx)
    • Response Codes:Server Error (5xx)
    • Response Codes:Internal All
    • Response Codes:Internal Blocked by Robots.txt
    • Response Codes:Internal Blocked Resource
    • Response Codes:Internal No Response
    • Response Codes:Internal Success (2xx)
    • Response Codes:Internal Redirection (3xx)
    • Response Codes:Internal Redirection (JavaScript)
    • Response Codes:Internal Redirection (Meta Refresh)
    • Response Codes:Internal Redirect Chain
    • Response Codes:Internal Redirect Loop
    • Response Codes:Internal Client Error (4xx)
    • Response Codes:Internal Server Error (5xx)
    • Response Codes:External All
    • Response Codes:External Blocked by Robots.txt
    • Response Codes:External Blocked Resource
    • Response Codes:External No Response
    • Response Codes:External Success (2xx)
    • Response Codes:External Redirection (3xx)
    • Response Codes:External Redirection (JavaScript)
    • Response Codes:External Redirection (Meta Refresh)
    • Response Codes:External Client Error (4xx)
    • Response Codes:External Server Error (5xx)
  • Security
    • Security:All
    • Security:HTTP URLs
    • Security:HTTPS URLs
    • Security:Mixed Content
    • Security:Form URL Insecure
    • Security:Form on HTTP URL
    • Security:Unsafe Cross-Origin Links
    • Security:Missing HSTS Header
    • Security:Bad Content Type
    • Security:Missing X-Content-Type-Options Header
    • Security:Missing X-Frame-Options Header
    • Security:Protocol-Relative Resource Links
    • Security:Missing Content-Security-Policy Header
    • Security:Missing Secure Referrer-Policy Header
  • Sitemaps
    • Sitemaps:All
    • Sitemaps:URLs in Sitemap
    • Sitemaps:URLs not in Sitemap
    • Sitemaps:Orphan URLs
    • Sitemaps:Non-Indexable URLs in Sitemap
    • Sitemaps:URLs in Multiple Sitemaps
    • Sitemaps:XML Sitemap with over 50k URLs
    • Sitemaps:XML Sitemap over 50MB
  • Structured Data
    • Structured Data:All
    • Structured Data:Contains Structured Data
    • Structured Data:Missing
    • Structured Data:Validation Errors
    • Structured Data:Validation Warnings
    • Structured Data:Parse Errors
    • Structured Data:Microdata URLs
    • Structured Data:JSON-LD URLs
    • Structured Data:RDFa URLs
  • Page Titles
    • Page Titles:All
    • Page Titles:Missing
    • Page Titles:Duplicate
    • Page Titles:Over X Characters
    • Page Titles:Below X Characters
    • Page Titles:Over X Pixels
    • Page Titles:Below X Pixels
    • Page Titles:Same as H1
    • Page Titles:Multiple
    • Page Titles:Outside
  • URL
    • URL:All
    • URL:Non ASCII Characters
    • URL:Underscores
    • URL:Uppercase
    • URL:Parameters
    • URL:Over X Characters
    • URL:Multiple Slashes
    • URL:Repetitive Path
    • URL:Contains Space
    • URL:Broken Bookmark
    • URL:Internal Search
    • URL:GA Tracking Parameters
  • Links
    • Links:All
    • Links:Pages Without Internal Outlinks
    • Links:Internal Nofollow Outlinks
    • Links:Internal Outlinks With No Anchor Text
    • Links:Non-Descriptive Anchor Text In Internal Outlinks
    • Links:Pages With High External Outlinks
    • Links:Pages With High Internal Outlinks
    • Links:Follow & Nofollow Internal Inlinks To Page
    • Links:Internal Nofollow Inlinks Only
    • Links:Pages With High Crawl Depth
    • Links:Outlinks To Localhost
    • Links:Non-Indexable Page Inlinks Only
  • Validation
    • Validation:All
    • Validation:Invalid HTML Elements in Head
    • Validation: Not First In Element
    • Validation:Missing Tag
    • Validation:Multiple Tags
    • Validation:Missing Tag
    • Validation:Multiple Tags
    • Validation:HTML Document Over 15MB
    • Validation: Element Preceding
  • Depth
    • Depth 1
    • Depth 2
    • Depth 3
    • Depth 4
    • Depth 5
    • Depth 6
    • Depth 7
    • Depth 8
    • Depth 9
    • Depth 10+
  • Top Inlinks
    • Top Inlinks 1 URL
    • Top Inlinks 1 Number of Inlinks
    • Top Inlinks 2 URL
    • Top Inlinks 2 Number of Inlinks
    • Top Inlinks 3 URL
    • Top Inlinks 3 Number of Inlinks
    • Top Inlinks 4 URL
    • Top Inlinks 4 Number of Inlinks
    • Top Inlinks 5 URL
    • Top Inlinks 5 Number of Inlinks
    • Top Inlinks 6 URL
    • Top Inlinks 6 Number of Inlinks
    • Top Inlinks 7 URL
    • Top Inlinks 7 Number of Inlinks
    • Top Inlinks 8 URL
    • Top Inlinks 8 Number of Inlinks
    • Top Inlinks 9 URL
    • Top Inlinks 9 Number of Inlinks
    • Top Inlinks 10 URL
    • Top Inlinks 10 Number of Inlinks
    • Top Inlinks 11 URL
    • Top Inlinks 11 Number of Inlinks
    • Top Inlinks 12 URL
    • Top Inlinks 12 Number of Inlinks
    • Top Inlinks 13 URL
    • Top Inlinks 13 Number of Inlinks
    • Top Inlinks 14 URL
    • Top Inlinks 14 Number of Inlinks
    • Top Inlinks 15 URL
    • Top Inlinks 15 Number of Inlinks
    • Top Inlinks 16 URL
    • Top Inlinks 16 Number of Inlinks
    • Top Inlinks 17 URL
    • Top Inlinks 17 Number of Inlinks
    • Top Inlinks 18 URL
    • Top Inlinks 18 Number of Inlinks
    • Top Inlinks 19 URL
    • Top Inlinks 19 Number of Inlinks
    • Top Inlinks 20 URL
    • Top Inlinks 20 Number of Inlinks
  • Response Times
    • Response Times 0s to 1s
    • Response Times 1s to 2s
    • Response Times 2s to 3s
    • Response Times 3s to 4s
    • Response Times 4s to 5s
    • Response Times 5s to 6s
    • Response Times 6s to 7s
    • Response Times 7s to 8s
    • Response Times 8s to 9s
    • Response Times 10s or more
Raw
export-tabs_options_list.md

Screaming Frog SEO Spider --export-tabs argument values

You can see all values with below command

/Applications/Screaming\ Frog\ SEO\ Spider.app/Contents/MacOS/ScreamingFrogSEOSpiderLauncher --help export-tabs

Full List For --export-tabs:

  • AMP
    • AMP:All
    • AMP:Non-200 Response
    • AMP:Missing Non-AMP Return Link
    • AMP:Missing Canonical to Non-AMP
    • AMP:Non-Indexable Canonical
    • AMP:Indexable
    • AMP:Non-Indexable
    • AMP:Missing Tag
    • AMP:Missing/Invalid <!doctype html> Tag
    • AMP:Missing Tag
    • AMP:Missing Tag
    • AMP:Missing Canonical
    • AMP:Missing/Invalid Tag
    • AMP:Missing/Invalid Tag
    • AMP:Missing/Invalid AMP Script
    • AMP:Missing/Invalid AMP Boilerplate
    • AMP:Contains Disallowed HTML
    • AMP:Other Validation Errors
  • Analytics
    • Analytics:All
    • Analytics:Sessions Above 0
    • Analytics:Bounce Rate Above 70%
    • Analytics:No GA Data
    • Analytics:Non-Indexable with GA Data
    • Analytics:Orphan URLs
  • Canonicals
    • Canonicals:All
    • Canonicals:Contains Canonical
    • Canonicals:Self Referencing
    • Canonicals:Canonicalised
    • Canonicals:Missing
    • Canonicals:Multiple
    • Canonicals:Non-Indexable Canonical
    • Canonicals:Multiple Conflicting
    • Canonicals:Canonical Is Relative
    • Canonicals:Unlinked
    • Canonicals:Outside
  • Change Detection
    • Change Detection:All
    • Change Detection:Word Count
    • Change Detection:Crawl Depth
    • Change Detection:Indexability
    • Change Detection:Page Titles
    • Change Detection:H1
    • Change Detection:Meta Description
    • Change Detection:Inlinks
    • Change Detection:Unique Inlinks
    • Change Detection:Internal Outlinks
    • Change Detection:Unique Internal Outlinks
    • Change Detection:External Outlinks
    • Change Detection:Unique External Outlinks
    • Change Detection:Structured Data Unique Types
    • Change Detection:Content
  • Content
    • Content:All
    • Content:Spelling Errors
    • Content:Grammar Errors
    • Content:Near Duplicates
    • Content:Exact Duplicates
    • Content:Low Content Pages
    • Content:Readability Difficult
    • Content:Readability Very Difficult
    • Content:Lorem Ipsum Placeholder
    • Content:Soft 404 Pages
  • Custom Extraction
    • Custom Extraction:All
    • Custom Extraction:Extractor 1 (values use up to 100)
    • Custom Search:All
    • Custom Search:Filter 1 (values use up to 100)
  • Directives
    • Directives:All
    • Directives:Index
    • Directives:Noindex
    • Directives:Follow
    • Directives:Nofollow
    • Directives:None
    • Directives:NoArchive
    • Directives:NoSnippet
    • Directives:Max-Snippet
    • Directives:Max-Image-Preview
    • Directives:Max-Video-Preview
    • Directives:NoODP
    • Directives:NoYDIR
    • Directives:NoImageIndex
    • Directives:NoTranslate
    • Directives:Unavailable_After
    • Directives:Refresh
    • Directives:Outside
  • External
    • External:All
    • External:HTML
    • External:JavaScript
    • External:CSS
    • External:Images
    • External:PDF
    • External:Flash
    • External:Other
    • External:Unknown
  • H1
    • H1:All
    • H1:Missing
    • H1:Duplicate
    • H1:Over X Characters
    • H1:Multiple
    • H1:Alt Text in H1
    • H1:Non-Sequential
  • H2
    • H2:All
    • H2:Missing
    • H2:Duplicate
    • H2:Over X Characters
    • H2:Multiple
    • H2:Non-Sequential
  • Hreflang
    • Hreflang:All
    • Hreflang:Contains hreflang
    • Hreflang:Non-200 hreflang URLs
    • Hreflang:Unlinked hreflang URLs
    • Hreflang:Missing Return Links
    • Hreflang:Inconsistent Language & Region Return Links
    • Hreflang:Non-Canonical Return Links
    • Hreflang:Noindex Return Links
    • Hreflang:Incorrect Language & Region Codes
    • Hreflang:Multiple Entries
    • Hreflang:Missing Self Reference
    • Hreflang:Not Using Canonical
    • Hreflang:Missing X-Default
    • Hreflang:Missing
    • Hreflang:Outside
  • Images
    • Images:All
    • Images:Over X KB
    • Images:Missing Alt Text
    • Images:Missing Alt Attribute
    • Images:Alt Text Over X Characters
    • Images:Background Images
    • Images:Incorrectly Sized Images
    • Images:Missing Size Attributes
  • Internal
    • Internal:All
    • Internal:HTML
    • Internal:JavaScript
    • Internal:CSS
    • Internal:Images
    • Internal:PDF
    • Internal:Flash
    • Internal:Other
    • Internal:Unknown
  • JavaScript
    • JavaScript:All
    • JavaScript:Uses Old AJAX Crawling Scheme URLs
    • JavaScript:Uses Old AJAX Crawling Scheme Meta Fragment Tag
    • JavaScript:Page Title Only in Rendered HTML
    • JavaScript:Page Title Updated by JavaScript
    • JavaScript:H1 Only in Rendered HTML
    • JavaScript:H1 Updated by JavaScript
    • JavaScript:Meta Description Only in Rendered HTML
    • JavaScript:Meta Description Updated by JavaScript
    • JavaScript:Canonical Only in Rendered HTML
    • JavaScript:Canonical Mismatch
    • JavaScript:Noindex Only in Original HTML
    • JavaScript:Nofollow Only in Original HTML
    • JavaScript:Contains JavaScript Links
    • JavaScript:Contains JavaScript Content
    • JavaScript:Pages with Blocked Resources
    • JavaScript:Pages with JavaScript Errors
    • JavaScript:Pages with JavaScript Warnings
    • JavaScript:Pages with Chrome Issues
  • Link Metrics
    • Link Metrics:All
  • Links
    • Links:All
    • Links:Pages Without Internal Outlinks
    • Links:Internal Nofollow Outlinks
    • Links:Internal Outlinks With No Anchor Text
    • Links:Non-Descriptive Anchor Text In Internal Outlinks
    • Links:Pages With High External Outlinks
    • Links:Pages With High Internal Outlinks
    • Links:Follow & Nofollow Internal Inlinks To Page
    • Links:Internal Nofollow Inlinks Only
    • Links:Pages With High Crawl Depth
    • Links:Outlinks To Localhost
    • Links:Non-Indexable Page Inlinks Only
  • Meta Description
    • Meta Description:All
    • Meta Description:Missing
    • Meta Description:Duplicate
    • Meta Description:Over X Characters
    • Meta Description:Below X Characters
    • Meta Description:Over X Pixels
    • Meta Description:Below X Pixels
    • Meta Description:Multiple
    • Meta Description:Outside
  • Meta Keywords
    • Meta Keywords:All
    • Meta Keywords:Missing
    • Meta Keywords:Duplicate
    • Meta Keywords:Multiple
  • Page Titles
    • Page Titles:All
    • Page Titles:Missing
    • Page Titles:Duplicate
    • Page Titles:Over X Characters
    • Page Titles:Below X Characters
    • Page Titles:Over X Pixels
    • Page Titles:Below X Pixels
    • Page Titles:Same as H1
    • Page Titles:Multiple
    • Page Titles:Outside
  • PageSpeed
    • PageSpeed:All
    • PageSpeed:Eliminate Render-Blocking Resources
    • PageSpeed:Defer Offscreen Images
    • PageSpeed:Efficiently Encode Images
    • PageSpeed:Properly Size Images
    • PageSpeed:Minify CSS
    • PageSpeed:Minify JavaScript
    • PageSpeed:Reduce Unused CSS
    • PageSpeed:Reduce Unused JavaScript
    • PageSpeed:Serve Images in Next-Gen Formats
    • PageSpeed:Enable Text Compression
    • PageSpeed:Preconnect to Required Origins
    • PageSpeed:Reduce Server Response Times (TTFB)
    • PageSpeed:Avoid Multiple Page Redirects
    • PageSpeed:Preload Key Requests
    • PageSpeed:Use Video Formats for Animated Content
    • PageSpeed:Avoid Excessive DOM Size
    • PageSpeed:Reduce JavaScript Execution Time
    • PageSpeed:Serve Static Assets with an Efficient Cache Policy
    • PageSpeed:Minimize Main-Thread Work
    • PageSpeed:Ensure Text Remains Visible During Webfont Load
    • PageSpeed:Image Elements Do Not Have Explicit Width & Height
    • PageSpeed:Avoid Large Layout Shifts
    • PageSpeed:Avoid Serving Legacy JavaScript to Modern Browsers
    • PageSpeed:Request Errors
  • Pagination
    • Pagination:All
    • Pagination:Contains Pagination
    • Pagination:First Page
    • Pagination:Paginated 2+ Pages
    • Pagination:Pagination URL Not in Anchor Tag
    • Pagination:Non-200 Pagination URLs
    • Pagination:Unlinked Pagination URLs
    • Pagination:Non-Indexable
    • Pagination:Multiple Pagination URLs
    • Pagination:Pagination Loop
    • Pagination:Sequence Error
  • Response Codes
    • Response Codes:All
    • Response Codes:Blocked by Robots.txt
    • Response Codes:Blocked Resource
    • Response Codes:No Response
    • Response Codes:Success (2xx)
    • Response Codes:Redirection (3xx)
    • Response Codes:Redirection (JavaScript)
    • Response Codes:Redirection (Meta Refresh)
    • Response Codes:Client Error (4xx)
    • Response Codes:Server Error (5xx)
    • Response Codes:Internal All
    • Response Codes:Internal Blocked by Robots.txt
    • Response Codes:Internal Blocked Resource
    • Response Codes:Internal No Response
    • Response Codes:Internal Success (2xx)
    • Response Codes:Internal Redirection (3xx)
    • Response Codes:Internal Redirection (JavaScript)
    • Response Codes:Internal Redirection (Meta Refresh)
    • Response Codes:Internal Redirect Chain
    • Response Codes:Internal Redirect Loop
    • Response Codes:Internal Client Error (4xx)
    • Response Codes:Internal Server Error (5xx)
    • Response Codes:External All
    • Response Codes:External Blocked by Robots.txt
    • Response Codes:External Blocked Resource
    • Response Codes:External No Response
    • Response Codes:External Success (2xx)
    • Response Codes:External Redirection (3xx)
    • Response Codes:External Redirection (JavaScript)
    • Response Codes:External Redirection (Meta Refresh)
    • Response Codes:External Client Error (4xx)
    • Response Codes:External Server Error (5xx)
  • Search Console
    • Search Console:All
    • Search Console:Clicks Above 0
    • Search Console:No Search Analytics Data
    • Search Console:Non-Indexable with Search Analytics Data
    • Search Console:Orphan URLs
    • Search Console:URL is Not on Google
    • Search Console:Indexable URL Not Indexed
    • Search Console:URL is on Google But Has Issues
    • Search Console:User-Declared Canonical Not Selected
    • Search Console:Page is Not Mobile Friendly
    • Search Console:AMP URL Invalid
    • Search Console:Rich Result Invalid
  • Security
    • Security:All
    • Security:HTTP URLs
    • Security:HTTPS URLs
    • Security:Mixed Content
    • Security:Form URL Insecure
    • Security:Form on HTTP URL
    • Security:Unsafe Cross-Origin Links
    • Security:Missing HSTS Header
    • Security:Bad Content Type
    • Security:Missing X-Content-Type-Options Header
    • Security:Missing X-Frame-Options Header
    • Security:Protocol-Relative Resource Links
    • Security:Missing Content-Security-Policy Header
    • Security:Missing Secure Referrer-Policy Header
  • Sitemaps
    • Sitemaps:All
    • Sitemaps:URLs in Sitemap
    • Sitemaps:URLs not in Sitemap
    • Sitemaps:Orphan URLs
    • Sitemaps:Non-Indexable URLs in Sitemap
    • Sitemaps:URLs in Multiple Sitemaps
    • Sitemaps:XML Sitemap with over 50k URLs
    • Sitemaps:XML Sitemap over 50MB
  • Structured Data
    • Structured Data:All
    • Structured Data:Contains Structured Data
    • Structured Data:Missing
    • Structured Data:Validation Errors
    • Structured Data:Validation Warnings
    • Structured Data:Parse Errors
    • Structured Data:Microdata URLs
    • Structured Data:JSON-LD URLs
    • Structured Data:RDFa URLs
    • UNDEF:Unknown
  • URL
    • URL:All
    • URL:Non ASCII Characters
    • URL:Underscores
    • URL:Uppercase
    • URL:Parameters
    • URL:Over X Characters
    • URL:Multiple Slashes
    • URL:Repetitive Path
    • URL:Contains Space
    • URL:Broken Bookmark
    • URL:Internal Search
    • URL:GA Tracking Parameters
  • Validation
    • Validation:All
    • Validation:Invalid HTML Elements in Head
    • Validation: Not First In Element
    • Validation:Missing Tag
    • Validation:Multiple Tags
    • Validation:Missing Tag
    • Validation:Multiple Tags
    • Validation:HTML Document Over 15MB
    • Validation: Element Preceding
Raw
save-reports_options_list.md

sf --help save-reports

  • Crawl Overview
  • Issues Overview
  • Redirects:All Redirects
  • Redirects:Redirect Chains
  • Redirects:Redirect & Canonical Chains
  • Canonicals:Canonical Chains
  • Canonicals:Non-Indexable Canonicals
  • Pagination:Non-200 Pagination URLs
  • Pagination:Unlinked Pagination URLs
  • Hreflang:All hreflang URLs
  • Hreflang:Non-200 hreflang URLs
  • Hreflang:Unlinked hreflang URLs
  • Hreflang:Missing Return Links
  • Hreflang:Inconsistent Language & Region Return Links
  • Hreflang:Non Canonical Return Links
  • Hreflang:Noindex Return Links
  • Insecure Content
  • SERP Summary
  • Orphan Pages
  • Structured Data:Validation Errors & Warnings Summary
  • Structured Data:Validation Errors & Warnings
  • Structured Data:Google Rich Results Features Summary
  • Structured Data:Google Rich Results Features
  • Javascript:Javascript Console Log Summary
  • PageSpeed:PageSpeed Opportunities Summary
  • PageSpeed:CSS Coverage Summary
  • PageSpeed:JavaScript Coverage Summary
  • PageSpeed:Eliminate Render-Blocking Resources
  • PageSpeed:Properly Size Images
  • PageSpeed:Defer Offscreen Images
  • PageSpeed:Minify CSS
  • PageSpeed:Minify JavaScript
  • PageSpeed:Reduce Unused CSS
  • PageSpeed:Reduce Unused JavaScript
  • PageSpeed:Efficiently Encode Images
  • PageSpeed:Serve Images in Next-Gen Formats
  • PageSpeed:Enable Text Compression
  • PageSpeed:Preload Key Requests
  • PageSpeed:Use Video Formats for Animated Content
  • PageSpeed:Avoid Serving Legacy JavaScript to Modern Browsers
  • PageSpeed:Avoid Excessive DOM Size
  • PageSpeed:Reduce JavaScript Execution Time
  • PageSpeed:Serve Static Assets with an Efficient Cache Policy
  • PageSpeed:Minimize Main-Thread Work
  • PageSpeed:Ensure Text Remains Visible During Webfont Load
  • PageSpeed:Avoid Large Layout Shifts
  • PageSpeed:Image Elements Do Not Have Explicit Width & Height
  • HTTP Headers:HTTP Header Summary
  • Cookies:Cookie Summary
Raw
Screaming Frog CLI.md 
/Applications/Screaming\ Frog\ SEO\ Spider.app/Contents/MacOS/ScreamingFrogSEOSpiderLauncher --headless \ 
--crawl https://example.com \
--save-report "Crawl Overview" \
--output-folder "$HOME/Desktop/"

Read Full Article

Screaming Frog CLI

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment