Tools
/
Crawler
/
ignoreQueryParams
Jan. 08, 2021
ignoreQueryParams
Type:
string[]
Parameter syntax
ignoreQueryParams: [ 'param', 'param2', ... ]
About this parameter
Filters out specified query parameters from crawled URLs. This can help you avoid indexing duplicate URLs.
Examples
In this example, the ref and _utm parameters are ignored in crawled URLs. Your crawler saves http://localhost?page=1&ref=algolia as http://localhost?page=1.
Copy
1
2
3
{
ignoreQueryParams: ['ref', '_utm'],
}
