Enriching Extraction with External Data

The data you want to include in your Algolia indices might not be stored on the websites you’re crawling. With Crawler, you can add external data to your records during a crawl. Crawler accepts two external data sources:

• Google Analytics,
• and CSVs.

Adding Google Analytics to your extracted records

You can use Google Analytics to enrich the records you extract from your websites. If you implement search on your crawler indices, you can use the captured analytics data to improve the relevance of your search.

With a little configuration, your crawler can fetch Google Analytics metrics automatically and regularly.

Adding CSV data to your extracted records

You might need to add offline-stored data to your web-content. With Crawler, you can do this by publishing a CSV online and linking it to your crawler.