New Reindexing Process Migration
We’ve completely revamped our reindexing process, bringing significant performance improvements and increased reliability.
In some cases, performance improved with 90%. For example, on a store with 10,000 products with meta-fields and the Collection Pages feature enabled, the original indexing process took 3 hours, 30 minutes and 37 seconds while the revamped process takes 22 minutes and 40 seconds.
This new process only works for products and collections. We’re gradually rolling it out to everyone. If you’d like to get early access, please contact us at support@algolia.com.
How does it work?
This new process relies on Shopify’s BulkOperation API. We first request Shopify for all the relevant data on the store and once it becomes available to use, we read the bulk file line by line, indexing the relevant attributes within your Algolia index.
Changes
As we transition to this new process, there are a few changes to keep in mind.
Parallel reindexing
As a way of rate limiting, Shopify only allows one bulk operation to be run per shop. This means you can only run one reindexing process at the time, and you can’t trigger a parallel reindex with another reindex already in progress.
Attributes indexed
Since the BulkOperation API works on GraphQL, there are certain attributes that we can’t index anymore:
option1option2option3
These attributes won’t be available in your records after you’ve run a reindexing process.
These fields correspond to options set on a variant. Variant option information can still be accessed via the options attribute.
Notifications
We’ll send you an email on the email address associated with your Algolia and Shopify account to inform you when your store has access to this new feature.
