The Kitchen Table
Syncing 6M+ Products with Shopify (Exclusive Books Case Study)
When a catalogue gets large enough, a naive Shopify GraphQL integration is the difference between stock that is accurate and stock that is days out of date. That was the challenge with Exclusive Books, one of South Africa's leading book retailers, syncing 6M+ products across 40+ stores.
The problem
The existing integration used Shopify's representational state transfer (REST) application programming interface (API) to update products one at a time. At this scale, that approach hit rate limits constantly and took weeks to complete a full sync. By the time it finished, the data was already stale. It had also been left in a broken state by a previous developer, so it was a rescue as much as a rebuild.
What we did
- Moved from REST to Shopify GraphQL with bulk operations, so updates happen in large batches instead of one call per product.
- Built real-time sync using Google Pub/Sub and Maxwell Daemon to stream database changes as they happen, rather than re-syncing everything.
- Automated the operational work, voucher creation, product imports, and pickup-point management across 40+ stores.
The result
Stock sync dropped from weeks to hours. Customers and staff finally had accurate inventory visibility across millions of products, and the constant rate-limit firefighting stopped.
The lesson for Shopify at scale
If you are running a large catalogue, the integration pattern matters more than the platform. REST is fine for small stores; at scale, GraphQL bulk operations and event-driven, real-time sync are what keep data fresh without hammering the API. Get that architecture right and Shopify handles serious volume comfortably.
Running a large or complex store?
We build and rescue Shopify integrations and custom commerce platforms. If your store is fighting its own data, see our e-commerce and marketplace service or read more about the Exclusive Books integration.
Free download: The E-commerce Build Readiness Checklist
Everything to sort out before you build or rebuild an online store or marketplace. Add your name, business, and email and we'll send it over, no obligation, no spam.
