Kaupr operates an identifiable, well-behaved crawler that reads publicly available product data from online stores. We use this data to build a competitive intelligence platform — helping DTC brands understand who they actually compete with, track price moves, and get alerted when their market shifts.
If you arrived here because you saw the Kaupr User-Agent in your server logs, this page tells you who we are, what we’re doing, and how to control it.
Kaupr/1.0 product indexer (+https://kaupr.com/about/crawler)We fetch publicly available product information. On Shopify stores we read the /products.json endpoint that Shopify exposes by default — the same endpoint Google, Bing, and price comparison services have indexed for years. We do not access:
robots.txtrobots.txt. If you disallow our User-Agent or /products.json, we stop.429 or 503 responses.Add this to your robots.txt:
User-agent: Kaupr Disallow: /
Our crawler will pick up the change within 24 hours and stop.
If your products are already in our index and you want them removed, submit a request at kaupr.com/merchants/removal. We acknowledge within 48 hours and complete removal within 7 days, and add your domain to our blocklist so we will not re-index in future.
DTC brands make their own products. The competitive intelligence tools that exist were built for retailers selling identical SKUs — they match barcodes, not semantics. Kaupr builds a semantic index of what every store sells so brands can find their real competitors automatically, track price moves, and get a Monday brief denominated in the revenue at stake.
The data we crawl is public. We surface it in a form that’s useful to brand owners, not consumers. If you’d like to discuss data licensing or partnership, email hello@kaupr.com.
Questions, removal requests, or press inquiries — hello@kaupr.com. We respond.