ThriftTickBot
About ThriftTickBot
ThriftTickBot is the crawler of the ThriftTick app. It identifies itself as ThriftTickBot/1.0 (+https://thrifttick.com/bot).
English
What it does
Once a night, starting around 03:00 Central European time, ThriftTickBot reads the public product listings of the Slovenian online stores shown in the app's Akcije (deals) screen: product name, price, regular price, availability, category and image link. The app uses them to show which products are really cheaper than before and links every deal back to the store's own product page. The bot reads no personal data, signs in to no account and never adds anything to a cart.
How it behaves
- One request at a time, with a pause between requests.
- Before each night's crawl it reads the store's robots.txt and skips the store if the pages it needs are disallowed for ThriftTickBot or for all bots.
- It stops the night's crawl at the first refusal (HTTP 401, 403, 405 or 451, or a redirect to a bot check) and does not try to get around it.
- It backs off on 429 and server errors, and respects Retry-After.
How to opt out or ask us to slow down
Add these lines to your robots.txt and the next night's crawl of your store will not run:
User-agent: ThriftTickBot
Disallow: /
If you would rather send a product feed, prefer a different time or rate, or have any other question, contact us through the contact given in our privacy policy.
Slovenščina
Kaj počne
ThriftTickBot je pajek aplikacije ThriftTick. Enkrat na noč, približno ob 3.00 po srednjeevropskem času, prebere javne sezname izdelkov slovenskih spletnih trgovin, ki so prikazane na zaslonu Akcije: ime izdelka, ceno, redno ceno, zalogo, kategorijo in povezavo do slike. Aplikacija iz njih pokaže, kateri izdelki so res cenejši kot prej, in vsako akcijo poveže na stran izdelka v trgovini. Pajek ne bere osebnih podatkov, se ne prijavlja v račune in ničesar ne dodaja v košarico.
Kako se obnaša
- Pošilja eno zahtevo naenkrat, s premorom med zahtevami.
- Pred vsakim nočnim branjem prebere robots.txt trgovine in trgovino izpusti, če so strani, ki jih potrebuje, prepovedane za ThriftTickBot ali za vse pajke.
- Branje tisto noč ustavi ob prvi zavrnitvi (HTTP 401, 403, 405 ali 451 ali preusmeritev na preverjanje pajkov) in je ne poskuša obiti.
- Pri odgovoru 429 in napakah strežnika počaka in upošteva Retry-After.
Kako ga izključite ali upočasnite
V robots.txt dodajte spodnji vrstici in naslednje noči vaše trgovine ne bo več bral:
User-agent: ThriftTickBot
Disallow: /
Če bi nam raje poslali vir izdelkov, želite drug čas ali hitrost branja ali imate drugo vprašanje, nam pišite prek kontakta v pravilniku o zasebnosti.