Donmai

Image previews not showing up in ATOM feed

Posted under Bugs & Features

This started happening around one week ago. Only the titles will load, the previews won't. If I open the ATOM feed in a text editor, copy the preview links and open them in a browser, they will load just fine. Sometimes I get lucky and 2 out of 100 will show up in the feed reader.

I tried exporting each one of my subscriptions to another feed reader (The Old Reader -> Feedreader) and using proxies, but the problem persists. Feeds from other sites (yande.re and Phoronix) still work. Browsing Danbooru from Firefox is as fast as it's always been.

I think this started happening right after the "Mar 09: New server again, site may experience slowness for next 1-2 days" global message, but I'm not 100% sure.

Same here.

Issue is probably related to referer in the header. Tried loading preview a few of times, once with no referer, once with a danbooru referer, and a couple of times with a various of rss readers. Works for the first two (which is why you can copy/paste and view them) but tack on anything else and I get a 403 Forbidden.

Worse case, you could always note the last id and do a search here of id:>xxxxxxxx

Also experiencing this issue as well.

Thumbnail previews in ATOM feeds return a 403 Forbidden and do not load.

Problem occurs when using online web-based RSS readers (e.g. Feedly, Feedreader Online).
Problem does not occur when using RSS reader applications (e.g. FeedDemon, RSS Bandit).

This is getting frustrating, as I have to open 100 links and check the images one by one, instead of just checking the ones I'm interested in by looking at the thumbnails.

Does this warrant opening an issue in Github or would it be considered off-topic there because of this problem being (most likely) a server related one?

EDIT: Nevermind, someone already did. A quick Google search yields this

These are the requests made by The Old Reader when it loads the Danbooru feeds.

Using wget, it is possible to download previews like this one from both http://hijiribe.donmai.us/ and http://sonohara.donmai.us/ only if the HTTP Referer field is any of the Danbooru subdomains or simply not set in the request headers.

As I already said, downloading the previews and the full-sized images from a web browser works without any issue, but external applications like feed readers will get 403 Forbidden when downloading the previews.

I understand this feature exists to avoid hotlinking but there must be some other way of doing so. The Referer field isn't even an infallible solution and some honest external applications won't work properly because of it, while a malicious application could hotlink any images by simply setting the referer.

1