Donmai

New Pixiv image links?

Posted under Bugs & Features

z905844 said:

Probably not related but it seems pixiv is doing something that prevents thumbnails from being similar searched- or even giving out image contextual menus when right clicked.

evazion said:

Works great, thanks. I packaged this up into a userstyle for easy installation: https://userstyles.org/styles/105904/fix-pixiv-thumbnail-links

I said yesterday they were preventing right click. Wasn't sure how. Figured it was javascript or CSS since I didn't find anything in the html. I Do Not Like People Messing With My Browser Functions.

ElectricSheep said:

Can it happen that the uploader uses different file formats for different pages? I think the API may not cover that case

I just tested it and Pixiv gives you an error during upload if you don't use the same file format for every page in a manga. So it should be safe to assume that every page will have the same file extension.

ZipFile said:

._layout-thumbnail:after {display: none !important;}

evazion said:

Works great, thanks. I packaged this up into a userstyle for easy installation: https://userstyles.org/styles/105904/fix-pixiv-thumbnail-links

Works great, however, now I'm getting the following messages from IQDB and SauceNAO when image searching the small or medium size images on Pixiv:

-IQDB:
"HTTP request failed: 403 Forbidden."
-SauceNao:
"Access to specified file was denied... ;_;"

Am I the only one experiencing this issue?

BrokenEagle98 said:

Works great, however, now I'm getting the following messages from IQDB and SauceNAO when image searching the small or medium size images on Pixiv:

-IQDB:
"HTTP request failed: 403 Forbidden."
-SauceNao:
"Access to specified file was denied... ;_;"

Am I the only one experiencing this issue?

No, I'm getting that too.

I would guess this is because iqdb and saucenao don't set a referer when accessing the small/medium images. Pixiv requires the referer to be set and from within pixiv when accessing images or else it gives a 403.

ElectricSheep said:

Since both iqdb and saucenao support file uploads in addition to URLs it's possible to simply submit the images the browser already has via greasemonkey's cross domain XHR.

Yeah, but if iqdb and saucenao could fake the refer automatically for pixiv it would be easier life! (and save time, server could fetch the image thousands times faster than my upload speed :D)

Toks said:

Hm... well we could still replace new -> old style post sources, only problem is that the post's source will then point to a 404 page. But since Danbooru will direct users who click the source link to the html mode=medium page anyway instead of the 404 image page, that doesn't seem like a huge problem.

For now though we might want to wait a little while in case Pixiv makes more changes soon.

I can have my program automatically turn non-bad_id new-style URLs into fake old-style URLs, if we want. Tested with post #1811614 and post #1811448; fake revision strings (epoch JST like normal revision strings, derived from the URL date) are tacked on because the dates in the URL differs from the upload dates.

Until iqdb and saucenao are fixed the easiest thing to do is just to use the full sized images for reverse image searching instead of the small/medium thumbnails. Since they already fake the referer for the full size.

RaisingK said:

I can have my program automatically turn non-bad_id new-style URLs into fake old-style URLs, if we want. Tested with post #1811614 and post #1811448; fake revision strings (epoch JST like normal revision strings, derived from the URL date) are tacked on because the dates in the URL differs from the upload dates.

I'd really prefer only using real working URLs in the source field and fixing the site such that it can handle them properly. I know I wanted to convert to old URLs at first, but that was only because they were working then. I'd rather not use them now that they don't work. It'd just be really hacky.

I almost have a fix ready so that the artist finder will work with the new URLs. source:pixiv/username searches still don't work, but I think they will be fixable too with the ideas discussed earlier in this thread.

Thanks.

Looks like the permanent switch to the new style happened during (2014-09-30 19:34:52, 2014-09-30 19:35:04] jst, starting with id 46270953. Anyone know what happens if someone revises a work from before this time?

Miene said:

Anyone know how to calculate whether an image is on the i1 or i2 domain?

For the record, that number doesn't actually matter. You can put the wrong domain in and it will still work.

Miene said:

Looks like the permanent switch to the new style happened during (2014-09-30 19:34:52, 2014-09-30 19:35:04] jst, starting with id 46270953. Anyone know what happens if someone revises a work from before this time?

post #1807125: Uploaded 9/8, revised 10/5. Pixiv uses the new-style URLs for both the HTML pages and the API thumbnails, but the old-style URL still works.

Other examples: id:1811312,1811310,1807158,1807135,1807132

evazion said:

I'd really prefer only using real working URLs in the source field and fixing the site such that it can handle them properly. I know I wanted to convert to old URLs at first, but that was only because they were working then. I'd rather not use them now that they don't work. It'd just be really hacky.

I almost have a fix ready so that the artist finder will work with the new URLs. source:pixiv/username searches still don't work, but I think they will be fixable too with the ideas discussed earlier in this thread.

Normalizing to real image URLs simplifies things for me anyway. I will probably end up annoying the users who took the trouble to manually falsify old-style sources...

Updated

RaisingK said:

post #1807125: Uploaded 9/8, revised 10/5. Pixiv uses the new-style URLs for both the HTML pages and the API thumbnails, but the old-style URL still works.

Other examples: id:1811312,1811310,1807158,1807135,1807132

For every Pixiv post uploaded between 09/16 and 09/30 that I've tested, both new-style and old-style URLs work. Before 09/16, only old-style URLs work. So it seems there is a transition period where both types of URLs work, before the switch to only new URLs working on 09/30. When a Pixiv post is revised it seems to be treated like one in the transition period.

I also noticed that for pixiv #46277913 (uploaded on 10/1 00:00; revised at 10/1 00:58 ), the URL for the original unrevised image worked a few days ago but now it doesn't. It looks like original images are only retained for a few days at most.

RaisingK said:

I will probably end up annoying the users who took the trouble to manually falsify old-style sources...

Though I really dislike the new source scheme, it seems that there's nothing I could do but to use with the new ones *sigh*

1 2 3 4 5