Donmai

Batch download a tag set

Posted under General

seish said:
Sorry to bump, but for about a week or two now oreno imouto doesn't seem to be downloading more than 100 images at a time. Also, the login does work for danbooru, but not for oreno.
More than 100 images download at a time for danbooru.
Perhaps there's an updated script beyond 1.2?
I've also modified list.pm to reflect the changes.

moeimouto=>sub{
use Booru::Dan;
Booru::Dan->new(
"http://oreno.imouto.org",
);
},
any ideas?

not work

Updated

psks said:
not work

What command are you using, as it seems to keep downloading pictures fine on the version I am using? Could you also throw a zip of the version you are using up on mediafire or otherwise so that I can compare the version you have to the one I am working off?

Seems like version 1.2 of this script isn't working when you use the -s option. Here is what I'm running:

booru.pl danbooru large_breasts -s 928184 -u username -w password

The output I get is as follows:

C:\danbooru>danbooru.bat
Logging in... ok! logged in as username
Can't use string ("Couln't GET http://danbooru.donm"...) as a HASH ref while "strict refs" in use at C:\danbooru\booru.pl line 95.

No idea what's going on...

For some reasons I can't download with 2 tags anymore. My command line is this:

perl booru.pl danbooru megurine_luka hatsune_miku -p="D:\LukaMiku" -u=Saluki -w=mypassword

Then the program just grab all megurine_luka posts, regardless of hatsune_miku tag . I don't use this program too often so I'm not sure when this problem started, but I used to be able to download 2-tag set several months ago. Could someone help me too see what's wrong?

http://pastebin.com/KyUgpTWi

This is looking really promising and actually has downloaded stuff for me, but it has no instructions. I'll try to see how this works.

Another perl program.

EDIT: this is the way i've been using it so far to make it "work". Of course don't type it with the <> characters.

perl booru.pl -u <username> -p <password> -d "<Directory to save>"

At the end of this you can use --pool <number of pool> to download a pool of images. Haven't figured out how to get it to use tags yet, but if someone finds out please let us all know.

Edit: it does work, you just have to let it load. One thing I've noticed is that it doesn't take into account duplicates and will redownload the files. it also can't (can it?) work with tags like user:granola or rating:e.

Updated

I'm using Granola's method to download images and I'm trying to use the "-s=" function but it isn't working. Is there a way to skip images with certain tags? For example, I want to download everything tagged aoki_reika and skip everything tagged 5girls, even if it has the aoki_reika tag.

I'm using danbooru downloader 3 to download images from yande.re, but there's something wrong with the result. The downloaded file can't be read, and the size is somehow wrong (only 33kb, even tough it should have been more). And it's not only happened to 1 image, but a lot of it. The tag i used to download was sonico, and the first 20 images i tried ends up failed. Anyone can help me?

Sorry if I'm necrobumping, but I have DirectGel & Danbooru Batch Downloader 1 UserScrpits. I want to download entire tags also but the problem with those is when I do, ALL file types (GIF, PNG, Possibly Animated PNG) & Flash (Which Comes up as Undefined) show up as jpg format, except flash for the reason I mentioned. Just what am I doing wrong? Oh, and I was using both User Scripts at the same time.

Well, not a single command-line downloader works after update to Danbooru 2. The closest I've come to working is DD v1.2 giving 404 when trying to POST to /user/authenticate and this one - http://pastebin.com/KyUgpTWi - giving an internal server error. I'm not interested in GUI downloaders, and I don't know of any other place to ask. So, are there any working CL downloaders out there? Or, if not, how do I fix 1.2's error? I suspect that it has to POST to a different location (I'm a complete noob at this), but I don't know which one, and I can't find any information on the subject. Thanks in advance.

Updated

Okay, after dumping an entirely unreasonable amount of time into this (a process that involved literally learning Perl from scratch) I managed to scrape together a workable script: http://pastebin.com/jgxMRTRH

Granted, it's not much modified (only around ten lines changed), but this involved a lot of painful trial and no less painful error. Also, now it is possible to download into directories with spaces in the path and the script doesn't overwrite duplicates. Yay.

The only observed bug is the corruption of images resulting from manual closure of script that hasn't finished running. No idea how to fix, so don't close the script manually.

Updated

I don't understand what you mean about favorites. This script is only supposed to work with tags and pools.

Fixed a glaring bug that I have no idea how I overlooked that caused all tags to be hardcapped at 200 images and added a blacklist that automatically causes all files containing certain tags to be skipped, and this doesn't even take up the two-tag free account limit! Also, I prettified the framework, so now it is very easy to sort posts based on literally any relevant parameter - name of the uploader, date, rating, status, anything.

1 4 5 6 7 8 9