Donmai

Mass uploading animal_ears images

Posted under General

This topic has been locked.

Hello everyone!

I wondered if there was any easy way of uploading quite a few images in an automated/semi-automated manner? I have the Firefox Danbooru uploader plug-in, it's nice, but it's limited, and tedious to use for numerous images. Furthermore, it is a bit tricky to upload from my computer instead of a website.

The point is, I managed to collect over 200 megabytes (maybe 1600+) of catgirl/doggirl/etc. quality artwork (work-safe and hentai too), and I gladly upload it to Danbooru, but I can't afford sitting here all the day uploading image after image, day after day.

That's why I ask you, is there a viable method for such uploading? I know that I may upload no more than 16 images a day, and they must wait the moderation. It would be easier with some kind of tool.

I know that tagging is essential here, but a shortcoming of my collection that they are not sorted in any way. (Because I keep them in one directory, with every file using it's CRC32 hash as filename, to avoid duplicates. However, there are still some dupes.) So tagging besides animal_ears would be a bit problematic, although most of them are cat_ears. Also, some images may be tagged as loli. The images are mostly original, but there are The Melancholy Of Haruhi Suzumiya, Lucky Star and such art. Some files are high-res, some are oekaki drawings or monochrome sketches. Wallpapers and scans also occur.

Of course, at least I could upload them piece by piece, and tag them as appropiate, but I'm looking to a more convenient way to share the collection. Thanks in advance.

SystemError

Updated by jxh2154

Mass uploads of that size are not intended for danbooru. We prefer individual uploads for 1) quality control and 2) proper tagging. As you say, some are worksafe, some are not. Some are loli, some are not. These are vital pieces of information that a mass upload cannot accommodate without you individually sorting them beforehand or immediatelt after uploading, in which case you might as well upload them individually to start with. And of course there's the daily limit of 16 that was mentioned.

Unless Albert changes something, it's not so much that the site can't do it or Albert can't set up some facility so much as that's not the kind of site danbooru is, and its not the kind of site danbooru wants to be. And since all uploads from users who haven't gotten invites are put in a mod queue, 1600 at once would be a bit of a challenge.

I'm aware of the Danbooru API, but I'm afraid I can't make any advantage over it without an already-made tool/application. :( Besides using web APIs and scripts is beyond my technical know-how.

Correct me if I'm wrong, but I guess the uploader plug-in is using exactly this API upload function, but with a simple user interface. Maybe there are some other uploader applications...?

You could use curl: http://en.wikipedia.org/wiki/CURL

First you generate your cookies.txt with your login information.
Also it would be required that you have a local server with ability to receive incoming connections

then do
curl cookies.txt -d "post[tags]=tag1 tag_2 tag_tag&post[source]=http://yourip/path/to/your/img.jpg" http://danbooru.donmai.us/post/create.xml

Danbooru will grab your img. Then add it. I know it can be also sent as a multi-part form and that way you wouldn't need a server, but I don't know how to do it with curl.

Problems:

1) Limit of 16 posts
2) You need to still tag them properly
3) They will go into the moderation queue.
4) Flood of bad content may get you a warning and/or a negative record

jxh2154 said:
Mass uploads of that size are not intended for danbooru. We prefer individual uploads for 1) quality control and 2) proper tagging. As you say, some are worksafe, some are not. Some are loli, some are not. These are vital pieces of information (...)

See below. I know many people contribute to Danbooru while surfing the (japanese) web, but there are people who collects images. Well, for quality control and proper tagging: I believe they are high quality and conform to Danbooru rules, and tagging... Well I have images, but the community (asides me) could tag as appropiate.

it's not so much that the site can't do it or Albert can't set up some facility so much as that's not the kind of site danbooru is, and its not the kind of site danbooru wants to be.

Excuse me, but I feel it's more like you're thinking about bandwith costs, rather than the image gallery value of Danbooru. What kind of site is Danbooru, if not a site for hosting high quality images? It's not like I would like to upload furry or guro content. :) Since it's all pretty standard anime artwork (I have a belief in my taste), Danbooru would benefit from it. It just a matter of uploading time and tagging, not "Danbooru is not meant for this".

Excuse me, but I feel it's more like you're thinking about bandwith costs, rather than the image gallery value of Danbooru. What kind of site is Danbooru, if not a site for hosting high quality images? It's not like I would like to upload furry or guro content. :) Since it's all pretty standard anime artwork (I have a belief in my taste), Danbooru would benefit from it. It just a matter of uploading time and tagging, not "Danbooru is not meant for this".

If the images are huge you can use other boards that don't have limits like moe.imouto.org or anime-chronicles.com. They are less strict with tagging (but more with huge/quality image) and don't have any limit, although posting crap will get anyone banned, so be sure to read rules/guidelines of the minimum requirements of each image

SystemError said: See below. I know many people contribute to Danbooru while surfing the (japanese) web, but there are people who collects images.

And they manage just fine with uploading individually.

Well, for quality control and proper tagging: I believe they are high quality and conform to Danbooru rules

I'm sure everyone believes that, including people with a lot of deletions. Your images may turn out to be just fine, but please leave that decision to the mods like everyone else does.

and tagging... Well I have images, but the community (asides me) could tag as appropiate.

Uploading is a two part obligation, both the upload itself and whenever possible, the tagging. Dumping 1600 image and saying "now you all deal with it" is not what is supposed to happen.

Excuse me, but I feel it's more like you're thinking about bandwith costs, rather than the image gallery value of Danbooru.

No. See above and below.

What kind of site is Danbooru, if not a site for hosting high quality images?

It is a site for hosting high quality images *properly tagged and rated*. If you simply want to get them all online and accessible in one big pile, there are plenty of image hosting websites and services out there better suited for it.

And you're still only allowed 16 a day, making this moot. The rules in place are set by the site's owner and they're there for a reason. I understand that you don't like them, but please accept them like everyone else does.

After a little thinking, I'm sorry if I was a little picky about this uploading, sorry jxh2154. It's not like I dislike anything about Danbooru, and the tag system is a really fine idea.

Nah... I guess I should tag uploads regadless of number. Well, maybe I start uploading some, and I hope the community enjoys them. I'm enjoying them, so a try wouldn't hurt... :3

Also, thanks for the help, Shuugo.

Just a question. Privileged accounts have the 16 image/day limit too?

I'm not aware of any GUI mass uploaders for Danbooru.

Even if there were, you'd still be limited to 16 posts a day. This limit is in place precisely to prevent people like you from flooding the site.

albert said:
I'm not aware of any GUI mass uploaders for Danbooru.

Even if there were, you'd still be limited to 16 posts a day. This limit is in place precisely to prevent people like you from flooding the site.

Hey, I'm not bad! O_o And I didn't want to "flood" the site, just add good images to it. Flood in my definition is spam/annoying messages, but something which is supposed to be uploaded here can't be flood. Anyway, the 16 image/day limit is a 16 image/day limit, so don't worry please. I'm not a big bad troll. XD I really like pictures which I collect, so I guess I'm with good intentions.

After all, a mass download would be more lethal to Danbooru's bandwidth usage, with no profit for the site itself. In the reverse direction, a mass upload would be beneficial to the site and to the community, but would strain the mods because of the queue and the community because of the tagging. Personally I vote for the less evil mass upload. :)

It's just a thought, as the limit is present.

Upload your 16 best images, then we'll see how "good" they are.

There are lots of people who've said they've got lots of great quality images, and then just uploaded shit.

You are not going to get a mass upload tool, so stop whining and start uploading.

SystemError said:
After all, a mass download would be more lethal to Danbooru's bandwidth usage, with no profit for the site itself. In the reverse direction, a mass upload would be beneficial to the site and to the community, but would strain the mods because of the queue and the community because of the tagging. Personally I vote for the less evil mass upload. :)

It's just a thought, as the limit is present.

You're comparing two totally unrelated tasks, I don't see how downloading all images is going to make publish all your images or help in any way with it

Fencedude said:
Upload your 16 best images, then we'll see how "good" they are.

There are lots of people who've said they've got lots of great quality images, and then just uploaded shit.

You are not going to get a mass upload tool, so stop whining and start uploading.

Rather the first 16 images, 'cos I don't want to mess up the line order. On the other hand, I already felt sorry for what I have said, soplease don't say I'm whining.
I know I don't get a mass upload tool, but I was asking for one from here? Especially from you? Nope, sir. Please assume good faith, like on Wikipedia.
I'll start uploading as soon as I feel the urge to it.

Shuugo>
No, I just compared theoretical mass uploading and theoretical mass downloading on a whim. In the case, if the limit was not present. Just a mindplay.

1