Donmai

AI-generated art check thread

Posted under General

With the ongoing issue and controversy in regards to AI-generated art (which we do not allow to be posted on this site), it is best that we start a forum thread to help identify if posts are AI-generated or not so that we can reduce the number of accidental uploading of AI art.

If you're unsure whether or not a certain image or set of images is AI-generated or not, post it here to request for feedback from other users to verify if that is the case.

  • If it has not been uploaded to Danbooru yet, post it as a link in this thread.
  • If it is already uploaded to Danbooru, post it here as post #xxxxxxxx.

Since I created the thread, my turn first: https://www.pixiv.net/en/artworks/101928725

I think there are two frequent problems with art:
- quality in terms of skill
- what an author wants to portray
Danbooru checks on quality and skill to a degree, but doesn't filter what vulgar, tasteless, indecent, offensive and unmannerly stuff is being portrayed. This really speaks poorly of humanity. Just browsing Danbooru is enough to be outraged, upset and feeling of losing hope of humanity. What helps is a long blacklist.

Ideally, I would want to filter all the AI works with:
- bad quality in terms of artistry, proficiency
- poor taste of the prompter

Certainly we don't want Danbooru to be flooded with millions of mediocre, similar AI synthesis works. For example, if hands are badly synthesized, then it gets deleted. And these works need to be tagged properly too.

Shibi said:

post #5751545
...is this really AI? It feels too.. naturally rough to be AI, even though the twitter profile says it is. If it is, then that's fucking scary.

1. Look at panties. No comments.
2. Look at the form of a right breast near a hand
3. Outlines are too strange
4. Bad anatomy for armpits
5. Weird fat to the right of the navel and no fat on the left side.
6. A lot of JPEG artifacts indicate upscaling.

Shibi said:

post #5751545
...is this really AI? It feels too.. naturally rough to be AI, even though the twitter profile says it is. If it is, then that's fucking scary.

One more thing to add: The face in that post reminds me a lot of sak_(lemondisk). I'll bet it was trained on some of their art. Less likely that an independent artist would so closely replicate another's style by accident. It also looks like it may have been trained on jpeg or scaling artifacts because there's a bunch of "unnatural" roughness and smearing too.

The "roughness" of a line is quantifiable. If the model is trained on rough lines, that's what it'll produce, as much as it'll produce smooth shading if trained on that. In this example the inconsistency of rough lines with polished shading in a lot of areas is another pointer. You don't usually see a human artist finish shading before cleaning up lines.

Another minor thing in this example -- but something that is probably a more widely usable principle for recognizing AI art -- is bits of red in the hair near the hair ribbons. I can't see a human artist drawing those. I would say it's an artifact of the model understanding shapes and objects statistically but not semantically. It knows that Kamisato Ayaka has light blue and red in approximately these shapes, but doesn't actually know what hair is or what a ribbon is, so it may create a shape that's technically very close to the intended one but doesn't actually make sense to draw. (As someone who dreamt of artificial general intelligence as a kid, I could go on for hours about how huge statistical models, while they are without doubt extremely useful for tons of things, should not be described as "intelligence" or "thinking" when they cannot generalize / understand concepts.)

Be careful about saying something is AI without concrete evidence. I've seen more than one artist on Twitter get very offended at their work being falsely called AI by people saying all the minor flaws in their work are proof of AI.

Nameless_Contributor said:

I made a script that warns on the upload page if an image meets the same criteria that would auto-add the AI-generated tag.

Is there supposed to be an actual warning that pops up in the upload page, or is it just auto-adding the AI-generated tag as the warning itself? I would assume at least the latter is happening to compensate for Pixiv users who don't use AI-related tags on their uploads.

Benit149 said:

Is there supposed to be an actual warning that pops up in the upload page, or is it just auto-adding the AI-generated tag as the warning itself? I would assume at least the latter is happening to compensate for Pixiv users who don't use AI-related tags on their uploads.

It shows a red warning notice at the top of the page if the file metadata indicate that the image is AI-gen.
The tags and description are already visible on the upload page so I didn't add checks for them.

Nameless_Contributor said:

It shows a red warning notice at the top of the page if the file metadata indicate that the image is AI-gen.
The tags and description are already visible on the upload page so I didn't add checks for them.

I have the script installed, and I'm not seeing any sort of red warning notice at the top of the page whenever I test an AI-generated image. I do also have your other script for uploads link media assets, so I'm wondering if that's causing a conflict.

Benit149 said:

I have the script installed, and I'm not seeing any sort of red warning notice at the top of the page whenever I test an AI-generated image. I do also have your other script for uploads link media assets, so I'm wondering if that's causing a conflict.

It's not guaranteed that the image file's metadata will tell it's AI, as noted in forum #223738.

Benit149 said:

I have the script installed, and I'm not seeing any sort of red warning notice at the top of the page whenever I test an AI-generated image. I do also have your other script for uploads link media assets, so I'm wondering if that's causing a conflict.

You can try uploading any image from exif:PNG:Software=NovelAI to Testbooru, if it shows the warning the script is working correctly. There's no conflict with the other script.

Benit149 said:

Tried a mock upload on Testbooru. I also C&P'ed the code multiple times to make sure it was correct. No red warning for me.

Hm... What browser and what userscript manager are you using? Any errors in the JS console (press F12 to open it)?
Please send me a DM so we don't derail this thread.

1 2 3 4 5 117