Patchouli is mistaking being sheltered to a point you're barely sociable, to being a downright idiot.
Flandre might've been isolated a lot and it screwed up her social developement, but it seem her intelligence didn't suffer too much from it.
(Don't mind how studies prove the correlation between social contacts and intelligence, this is just a Touhou comic.)