Maybe I'm bad at prompting them but both Klein 9B and ZiT seem really lacking in facial expressions

r/StableDiffusion
Generative AI

They can both do basic emotions like joy, surprise, fear, anger, etc but trying to get them to do specific facial expressions is really difficult to impossible. ZiT often just ignores your instructions while Klein, when it works, goes overboard, moving the face too much even when you try to ask for a subtle smirk or a faint smile, adding so many laugh lines, dimples and folds it makes the faces look rubbery. I tried giving some example images to an LLM and using the detailed descriptions in my prompts but they didn't seem to make much difference.