No local image generation with Intelligent turned on

purerub

Hello, first time posting here, so I'm probably going to go overboard with the amount of info, but I'm having an issue where turning on Intelligent image generation (and tested with multi-character both on and off) while self-hosting ComfyUI for image generation causes an issue where my local generator is not called at all to generate an image.

I took a HAR dump and tried to analyze for anything out of the ordinary, but couldn't spot anything.
With intelligentSyncImageV2: true, the client emits no getSyncV2Prompt request at all — no error, no network activity — while narration, TTS segmentation (6–8 segments/beat) and stim dispatch all work normally.

I did notice that
charGenSettings.loras is set to [] for some reason even though the character I selected has a LORA.

This was not the case before the latest update, is anyone else having this issue?

@KairosJS can you assist? Happy to provide any and all details of my local setup.

PS. I've also noticed that when I disable that setting, sometimes the app uses one of the pre-generated images from the character setup gallery, which I'd really prefer it didn't, is there a way to disable this?

purerub

@KairosJS
I've narrowed this down:

handleImageSyncing = async (o,l,c,h,m,d) => new Promise(async (p,u) => {
if (c.local && !c.useOnlineUtily) return p();

So setting Model for utility features to "Local" breaks local image generation silently.

KairosJS

Nick11235

purerub

Hey, this is intended, the following agents: FX, SFX, intelligent image generation, translation and scene state don't work locally. You can use a local LLM for the RP, but need to enable Online Models for "Model for utility features" that should work.
.

If that worked before, I think it's because it fell back on the online model.

Hopefully it helps.

Nick11235

Having the same issues I believe, recently posted I couldn't get local LLM and local image to work together (only very recently tried) which was fixed by either disabling the Intelligent Image Gen, or choosing OnlineAI for the Utility features (with Intelligent Image Gen).

Intelligent Image Gen off works fine for local Utility for me, but if I leave it on and then set Utility to local, the prompt view tab is completely blank and the image remains as the first loaded gallery image, was a real head scratcher whilst starting to make sense of running the models locally - glad to see this post as it seems to confirm I wasn't doing anything stupid/incorrectly (hopefully!).

purerub

KairosJS
Thanks Kairos.

It might be nice to have the tooltip mention that those modules require using the online model for the utility features. Or add that as a requirement in the Modules section to explain that those require the Online model.

KairosJS

purerub Yes, you're right, I will make this clearer.

purerub

@KairosJS I'm likely the exception here but I have some vram to spare. Is there anyway to host the agent for the utility features locally?