UniControl: Unified Controllable Visual Generation Modelhttps://github.com/salesforce/UniControl
UniControl is a new generative model that combines many condition-to-image (C2I) tasks into one framework while still allowing for language prompts. This enables precise image generation where visual conditions influence the generated structures and language prompts guide the style and context. UniControl can handle diverse visual conditions through pretrained text-to-image diffusion models and a task-aware HyperNet that modulates these models. UniControl outperforms single-task models of similar sizes and marks a significant advancement in controlled visual generation.