A pressing issue emerges in text-to-image (T2I) generation using reinforcement learning (RL) with quality rewards. Even though potential enhancement in image quality through reinforcement learning RL has been observed, the aggregation of multiple rewards can lead to over-optimization in certain metrics and degradation in others. Manual determination of optimal weights becomes a challenging task. This…

Researchers from Tel-Aviv University and Google Research introduced a new method of user-specific or personalized text-to-image conversion called Prompt-Aligned Personalization (PALP). Generating personalized images from text is a challenging task and requires the presence of diverse elements like specific location, style, or (/and) ambiance. Existing methods compromise personalization or prompt alignment. The most difficult challenge…

Combining CLIP and the Segment Anything Model (SAM) is a groundbreaking Vision Foundation Models (VFMs) approach. SAM performs superior segmentation tasks across diverse domains, while CLIP is renowned for its exceptional zero-shot recognition capabilities.  While SAM and CLIP offer significant advantages, they also come with inherent limitations in their original designs. SAM, for instance, cannot…

When the camera and the subject move about one another during the exposure, the result is a typical artifact known as motion blur. Computer vision tasks like autonomous driving, object segmentation, and scene analysis can negatively impact this effect, which blurs or stretches the image’s object contours, diminishing their clarity and detail. To create efficient…