The focus has shifted towards multimodal Large Language Models (MLLMs), particularly in enhancing their processing and integrating multi-sensory data in the evolution of AI. This advancement is crucial in mimicking human-like cognitive abilities for complex real-world interactions, especially when dealing with rich visual inputs. A key challenge in the current MLLMs is their need for…

Neural Radiance Fields (NeRF) have revolutionized how everyone approaches 3D content creation, offering unparalleled realism in virtual and augmented reality applications. However, editing these scenes has been complex and cumbersome, often requiring intricate processes and yielding inconsistent results. The current landscape of NeRF scene editing involves a range of methods that, while effective in certain…

Advancements in generative models for text-to-image (T2I) have been dramatic. Recently, text-to-video (T2V) systems have made significant strides, enabling the automatic generation of videos based on textual prompt descriptions. One primary challenge in video synthesis is the extensive memory and training data required. Methods based on the pre-trained Stable Diffusion (SD) model have been proposed…

The study investigates how text-based models like LLMs perceive and interpret visual information in exploring the intersection of language models and visual understanding. The research ventures into uncharted territory, probing the extent to which models designed for text processing can encapsulate and depict visual concepts, a challenging area considering the inherent non-visual nature of these…

Recent advancements in text-to-image generation driven by diffusion models have sparked interest in text-guided 3D generation, aiming to automate 3D asset creation for virtual reality, movies, and gaming. However, challenges arise in 3D synthesis due to scarce high-quality data and the complexity of generative modeling with 3D representations. Score distillation techniques have emerged to address…

Adversarial attacks in image classification, a critical issue in AI security, involve subtle changes to images that mislead AI models into incorrect classifications. The research delves into the intricacies of these attacks, particularly focusing on multi-attacks, where a single alteration can simultaneously affect multiple images’ classifications. This phenomenon is not just a theoretical concern but…

Artificial intelligence has always faced the issue of producing high-quality videos that smoothly integrate multimodal inputs like text and graphics. Text-to-video generation techniques now in use frequently concentrate on single-modal conditioning, using either text or images alone. The accuracy and control researchers can exert over the created films are limited by this unimodal technique, making…

Diffusion models are a significant component in generative models, particularly for image generation, and these models are undergoing transformative advancements. These models, functioning by transforming noise into structured data, especially images, through a denoising process, have become increasingly important in computer vision and related fields. Their capability to convert pure noise into detailed images has…

Neural View Synthesis (NVS) poses a complex challenge in generating realistic 3D scenes from multi-view videos, especially in diverse real-world scenarios. The limitations of current state-of-the-art (SOTA) NVS techniques become apparent when faced with variations in lighting, reflections, transparency, and overall scene complexity. Recognizing these challenges, researchers have aimed to push the boundaries of NVS…

The challenge of creating adaptable and versatile visual assistants has become increasingly evident in the rapidly evolving Artificial Intelligence. Traditional models often grapple with fixed capabilities and need help to learn dynamically from diverse examples. The need for a more agile and responsive visual assistant capable of adapting to new environments and tasks seamlessly sets…