Image Editing Of Complex Visual Scene Via Natural Language H/F - 78

Le CEA est un acteur majeur de la recherche, au service des citoyens, de l'économie et de l'Etat.

Il apporte des solutions concrètes à leurs besoins dans quatre domaines principaux : transition énergétique, transition numérique, technologies pour la médecine du futur, défense et sécurité sur un socle de recherche fondamentale. Le CEA s'engage depuis plus de 75 ans au service de la souveraineté scientifique, technologique et industrielle de la France et de l'Europe pour un présent et un avenir mieux maîtrisés et plus sûrs.

Implanté au coeur des territoires équipés de très grandes infrastructures de recherche, le CEA dispose d'un large éventail de partenaires académiques et industriels en France, en Europe et à l'international.

Les 20 000 collaboratrices et collaborateurs du CEA partagent trois valeurs fondamentales :

- La conscience des responsabilités
- La coopération
- La curiositéThis internship focuses on the emerging field of natural language-guided image editing, specifically targeting the generation and modification of complex scenes based on verbal descriptions. The candidate will work on designing and implementing novel methods that can interpret natural language to manipulate or generate detailed images representing multifaceted scenarios (e.g., crowd scenes, cityscapes, interactions between multiple objects).

This project presents several key challenges, including:
-Scene Complexity: Managing multiple objects and their relationships in a scene adds significant complexity. The goal is to maintain coherence and accuracy in the edited images, even when the scenes described involve intricate interactions between various elements.
-Multimodal Integration: Successfully combining linguistic and visual inputs to obtain visual outputs, is a complex problem requiring seamless interaction between natural language processing (NLP) and computer vision models.

The objectives of this internship are to:
-Investigate current methods for natural language-based image generation and editing of complex scenes (in particular for the numerality and geometric positioning aspects);
-Develop an innovative approach for editing complex scenes using natural language descriptions;
-Demonstrate significant improvements in the accuracy and detail of generated images;
-Contribute to academic research through potential publications and/or patents.