The BildKlangPoet - a Framework for Designing Mixed Reality Painting Experiences Using Generative AI

This project aims to bridge the gap between generative AI and the individual user experience by creating an interactive installation that combines self-created or selected content with real-time and AI-generated media. The primary aim is to actively involve visitors in the process of creating a digital painting. Their face, decisions and drawings or writings become the basis for an AI-generated painting. The installation is based on the principle of AI-supported media generation, in which users play an active role in the creative process. Personalized works of art are created from photos, text or drawings and combined with generated images, poems and music. The results are partially rendered in real time. The second goal is to support the creation of new media art experiences through remixing.