MARINA MUZYKA
MARINA MUZYKA
      InsideOut.Imprint is an artistic exploration focused on studying the emotions of the musician at the moment of performing a musical composition. Drawing upon the registration of brain activity signals (electroencephalogram) and visual programming technologies, the project offers a method of visual and tactile interpretation of musical pieces. This occurs through the musician's own perception of the music. The musical compositions "Russian Dead Ends" and "The Book of Sorrow and Joy" by composer Nastasya Khrushcheva were chosen as examples of contemporary academic music, showcasing a wide emotional range. Of particular interest is the opportunity to work directly with the composer, studying how emotions influence visualization.

      We have developed an experimental logic for creating artistic objects, representing 'imprints' of both the played and experienced musical composition. This method allows for the creation of physical-digital imprints of each unique musical performance, by overlaying information about the musician's emotions onto sound waves.

      In the initial stage of the project, recordings of musical compositions performed by Nastasya Khrushcheva were encoded into volumetric digital objects—'sculptural works.' Their forms and textures convey the dynamics and unique geometry of sound, which became the basis for digital and physical prototypes.
      During a musical performance, the geometry of the digital imprints was altered by brain bioelectrical activity data obtained from a neurointerface. These data included measures of alpha, beta, and theta waves, each with a unique shape, amplitude, topography, frequency, and response type. Analyzing and presenting these indices allowed us to track the dynamics of changes in the musician's state as the musical story unfolded at each point in time.

      At the beginning of the performance, the audience could observe the activity of the alpha rhythm, associated with a state of calm wakefulness and meditation. However, as the musician immersed themselves in the process of playing, there was an increase in the beta rhythm, reflecting moments of high thinking activity and strong emotional tension, as well as a simultaneous decrease in the activity of the alpha rhythm. An increase in theta rhythm activity, associated with the state of meditation and creativity, could be recorded throughout the musical plot.
      In the next stage of the project, the sculptural imprints of musical compositions acquire tactility in the form of ceramic sculptures, which are printed in collaboration with Danil Karamushkin using additive manufacturing technologies. Imprints of each musical piece become part of an exhibition composition in the Russian Museum. During real-time performances, the geometry of the sculptures transforms under the influence of brain wave activity information received from the performer. During play, the musician shows an increase in beta rhythm and simultaneously a decrease in alpha rhythm of brain activity. Considering the automatic separation of myographic artifacts, we can also obtain information about the musician's heightened concentration during the performance. Data on brain bioelectrical activity is transformed into visual patterns, forming a unique image at each moment in time.
      The InsideOut.Imprint project was developed as part of a joint exhibition project of the State Russian Museum in St. Petersburg and the Art&Science Center at ITMO University, curated by Khristina Ots and Sergey Kostyrko.
      Artists: Maria Kuptsova, Marina Muzyka, Daria Smakhtina
      Ideologist: Egor Zvezdin
      Sculptural objects fabricated in collaboration with: Danil Karamushkin
      Composer and pianist: Nastasia Khruscheva
      Technical support: Ilya Revin
      Producer: ArtMix (Egor Zvezdin, Margo Bor)
      Neurointerfaces: Neiry.ru
      Text: Maria Kuptsova, Marina Muzyka


      February | 2024