{"id":8104,"date":"2025-12-07T00:54:54","date_gmt":"2025-12-07T00:54:54","guid":{"rendered":"https:\/\/blog.7doigts.com\/?p=8104"},"modified":"2025-12-07T00:54:54","modified_gmt":"2025-12-07T00:54:54","slug":"generative-ai-from-human-movement-to-visual-creation","status":"publish","type":"post","link":"https:\/\/blog.7doigts.com\/en\/2025\/12\/07\/generative-ai-from-human-movement-to-visual-creation\/","title":{"rendered":"Generative AI: from human movement to visual creation"},"content":{"rendered":"<p><i><span data-contrast=\"auto\">From the very beginning of image generation using artificial intelligence, LAB7\u2019s creative director Samuel&nbsp;T\u00e9treault&nbsp;envisioned the creative potential of this technology&nbsp;used&nbsp;in&nbsp;a&nbsp;dialogue with&nbsp;live performance and human movement. We went through several iterations to explore generative AI tools as they were evolving,&nbsp;to&nbsp;bring&nbsp;this&nbsp;vision to life.<\/span><\/i><span data-ccp-props=\"{&quot;134233279&quot;:true}\">&nbsp;<\/span><\/p>\n<p><span data-contrast=\"auto\"><strong>For&nbsp;our first exploration in 2023<\/strong>, we simply used artificial intelligence to transform pre-recorded videos, confirming&nbsp;the&nbsp;creative potential&nbsp;of our concept.&nbsp;Then one of our interns, a computer&nbsp;engineer&nbsp;graduating student, built a first&nbsp;prototype&nbsp;of a&nbsp;solution to&nbsp;create a \u201clive\u201d&nbsp;interaction between human movement and generative AI.&nbsp;This&nbsp;pipeline combined&nbsp;a video camera, silhouette&nbsp;cropping, and&nbsp;searching&nbsp;an image bank that had been generated&nbsp;beforehand.<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true}\">&nbsp;<\/span><\/p>\n<p><span data-ccp-props=\"{&quot;134233279&quot;:true}\"><a href=\"https:\/\/blog.7doigts.com\/2025\/12\/07\/ia-generative-du-mouvement-humain-a-la-creation-visuelle\/birds_ai\/\" rel=\"attachment wp-att-8095\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-8095\" src=\"http:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI-1024x309.png\" alt=\"\" width=\"1024\" height=\"309\" srcset=\"https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI-1024x309.png 1024w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI-300x90.png 300w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI-768x231.png 768w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI-1080x325.png 1080w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI-24x7.png 24w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI-36x11.png 36w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI-48x14.png 48w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Birds_AI.png 1387w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span class=\"TextRun SCXW261285637 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun SCXW261285637 BCX0\"><strong>The second iteration of the project, in the summer of 2024,<\/strong> replaced the video camera with a Kinect camera and relied on the integration of Stable Diffusion into Comfy UI. Under the creative direction of Samuel&nbsp;<\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW261285637 BCX0\">T\u00e9treault<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">, we created several visual recipes and invited acrobatic dancers to bring them to life. Th<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">is prototype was<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">&nbsp;presented at Forum LAB7 in November 2024 and then at the E-AI conference in February 2025. The system<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">&nbsp;could<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">process<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">10 i<\/span><span class=\"NormalTextRun SCXW261285637 BCX0\">mages per second, which resulted in a slightly jerky rendering and influenced certain artistic choices, particularly in terms of the rhythm of the performance.<\/span><\/span><span class=\"EOP SCXW261285637 BCX0\" data-ccp-props=\"{&quot;134233279&quot;:true}\">&nbsp;<\/span><\/p>\n<p><iframe loading=\"lazy\" title=\"FORUM LAB7 2024 - De\u0301mo artistique - Arts du mouvement, IA ge\u0301ne\u0301rative et temps re\u0301el\" width=\"1080\" height=\"608\" src=\"https:\/\/www.youtube.com\/embed\/a5DY9KawZ_s?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<p><span class=\"TextRun SCXW132777150 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun SCXW132777150 BCX0\"><strong>In February 2025<\/strong>, we took advantage of the integration of Stable Diffusion into the VVVV software to further develop our concept and achieve greater visual fluidity. We&nbsp;<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">us<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">ed this&nbsp;<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">new pipeline<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">for<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">&nbsp;the opening ceremony of Hannover Messe, the world&#8217;s largest industrial technology trade fair, with a performance directe<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">d by&nbsp;<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">the 7 Fingers<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">artistic codirector&nbsp;<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">Patrick L\u00e9onard, in collaboration with the formida<\/span><span class=\"NormalTextRun SCXW132777150 BCX0\">ble Toronto-based Indigenous company Red Sky Performance and our sister company Supply + Demand.<\/span><\/span><span class=\"EOP SCXW132777150 BCX0\" data-ccp-props=\"{&quot;134233279&quot;:true}\">&nbsp;<\/span><\/p>\n<p><iframe loading=\"lazy\" title=\"Opening of The Hannover Messe\" width=\"1080\" height=\"608\" src=\"https:\/\/www.youtube.com\/embed\/drvlZf7qC84?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<p><span class=\"TextRun SCXW103915273 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun SCXW103915273 BCX0\">Finally, we perfected the latest version of&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">our&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">pro<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">t<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">otype<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">during a <strong>creative lab in July 2025<\/strong>, funded by the City of Montreal. Samuel&nbsp;<\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW103915273 BCX0\">T\u00e9treault<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;worked hand in hand with&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">digital<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;artist Rapha\u00ebl Dupont<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">, from our sister company Supply + Demand,<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;to create a dozen visual recipes that apply AI image generation to compositions combining the artists&#8217; silhouettes with&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">animated&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">3D objects and particles.&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">We also worked on v<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">is<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">ual composition<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">s<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;to&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">experiment<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">with&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">the&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">potential<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;of&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">the<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;multi-screen<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;immersive space in which the residency&#8217;s final presentation took place,&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">with<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;visuals&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">brought&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">to life<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;by&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">four acrobat<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">-dancers<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">.&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">Both this presentation and a shorter version<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">showcas<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">ed<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;at HUB Montr\u00e9al in<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;October 2025 were&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">a great success<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;and&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">left<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">our audience of professi<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">onals&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">admirative of<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">our exc<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">ellent&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">aesthetic and technical<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">&nbsp;<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">proposition<\/span><span class=\"NormalTextRun SCXW103915273 BCX0\">.<\/span><\/span><span class=\"EOP SCXW103915273 BCX0\" data-ccp-props=\"{&quot;134233279&quot;:true}\">&nbsp;<\/span><\/p>\n<p><iframe loading=\"lazy\" title=\"Gen Ai\" width=\"1080\" height=\"608\" src=\"https:\/\/www.youtube.com\/embed\/4onXl1J4CnY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p><span data-contrast=\"auto\">Throughout this project, we conducted&nbsp;numerous&nbsp;tests with our&nbsp;research&nbsp;partner, the HUPR Center, for example to test the device with more complex circus disciplines, accessories, and other capture methods.&nbsp;SAT also&nbsp;created a&nbsp;user-friendly interface&nbsp;integrated in their open-source&nbsp;solution&nbsp;Ossia,&nbsp;so&nbsp;creators&nbsp;can&nbsp;easily&nbsp;explore and&nbsp;create with&nbsp;generative AI and human movements.&nbsp;Now that&nbsp;our prototype&nbsp;has proven its potential, we can use it in a performance context, with acrobats and&nbsp;dancers, but also as an&nbsp;interactive&nbsp;installation available to&nbsp;the public. And, why not, soon in a show!<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true}\">&nbsp;<\/span><\/p>\n<p><i><span data-contrast=\"auto\">We would like to thank Ville de Montr\u00e9al&nbsp;and our partners for their support.<\/span><\/i><span data-ccp-props=\"{&quot;134233279&quot;:true}\">&nbsp;<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true}\">&nbsp;<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true}\"><a href=\"https:\/\/blog.7doigts.com\/2025\/12\/07\/ia-generative-du-mouvement-humain-a-la-creation-visuelle\/logos-copie\/\" rel=\"attachment wp-att-8097\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-8097\" src=\"http:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-1024x124.jpg\" alt=\"\" width=\"1024\" height=\"124\" srcset=\"https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-1024x124.jpg 1024w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-300x36.jpg 300w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-768x93.jpg 768w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-1536x185.jpg 1536w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-2048x247.jpg 2048w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-1080x130.jpg 1080w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-24x3.jpg 24w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-36x4.jpg 36w, https:\/\/blog.7doigts.com\/wp-content\/uploads\/2025\/12\/Logos-copie-48x6.jpg 48w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a>&nbsp;<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>From the very beginning of image generation using artificial intelligence, LAB7\u2019s creative director Samuel&nbsp;T\u00e9treault&nbsp;envisioned the creative potential of this technology&nbsp;used&nbsp;in&nbsp;a&nbsp;dialogue with&nbsp;live performance and human movement. We went through several iterations to explore generative AI tools as they were evolving,&nbsp;to&nbsp;bring&nbsp;this&nbsp;vision to life.&nbsp; For&nbsp;our first exploration in 2023, we simply used artificial intelligence to transform pre-recorded videos, confirming&nbsp;the&nbsp;creative potential&nbsp;of our concept.&nbsp;Then one of our interns, a computer&nbsp;engineer&nbsp;graduating student, built a first&nbsp;prototype&nbsp;of a&nbsp;solution to&nbsp;create a \u201clive\u201d&nbsp;interaction between human movement and generative AI.&nbsp;This&nbsp;pipeline combined&nbsp;a video camera, silhouette&nbsp;cropping, and&nbsp;searching&nbsp;an image bank that had been generated&nbsp;beforehand.&nbsp; &nbsp; The second iteration of the project, in the summer of 2024, replaced the video camera with a Kinect camera and relied on the integration of Stable Diffusion into Comfy UI. Under the creative direction of Samuel&nbsp;T\u00e9treault, we created several visual recipes and invited acrobatic dancers to bring them to life. This prototype was&nbsp;presented at Forum LAB7 in November 2024 and then at the E-AI conference in February 2025. The system&nbsp;could&nbsp;process&nbsp;10 images per second, which resulted in a slightly jerky rendering and influenced certain artistic choices, particularly in terms of the rhythm of the performance.&nbsp; &nbsp; In February 2025, we took advantage of the integration of Stable Diffusion into the [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[227],"tags":[],"class_list":["post-8104","post","type-post","status-publish","format-standard","hentry","category-lab7"],"_links":{"self":[{"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/posts\/8104","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/comments?post=8104"}],"version-history":[{"count":1,"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/posts\/8104\/revisions"}],"predecessor-version":[{"id":8105,"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/posts\/8104\/revisions\/8105"}],"wp:attachment":[{"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/media?parent=8104"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/categories?post=8104"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.7doigts.com\/en\/wp-json\/wp\/v2\/tags?post=8104"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}