《爱,被呈现》,一部新的纪录短片,探索记忆丧失和讲故事的力量——并展示了技术如何帮助重新点燃那些开始消逝的记忆。影片跟随伯特和埃塞尔·沙茨,这对结婚超过70年的夫妻,讲述他们如何应对伯特的认知衰退。在他逐渐模糊的记忆中,有一段最珍贵的记忆:他们在克利夫兰的学生合作社第一次见面的日子。由于那一天没有被拍照或拍摄,这一天只能存在于他们的脑海中。
当我作为影片的技术负责人加入时,我就知道这个项目在技术上复杂的同时,情感上也同样具有挑战性。记忆丧失对我来说很个人化。我的祖父在去世前经历了中风和记忆丧失。我最后一次去看他时,我已经三十多岁。他坚信我还在上大学,并为我毕业而感到非常高兴。那段苦乐参半的记忆一直没有离开我。
这种经历让我想看看这项技术是否能通过同样的媒介让我与家人建立更深的联系。当这个项目开始时,我向父亲要了老家照片。我在父母初次相识时的照片上测试了我们的图像修复技术,并用我们的视频模型将照片动画化。看到父母二十多岁的样子真正让我明白,这些工具能如何帮助保留最重要的记忆,不让它们消逝。
《爱,被呈现》由奥斯卡提名导演莉兹·加布斯执导,她与丹·科根和达伦·阿罗诺夫斯基共同制作。影片是在谷歌深度智脑和阿罗诺夫斯基的创意项目Primordial Soup合作下创作的。
莉兹和达伦在拍摄影片时,都对记忆的韧性感到好奇。在执导纪录片《昏迷》期间,莉兹看到患者处于最小意识状态时,当听到熟悉的声音或看到亲人照片时,功能性磁共振成像显示出大脑活动的亮起。几年后,达伦看到了一段阿尔茨海默症前芭蕾舞演员的视频,当她听到《天鹅湖》时,她本能地从轮椅上演绎舞蹈动作。
这些触发点使创作团队转向了怀旧疗法,这是一种临床实践,通过歌曲、家庭故事和老照片等感官线索来刺激记忆,激发对话,并重新点燃情感联系。但当记忆没有与这些线索相关联时,会发生什么呢?
为了重现Burt和Ethelle未被记录的过去,电影制作人选择与我的团队合作。Ethelle坐在我们旁边,成为了积极的共同创作者,纠正楼梯的曲线或鞋跟的形状。
我们与Primordial Soup团队并肩工作,将新兴的AI模型作为艺术媒介和工具包,每一步都以人工指导技术。
弥合缺失细节的空白需要一种双重技术方法,旨在保持情感的真实性。
将这两种媒介结合,使我们能够交织Burt和Ethelle的过去与现在。在此过程中,我们生成了一种“记忆”,他们告诉我们这种记忆感觉真实。
请参阅我的同事Jess Gallegos,了解工作流程的更多细节。
正如Darren在拍摄过程中所指出的,工具——如画笔或锤子——在没有人工操作指导下毫无作用。在《Love, Rendered》中,机器学习是我们用来引导Burt和Ethelle回溯时光的工具,帮助他们抓住易逝的瞬间。
你可以在这里观看完整影片:https://youtu.be/TYlsVEtKe-8?si=KlcWZsYLE_npPx2G,逐帧感受他们的爱情故事。
无论您是想与祖父母联系,还是保存家庭核心记忆,都可以在Gemini应用中修复旧照片:https://gemini.google.com/app。上传一张照片的图像,并告诉Gemini:“你能修复并上色这张照片吗?保持人物的外貌、表情和姿态。”
请检查您的收件箱以确认订阅。
“Love, Rendered,” a new documentary short, explores memory loss and the power of storytelling — and it showcases how technology can help rekindle memories that have begun to fade. The film follows Burt and Ethelle Shatz, a couple married for over 70 years, as they navigate Burt’s cognitive decline. Among his fading memories is one of their most precious: the day they met at a student co-op in Cleveland. Because it wasn’t photographed or filmed, the day existed only in their minds.
When I stepped in as the film’s technical lead, I knew the project would be as emotionally demanding as it was technically complex. Memory loss is personal to me. My grandfather suffered a stroke and memory loss before he passed. The last time I visited him, I was in my thirties. He was convinced I was still in college and was so happy I was graduating. That bittersweet memory never left me.
The experience made me want to see if this technology could help me connect more deeply with my family through the same medium. When this project began, I asked my father for old family photos. I tested our image restoration on photographs from when my parents met and used our video models to animate them. Watching my parents move as twenty-somethings really drove home how these tools could help keep what matters most from slipping away.
“Love, Rendered” was directed by Academy Award–nominated filmmaker Liz Garbus, who produced it alongside Dan Cogan and Darren Aronofsky. It was created in collaboration between Google DeepMind and Primordial Soup, Aronofsky’s creative venture.
Liz and Darren both came to the film curious about the resilience of memory. While directing the documentary “Coma,” Liz saw fMRI scans light up when patients in minimally conscious states heard familiar voices or were shown images of loved ones. Years later, Darren encountered footage of a former ballerina with Alzheimer’s who, upon hearing “Swan Lake,” instinctively danced the choreography from her wheelchair.
These touchstones led the creative team to reminiscence therapy, the clinical practice of using sensory cues like songs, family stories, and old photographs to stimulate memories, spark conversations, and rekindle emotional connections. But what happens when a memory isn’t attached to such cues?
To recreate Burt and Ethelle's unrecorded past, the filmmakers partnered with my team. Sitting alongside us, Ethelle became an active co-creator, correcting the curve of a staircase or the shape of a shoe heel.
We worked alongside the team at Primordial Soup, leveraging emerging AI models as an art medium and toolkit, guiding the technology with human direction every step of the way.
Bridging the gaps between the missing details required a two-part technical approach designed to preserve emotional truth.
Combining these two mediums allowed us to intertwine Burt and Ethelle’s past and their present. In doing so, we generated a “memory” that they told us felt authentic.
See my colleague Jess Gallegos explain the workflow in more detail.
As Darren noted during production, a tool — like a paintbrush or a hammer — does nothing until it’s guided by human hands. In “Love, Rendered,” machine learning was the tool we used to guide Burt and Ethelle back through time, helping them hold onto a vanishing moment.
You can watch the full film here:https://youtu.be/TYlsVEtKe-8?si=KlcWZsYLE_npPx2G to experience their love story, frame by frame.
Whether you’re looking to connect with a grandparent or preserve your family’s core memories, you can restore old photos in the Gemini app:https://gemini.google.com/app. Upload an image of the photo and ask Gemini: “Can you restore and colorize this photo? Preserve the appearance, expression, and pose of the people.”
Check your inbox to confirm your subscription.