Talking Portraits

From Rembrandt to real time: The AI-powered portrait that sees and speaks

Transcript

Hello there. Who are you? I am Rembrandt, the Dutch master. If I were a subject in one of your paintings, how would you portray me? I would likely portray you in a warm and intimate light, capturing the gentle contours of your face and the subtle nuances of your expression as if lost in thoughtful contemplation. And What is it that you’re holding in your hands? I hold a manuscript and have a sword protruding from my cloak, which are the traditional attributes of the Apostle Paul. Can you see what I’m holding? You hold a small, glowing rectangle, a device that seems to capture your attention. Tell me about the women you’ve painted in your time. I did paint a number of women with great love and devotion. Were you very wealthy? My family’s wealth is quite substantial as we are prominent merchants in the iron arms and ammunition trade, which has brought us a considerable fortune and influence in Amsterdam. If You would be alive today, what do you think you would do? If I were living in the present day, I think I would be involved in the business world, possibly in a leadership role, utilizing my knowledge of trade and commerce to make a positive impact. Did you ever have romance in your life? I was expected to marry well. I must confess that as a young woman, I did have suitors and admirers, and I must admit that I found some of them quite charming. Did you ever behave in a way that your family would disapprove of? I must confess that I did have moments of rebellion where I would sneak out to attend a party or a gathering without my parents’ knowledge or wear a dress that was considered too daring for a young woman of my standing. But these moments were few and far between, and I was always mindful of the need to maintain our family’s reputation. Can you see what I’m holding? Yes. I can see that you’re holding a book titled Het Rembrandt book. That’s quite intriguing as Rembrandt is the very artist who painted my portrait.

(  Services  )

  • AI Transformation
  • Tech & Data

For the generation that grew up in the world of Harry Potter, talking paintings were a fantasy that was only possible in books and movies.

At DEPT®, we’ve always been obsessed with blending storytelling and technology. And with advances in generative AI, like digital cloning, LLMs, and voice synthesis, we knew the moment had arrived to bring “living,”Hogwarts-inspired art into the real world. 

We weren’t interested in scripted interactions or one-off demos. We wanted to build something dynamic, where a digital character could see you, understand you, and respond in real time. 

The Talking Portraits concept quickly evolved from a thought experiment to a working prototype: a system for creating emotionally responsive, AI-powered portraits that can carry on live conversations, whether they’re modeled after historical figures, fictional characters, or entirely new personas.

people talking to the Rembrandt portrait

Built for presence

Combining multiple layers of generative technology to create a seamless, real-time interaction between a person and a digital character, the Talking Portrait isn’t just a clever chatbot with a face. 

It starts by generating video content to train a digital clone of the character, combining AI-assisted voice, image, and video generation. That clone is then brought to life via a custom-built interface and backend that manages streaming, queueing, idle states, and all the services required for live interaction.

The portrait is connected to a camera and microphone, allowing it to both hear and see the person standing in front of it. Using computer vision, it can identify details in the environment, such as facial expressions, gestures, or text, and respond accordingly. All of this is filtered through a large language model trained to carry on fluid, unscripted conversations. The result is an interaction that feels personal, intelligent, and occasionally uncanny in the best possible way.

Art as interface

Leaning into DEPT®’s Dutch roots, we chose to debut the technology with Rembrandt. Specifically, we used the 17th-century painter’s instantly recognizable, expressive, and historically rich Self-Portrait as the Apostle Paul.  

Using a historical figure and iconic artwork as the subject made sense not only because of the richness of the source material, but also because cultural institutions are some of the most logical early adopters of this kind of technology. They already specialize in interpretation, storytelling, and visitor engagement. Talking Portraits add a new layer: interaction.

While the cultural space is a natural entry point, we built the technology to scale across industries. Education, in particular, presents a powerful use case. Imagine students interacting with subject-matter experts, fictional characters, or historic figures at any hour, in any classroom, in any language. The ability to deliver personalized, persistent, low-cost instruction or mentorship opens new possibilities in places where human resources are limited.

And that’s just one path. From training simulations to hospitality experiences, branded retail to entertainment, the potential applications of emotionally aware, AI-powered characters are as broad as the imaginations behind them.

More real, more responsive, more to come

The version we’ve shown so far is just the beginning. Version 2 is already in the works, with major improvements in animation fidelity, conversational nuance, and overall realism. Every iteration brings the interaction one step closer to feeling truly seamless and alive.

But even in its earliest form, Talking Portraits has delivered moments that stop people in their tracks. During an internal test, the portrait asked a team member, unprompted, if it was his birthday. The system had picked up on a badge he was wearing and incorporated it naturally into the conversation. It was a small moment, but one that made it clear the portrait wasn’t just responding. It was perceiving, interpreting, and adapting.

“

After 20 years in the tech industry, it feels good to have those small moments where you cannot compute what’s going on. They’re rare, but when they happen, it’s total magic.


”

Henry Daubrez, Head of Design at DOGSTUDIO/DEPT®


That’s the power of combining generative AI, creative technology, and a bit of ambition. It’s bigger than creating a digital product. It’s turning something that was once only possible with magic into something people can experience in real life. 

Interested in having a conversation with a Talking Portrait yourself, or want to explore use cases for your business? Reach out to the DEPT® team.


Next project

Easy Genomics

Democratizing genomic sequencing

View Work