Vatican, Microsoft unveil AI-generated 'digital twin' of St. Peter's

To enrich people's experience of the Holy Year either in Rome or at home, the Vatican has partnered with Microsoft to create an AI-powered "digital twin" of St. Peter's Basilica, offering immersive virtual views, a new app and interactive features starting Dec. 1.

A high-resolution image of a scene inside St. Peter's Basilica is projected on top of a cement cupola during an immersive exhibit at the Vatican on Nov. 11, 2024. Microsoft and Iconem supported the exhibit. (CNS photo/Carol Glatz)

VATICAN CITY (CNS) -- Aimed at reaching out to people unable to go to Rome for the Holy Year and helping the millions who are expected to visit St. Peter's Basilica, the Vatican teamed up with Microsoft and other specialized experts to create a "digital twin" of the church for an immersive and more meaningful experience.

St. Peter's Basilica will be launching a new website to feature the virtual views, streaming services of religious celebrations and podcasts of prayerful meditations as well as an app Dec. 1, that will help visitors with suggested itineraries, audio guides and real-time updates about the lines to the Holy Door and other sites.

Also, in January, young students around the world will be able to explore the basilica on Microsoft's game-based learning platform, Minecraft Education.

gambetti — Cardinal Mauro Gambetti, archpriest of St. Peter's Basilica, speaks at a news conference at the Vatican Nov. 11, 2024. (CNS photo/Justin McLellan)

The multiple projects use AI technology to help people weave together the historical, artistic and spiritual meanings connected with the world's largest church, Cardinal Mauro Gambetti, archpriest of the basilica, told reporters at a Vatican news conference Nov. 11.

The "digital ecosystem," he said, will accompany visitors and help them have a more spiritual experience.

The cardinal said the idea to create the new services emerged when he and Brad Smith, president of Microsoft, were admiring Michelangelo's La Pieta' statue together in the basilica in 2022 and decided it would be important to share the meaning of these ancient and important works of art in a way that is "understandable and accessible" to more people.

Smith said it also flowed from the fact the tech giant has been working closely with Vatican officials since 2018 starting with the "Rome Call for AI Ethics," a commitment by global organizations to follow key ethical principles in today's emerging technologies.

The tech company's "AI for Good" lab uses AI to model and create digital representations of any physical body, be it a factory, a building or an entire city. And "Microsoft had done similar work elsewhere in Europe," he said, by creating a 3D-holographic form of France's Mont-Saint-Michel.

brad smith — Brad Smith, president of Microsoft, speaks at a news conference at the Vatican Nov. 11, 2024. (CNS photo/Justin McLellan)

Working with Iconem, a French startup specializing in the digitization of important cultural sites in 3D, experts used cameras, laser scanners and two drones for one month in 2023 to capture almost half a million high-resolution images of St. Peter's Basilica, Smith said.

They collected 22 terabytes of data, which would need almost 5,000 DVDs to record all that data. To comprehend what 5,000 DVDs look like, they would be more than 18 feet (5.62 meters) high if stacked one on top of another -- about the height of a two-story building.

Sophisticated AI technology was used to piece all those photos together, he said. The tech is so new that it was not available even two and a half years ago "when we started talking about this project."

The result is viewers can explore the basilica from top to bottom, getting closeup looks even of St. Peter's tomb below, and workers at the basilica can identify previously unseen cracks, missing tiles or other potential repairs needing attention, Smith said.

The basilica will also be offering two new immersive exhibits. One is on the roof of the basilica in which high-resolution images of the basilica are cast on the cement dome of the cupola and the other is along the windowed corridor looking over the interior of the basilica showing a series of images about the history of the church, which will be celebrating the 400th anniversary of its consecration in 1626 after construction began in 1506.

The exhibit also features testimonies written in pencil on the walls by basilica workers from the past who would launch themselves from the upper floors by rope in order to rappel down to do cleaning and restoration work on the mosaics and frescos below.

Correction: An earlier version of this story reported a misstatement made by Brad Smith about the amount of image data gathered during the project. The correct amount is 22 terabytes, not 20 petabytes. That number and how many DVDs it would take to record that data have been corrected Dec. 3, 2024.

CATHOLIC NEWS SERVICE

With its Rome bureau founded in 1950, Catholic News Service has been providing complete, in-depth coverage of the popes and the Vatican for more than 70 years. CNS Rome continues to be your fair, faithful and informed connection to the Holy See.

Have a question or comment? Click here to reach out

I agree that the data I provided to complete this transaction may be used for that purpose and used and stored for USCCB's inventory records and to evaluate interest in USCCB's web pages. I further agree to receive email communications about USCCB goods, services and information. I have read the Privacy Policy and agree to its terms.