Reconstructing Pelé’s “lost” goal

We used Google DeepMind technology to reconstruct a lost piece of football history and tell the story of how it all came to life.

On August 2, 1959, Pelé scored the most beautiful goal of his career: three consecutive “sombreros” over defenders and the goalkeeper without the ball ever touching the ground. But the moment was never captured on film.

For over 60 years, the legendary “Gol da Rua Javari” lived in the memories of the fans who were there. Now, in collaboration with Pelé’s family, historians, sports journalists and football legends, we used Google DeepMind technology to reconstruct this piece of football history. The work was created in full partnership with Pelé Brand, the platform responsible for preserving, protecting and expanding Pelé’s legacy, under the leadership of NR Sports.

The “Gol da Rua Javari” reconstruction is presented as a mini-documentary that features interviews with the historians, journalists, Pelé’s family, eyewitnesses and football legends with whom we worked to tell the story of an incredible moment in football history.

“He would be so proud to see all this happening. He’d always say it was a shame that the goal was never recorded. So being able to relive it, with all this technology, is amazing.” — Flávia Kurtz, Pelé’s Daughter

Piecing together a legend

To get the history exactly right, Brazilian historian Anita Lucchesi and her team gathered nearly 2,000 historical records — from blueprints to family albums. They interviewed eyewitnesses, journalists and the Mooca community, using a scale model of the stadium, archival photographs and diagrams to help those who saw the goal reconstruct it from memory.

Video Player

00:00

00:16

Over 3,600 historical images were gathered to accurately reconstruct the goal.

Black and white photo of the famous goal

Historical photograph of the “Gol da Rua Javari”, taken on August 2nd, 1959.

Color image of a historian speaking to the camera

Anita Lucchesi, Historian, UERJ & Arka

Old historical materials about the famous goal

Archival fragments: newspapers, maps, blueprints and family albums

Black and white photo of people playing soccer in Brazil

Historical photograph of the “Estádio da Rua Javari” in the Mooca neighborhood, São Paulo.

Black and white image of soccer team members in Brazil

Members of the Juventus team and staff at the Javari Street Stadium.

Photograph of the Juventus team in 1959

Old newspaper clipping with the text "Gooool" and a diagram of the goal.

Newspaper report of the match and diagram of the goal

Going from the pitch to pixels

Recreating this goal required a combination of practical filmmaking and our most advanced AI models: Veo, Gemini Omni and Nano Banana Pro.

First, our crew shot live-action footage right on the grass of the Rua Javari stadium, using heavy leather balls and period-accurate uniforms. This physical foundation was then fed into our models to begin the digital transformation. We focused on three core technical experiments:

Character replacement: Accurately mapping Pelé’s likeness and his classic number 10 kit onto a modern stunt player.
Environment restyling: Transforming the modern stadium to match the cloudy weather and architecture of that specific day.
Generating the ambiance: showing how fans watching the match at the stadium and listening to the radio broadcast at home experienced the moment.

Side by side image of the original shoes and the digital recreation

Pelé’s original cleats from 1959. Archival photographs and artifacts served as the basis for all AI-generated scenes, ensuring historical accuracy across the film.

Side by side image of an original photograph and a digital recreation

Raphael Herrera, photographer at Javari Stadium in 1959

Side by side images of two elderly men and digital recreations of their younger selves

Angelo Agarelli and Vicente Romano Netto, Juventus’ fans and eyewitnesses of the goal at Javari.

Side by side images of a crowd photo and a digital recreation

Crowds packing Javari Stadium during a Juventus match

Balancing photorealism with performance control

While generative models excel at photorealism, the extreme athletic choreography of a legend like Pelé presents a unique challenge. To solve this, we used Performance Control — an approach based on Veo 3 that extracts precise 3D geometry and motion from a modern stunt player to drive video generation. By pairing this with complementary workflows that use Nano Banana Pro and Gemini Omni, we generated a final video that seamlessly brings together the stadium architecture, field conditions, Pelé’s likeness and the dynamic play.

Video Player

00:00

00:09

Starting with the original live-action video (top-left), we break the scene into separate, editable layers. We capture the athletes’ exact 3D motion (top-right), isolate them from the scenery (bottom-left), and generate a clean background without them (bottom-right). This allows us to modify the players and the environment independently.

Image of a laptop showing different stages of animation

To streamline editing, VFX, and video generation, Gemini Omni and Veo isolated actor footage, extracted the background and generated 3D blue-mesh player movement representations.

Video Player

00:00

00:07

Performance Control creates editable 3D blue mesh renderings from an input video, modifiable using reference images.

Building a hybrid post-production pipeline

To achieve the final polish, we built a hybrid pipeline that combined AI generation with traditional visual effects (VFX). Using custom internal tools, we further refined the AI-generated shots with Gemini Omni and Nano Banana Pro, relying on archival imagery to ensure every detail was accurate. The workflow then moved to traditional VFX for tasks like ball compositing, grain integration, and rigorous color balancing. To ensure the generations looked as period accurate as possible, we ran the digital output through a filmout machine, capturing the distinct look and feel of 1950s cinema.

“The past remains a vast land, where many stories lie dormant, most of them not about famous goals or kings. What this reconstruction taught me is that they, too, might one day see a new light.”

By Anita Lucchesi

Brazilian Historian, UERJ & Arka

Making the invisible, visible

Nothing can substitute the experience of the fans who were there live, but we hope this project gives new life to an iconic moment in football history.

This goal reconstruction is now proudly on display at the Pelé Museum in Santos.

Picture of a child in a Pele jersey at the museum

Museu Pelé, Santos SP, Brazil

On August 2, 1959, Pelé scored the most beautiful goal of his career: three consecutive “sombreros” without the ball touching the ground. Yet, the legendary ‘Gol da Rua Javari’ was never caught on film. We worked alongside historians, sports journalists, football legends, and Pelé’s family to reconstruct this lost moment and share it with the world.

This project was created in full partnership with the Pelé Brand, the official managers of the Pelé estate.

Rooted in education and cultural preservation, the project heads to the Pelé Museum this year. To achieve this, teams from Google DeepMind used models like Gemini Omni and Veo to transform historical fragments into moving imagery, filmed on the original pitch with authentic uniforms and a vintage ball.

By making the memory of this goal more accessible, it stands as a tribute to inspire a new generation of fans during the first World Cup without him.

The goal is on display at the Museu Pelé in Santos, Brazil.

Learn more at https://blog.google/innovation-and-ai…

No dia 2 de agosto de 1959, Pelé marcou o gol mais bonito da sua carreira: três chapéus consecutivos, sem deixar a bola tocar no chão. No entanto, o famoso “Gol da Rua Javari” nunca foi filmado. Em um trabalho em conjunto com historiadores, jornalistas esportivos, lendas do futebol e familiares do Pelé, reconstruímos esse momento antológico do futebol para o mundo todo ver.

Esse projeto foi criado em parceria com a marca Pelé, administradores oficiais do espólio do Rei Pelé.

Com foco em educação e preservação cultural, o projeto segue para o Museu Pelé este ano. Para conseguir isso, equipes do Google DeepMind usaram modelos de IA como Gemini Omni e Veo, para transformar fragmentos históricos em filmes, usando filmagens no campo original com uniformes e bola da época.

Tornar a memória desse gol acessível, é uma forma de homenagem, para inspirar as novas gerações de fãs de futebol, na primeira Copa do Mundo sem o Rei Pelé.

O “Gol da Rua Javari” está em exibição no Museu Pelé, em Santos.

Special thanks to:

Flávia Kurtz, Walter Dias, Pepe, Neymar Jr., Marta, Mauro Beting, Vicente Romano Netto, Angelo Agarelli, Anita Lucchesi, Paulo Monteiro, Santos F.C., C.A. Juventus, NY Cosmos, Museu Pelé, Museu do Futebol

Reconstructing Pelé’s “lost”

Google DeepMind, in partnership with the Pelé Brand, reconstructed the legendary “Gol da Rua Javari” (scored on August 2, 1959). Considered Pelé’s greatest goal, it featured three consecutive sombreros over defenders and a header without the ball touching the ground. It was previously unrecorded, living only in eyewitness memories. [1, 2]

Reconstructing Pelé’s “lost”

The reconstruction was made using artificial intelligence to bridge historical fragments with visual reality. The technical and historical process included:

Eyewitness Accounts: Researchers interviewed historians, sports journalists, members of the Mooca community, and fans who were at the original stadium.
Archival Data: The team collated over 2,000 historical records, using scale models of the Rua Javari stadium, diagrams, and archival photographs to ensure exact spatial and temporal accuracy.
AI Technology: Google utilized frontier models including Gemini Omni to interpret historical data and Veo to generate the video, relying on a technique that grounded the AI in historical facts rather than inventing new content.
Live-Action Shoot: Live footage was shot on the pitch at the original stadium using period-accurate uniforms and heavy leather balls. [3, 4]

To see the documentary and the recreation of the goal, check out Google’s full story:

Read about the process and watch the mini-documentary on the Google DeepMind Blog .
Learn about the behind-the-scenes preservation efforts via Google’s Official Announcement. [2, 3, 4]

If you’d like, I can:Detail the exact movements and technical execution of the three sombreros.Provide more information on how the Veo AI model transforms historical memory into video.Let me know if you want to explore a specific part of this AI reconstruction!

Reconstructing Pelé’s “lost”

The History of the World in 20 Minutes

. How Did Ancient Humans Travel the World?

. Nonprofits empower a nation of problem solvers | Episode 4

The Real Geological History of India

History of the birth of Rail Transport – The Evolution of Railways

. Mystery of Titanic: How The Unsinkable Ship Sink?

. Now available: group conversations with external collaborators in Google Chat

. Waze rolls out new customization features and more Gemini updates

. Optimize your reach and frequency across campaigns with video campaign groups.

. Made to Create | Scott Hansen is Tycho | Adobe

. AI SEO: Writing That’s Specific May Get Cited More