What is this?
This website contains the project we have completed in our Digital Signal Processing course at the University of Michigan. In this project, we have attempted to emulate Shazam, an application that has fascinated us since its release. However, instead of detecting music, our application aims to detect films. Thus, we have called our work a “Video Shazam”. Our program can process a video that has noise, create a fingerprint for it, and with this fingerprint, give back corresponding information about the film.
We have developed an algorithm that creates a video fingerprint given a MP4 video. We have created a database with fingerprints of movie scenes. The program receives a film scene with some noise, creates a fingerprint of that video and calculates the best match for the database fingerprints. An output of the name of the film, and some other related information is then given. The algorithm is explained in the Fingerprint algorithm page.
Film scenes
Here our data is presented. At the moment, we have four film scenes in our database, 30 seconds each: The Godfather, Full Metal Jacket, Blade Runner and Reservoir Dogs
Film database
Title: Full Metal Jacket
Director: Stanley Kubrick
Actors: Matthew Modine, Adam Baldwin, Vincent D'Onofrio, R. Lee Ermey, Dorian Harewood, Arliss Howard, Kevin Major Howard and Ed O'Ross
Genre: War
Country: United Kingdom and United States
Title: Blade Runner
Director: Riddley Scott
Actors: Harrison Ford, Rutger Hauer, Sean Young, and Edward James Olmos
Genre: Science Fiction
Country: United States
Title: Reservoir Dogs
Director: Quentin Tarantino
Actors: Harvey Keitel, Tim Roth, Chris Penn, Steve Buscemi, Lawrence Tierney and Michael Madsen
Genre: Black Comedy, crime thriller
Country: United States
Title: The Godfather
Director: Francis Ford Coppola
Actors: Marlon Brando, Al Pacino, James Caan, Richard Castellano, Robert Duvall, Sterling Hayden, John Marley, Richard Conte and Diane Keaton
Genre: Crime
Country: United States
FULL METAL JACKET
BLADE RUNNER
RESERVOIR DOGS
THE GODFATHER
The app
We have created the first version of the app, called Video Shazam. At the moment it is a Matlab GUI and you need to executed in the same file as the videos that you want to test. You can see the image of the app (Figure 1). You have to select whether you want to add a video recorded with the cellphone, or just try to add random, gaussian or lighting variance to the video. The answer will be the data of the video the program thinks you are testing.
Video Shazam application
Who are we?
We are Josu Etxezarreta Martinez and Iñigo Jauregi Unanue, two Senior Electrical Engineers from the Basque Country, Spain. We are students in Tecnun-University of Navarra but right now we are on an exchange program at the University of Michigan. We are both interested in films and Signal Processing. In this project, we have combined both of our passions into one work.
Iñigo Jauregi Unanue
Josu Etxezarreta Martinez