Sound Design Lies: Crafting Cinematic Reality | TEDx Talk

[00:00:00]Transcriber: Camille Martínez Reviewer: Ivana Korom I want to skip the introduction.

[00:00:15]I want to start by doing an experiment.

[00:00:19]I'm going to play three videos of a rainy day.

[00:00:23]But I've replaced the audio of one of the videos, and instead of the sound of rain, I've added the sound of bacon frying.

[00:00:33]So I want you think carefully which one the clip with the bacon is.

[00:00:38](Rain falls) (Rain falls) (Rain falls) All right.

[00:00:54]Actually, I lied.

[00:00:56]They're all bacon.

[00:00:58](Bacon sizzles) (Applause) My point here isn't really to make you hungry every time you see a rainy scene, but it's to show that our brains are conditioned to embrace the lies.

[00:01:19]We're not looking for accuracy.

[00:01:22]So on the subject of deception, I wanted to quote one of my favorite authors.

[00:01:28]In "The Decay of Lying," Oscar Wilde establishes the idea that all bad art comes from copying nature and being realistic; and all great art comes from lying and deceiving, and telling beautiful, untrue things.

[00:01:50]So, I want to make this clear - when you're watching a movie and a phone rings, it's not actually ringing.

[00:02:01]It's been added later in postproduction in a studio.

[00:02:05]All of the sounds you hear are fake.

[00:02:08]Everything, apart from the dialogue, is fake.

[00:02:11]Not the only thing that's fake in Hollywood, by the way.

[00:02:14]Laughter) When you watch a movie and you see a bird flapping its wings -- (Wings flap) They haven't really recorded the bird.

[00:02:25]It sounds a lot more realistic if you record a sheet or shaking kitchen gloves.

[00:02:32](Flaps) The burning of a cigarette up close -- (Cigarette burns) It actually sounds a lot more authentic if you take a small Saran Wrap ball and release it.

[00:02:49](A Saran Warp ball being released) Punches?

[00:02:55](Punch) Let me play that again.

[00:02:57](Punch) That's often done by sticking a knife in vegetables, usually cabbage.

[00:03:04](Cabbage stabbed with a knife) The next one - I'm not going to play the video but it's breaking bones.

[00:03:11](Bones break) Well, no one was really harmed.

[00:03:16]It's actually... breaking celery or frozen lettuce.

[00:03:22](Breaking frozen lettuce or celery) (Laughter) Yeah. Thanks to my three friends who are laughing.

[00:03:34]Making the right sounds is not always as easy as a trip to the supermarket and going to the vegetable section.

[00:03:43]But it's often a lot more complicated than that.

[00:03:46]So let's reverse-engineer together the creation of a sound effect.

[00:03:51]One of my favorite stories comes from Frank Serafine.

[00:03:54]He's a contributor to our library, and a great sound designer for "Tron" and "Star Trek" and others.

[00:04:01]He was part of the Paramount team that won the Oscar for best sound for "The Hunt for Red October."

[00:04:08]In this Cold War classic, in the '90s, they were asked to produce the sound of the propeller of the submarine.

[00:04:16]So they had a small problem: they couldn't really find a submarine in West Hollywood.

[00:04:21]So basically, what they did is, they went to a friend's swimming pool, and Frank performed a cannonball.

[00:04:32]They placed an underwater mic and an overhead mic outside the swimming pool.

[00:04:37]We recreated the sound.

[00:04:39]So here's what the underwater mic sounds like.

[00:04:42](Underwater plunge) Adding the overhead mic, it sounded a bit like this: (Water splashes) So now they took the sound and pitched it one octave down, sort of like slowing down a record.

[00:04:58](Water splashes at lower octave) And then they removed a lot of the high frequencies.

[00:05:04](Water splashes) And pitched it down another octave.

[00:05:09](Water splashes at lower octave) And then they added a little bit of the splash from the overhead microphone.

[00:05:17](Water splashes) And by looping and repeating that sound, they got this: (Propeller churns) So, creativity and technology put together in order to create the illusion that we're inside the submarine.

[00:05:39]But once you've created your sounds and you've synced them to the image, you want those sounds to live in the world of the story.

[00:05:50]And one the best ways to do that is to add reverb.

[00:05:54]So this is the first audio tool I want to talk about.

[00:05:58]Reverberation, or reverb, is the persistence of the sound after the original sound has ended.

[00:06:05]So it's sort of like the -- all the reflections from the materials, the objects and the walls around the sound.

[00:06:13]Take, for example, the sound of a gunshot.

[00:06:15]The original sound is less than half a second long.

[00:06:20](Gunshot) By adding reverb, we can make it sound like it was recorded inside a bathroom.

[00:06:28](Gunshot reverbs in bathroom) Or like it was recorded inside a chapel or a church.

[00:06:33](Gunshot reverbs church) Or in a canyon.

[00:06:38](Gunshot reverbs in canyon) So reverb gives us a lot of information about the space between the listener and the original sound source.

[00:06:49]If the sound is the taste, then reverb is sort of like the smell of the sound.

[00:06:56]But reverb can do a lot more.

[00:06:58]Listening to a sound with a lot less reverberation than the on-screen action is going to immediately signify to us that we're listening to a commentator, to an objective narrator that's not participating in the on-screen action.

[00:07:16]Also, emotionally intimate moments in cinema are often heard with zero reverb, because that's how it would sound if someone was speaking inside our ear.

[00:07:26]On the completely other side, adding a lot of reverb to a voice is going to make us think that we're listening to a flashback, or perhaps that we're inside the head of a character or that we're listening to the voice of God.

[00:07:41]Or, even more powerful in film, Morgan Freeman.

[00:07:45](Laughter) So -- (Applause) But what are some other tools or hacks that sound designers use?

[00:07:57]Well, here's a really big one.

[00:08:10]I think some people guessed it.

[00:08:11]It's silence.

[00:08:12]I didn't really forget this part of the talk but I sort of wanted to show that a few moments of silence is going to make us pay attention.

[00:08:20]And in the Western world, we're not really used to verbal silences.

[00:08:25]They're considered awkward or rude.

[00:08:29]So silence preceding verbal communication can create a lot of tension.

[00:08:36]But imagine a really big Hollywood movie, where it's full of explosions and automatic guns.

[00:08:44]Loud stops being loud anymore, after a while.

[00:08:48]So in a yin-yang way, silence needs loudness and loudness needs silence for either of them to have any effect.

[00:08:55]But what does silence mean?

[00:08:56]Well, it depends how it's used in each film.

[00:08:59]Silence can place us inside the head of a character or provoke thought.

[00:09:04]We often relate silences with... contemplation, meditation, being deep in thought.

[00:09:14]But apart from having one meaning, silence becomes a blank canvas upon which the viewer is invited to the paint their own thoughts.

[00:09:24]But I want to make it clear: there is no such thing as silence.

[00:09:28]And I know this sounds like the most pretentious TED Talk statement ever.

[00:09:33](Laughter) But even if you were to enter a room with zero reverberation and zero external sounds, you would still be able to hear the pumping of your own blood.

[00:09:45]And in cinema, traditionally, there was never a silent moment because of the sound of the projector.

[00:09:52]And even in today's Dolby world, there's not really any moment of silence if you listen around you.

[00:09:59]There's always some sort of noise.

[00:10:02]Now, since there's no such thing as silence, what do filmmakers and sound designers use?

[00:10:08]Well, as a synonym, they often use ambiences.

[00:10:13]Ambiences are the unique background sounds that are specific to each location.

[00:10:20]Each location has a unique sound, and each room has a unique sound, which is called room tone.

[00:10:25]So here's a recording of a market in Morocco.

[00:10:28](Voices, music) And here's a recording of Times Square in New York.

[00:10:37](Traffic sounds, car horns, voices) Believe me, it's a lot better to have to listen to Times Square than to have to smell Times Square.

[00:10:49]Room tone is the addition of all the noises inside the room: the ventilation, the heating, the fridge.

[00:10:56]Here's a recording of my apartment in Brooklyn.

[00:11:00][You can hear the ventilation, the boiler, the fridge and street traffic] [(is that an electric toothbrush or just my neighbor having some fun?)]

[00:11:10]Ambiences work in a most primal way.

[00:11:15]They can speak directly to our brain subconsciously.

[00:11:19]So, birds chirping outside your window may indicate normality, perhaps because, as a species, we've been used to that sound every morning for millions of years.

[00:11:33](Birds chirp) On the other hand, industrial sounds have been introduced to us a little more recently.

[00:11:46]Even though I really like them personally -- they've been used by one of my heroes, David Lynch, and his sound designer, Alan Splet -- industrial sounds often carry negative connotations.

[00:11:56](Machine noises) Now, sound effects can tap into our emotional memory.

[00:12:08]Occasionally, they can be so significant that they become a character in a movie.

[00:12:13]They are a lot more low maintenance than some actors, as well.

[00:12:18]For example - The sound of thunder may indicate divine intervention or anger.

[00:12:26](Thunder) Church bells can remind us of the passing of time, or perhaps our own mortality.

[00:12:38](Bells ring) And breaking of glass can indicate the end of a relationship or a friendship.

[00:12:52](Glass breaks) Scientists believe that dissonant sounds, for example, brass or wind instruments played very loud, may remind us of animal howls in nature and therefore create a sense of irritation or fear.

[00:13:13](Brass and wind instruments play) So now we've spoken about on-screen sounds.

[00:13:22]But occasionally, the source of a sound cannot be seen.

[00:13:27]That's what we call offscreen sounds, or "acousmatic."

[00:13:31]The term "acousmatic" comes from Pythagoras in ancient Greece, who used to teach behind a veil or curtain for years, not revealing himself to his disciples.

[00:13:43]I think the mathematician and philosopher thought that, in that way, his students might focus more on the voice, and his words and its meaning, rather than the visual of him speaking.

[00:13:58]So sort of like the Wizard of Oz, or "1984's" Big Brother, separating the voice from its source, separating cause and effect sort of creates a sense of ubiquity or panopticism, and therefore, authority.

[00:14:16]There's a strong tradition of acousmatic sound.

[00:14:20]Nuns in monasteries in Rome and Venice used to sing in rooms up in galleries close to the ceiling, creating the illusion that we're listening to angels up in the sky.

[00:14:34]Richard Wagner famously created the hidden orchestra that was placed in a pit between the stage and the audience.

[00:14:41]And one of my heroes, Aphex Twin, famously hid in dark corners of clubs.

[00:14:47]I think what all these masters knew is that by hiding the source, you create a sense of mystery.

[00:14:53]This has been seen in cinema over and over, with Hitchcock, and Ridley Scott in "Alien."

[00:14:58]Hearing a sound without knowing its source is going to create some sort of tension.

[00:15:05]Also, it can minimize certain visual restrictions that directors have and can show something that wasn't there during filming.

[00:15:14]And if all this sounds a little theoretical, I wanted to play a little video.

[00:15:19](Toy squeaks) (Typewriter) (Drums) (Ping-pong) (Knives being sharpened) (Record scratches) (Saw cuts) (Woman screams) (Laughter) What I'm sort of trying to demonstrate with these tools is that sound is a language.

[00:15:55]It can trick us by transporting us geographically; it can change the mood; it can set the pace; it can make us laugh or it can make us scared.

[00:16:09]On a personal level, I fell in love with that language a few years ago, and somehow managed to make it into some sort of profession.

[00:16:19]And I think with our work through the sound library, we're trying to kind of expand the vocabulary of that language.

[00:16:30]And in that way, we want to offer the right tools to sound designers, filmmakers, and video game and app designers, to keep telling even better stories and creating even more beautiful lies.

[00:16:45]So thanks for listening.

[00:16:46](Applause)