Lip sync

from Wikipedia, the free encyclopedia

Under lip synchronization (also Lip sync ) refers to a synchronization technique that is used for the lip movement in a visual medium with the spoken words of an audio track synchronous match.

history

Lip synchronization was used as a technical means in pop music and film production as early as the first half of the 20th century to ensure that viewers did not notice any discrepancies between body and voice.

In Dennis Potter's BBC - TV series Pennies from Heaven from 1978 lip-synching was first no longer hidden but clearly revealed. The series tells how a traveling salesman escapes his agony by diving into the world of music using lip-sync.

Since the advent of MTV and professional music videos in the 1980s, many artists have focused on visual effects instead of live singing on their live shows. Over time, there were more suspicions that singers had not sung live at all.

With the advent of modern video editing software and Web 2.0 , it has become much easier to produce and distribute lip sync videos.

application

music

In music , lip-sync is used to play a pre-recorded voice, during a live performance or a music video of a singer. The singer imitates the lip movement of the song without singing the original voice or does so very quietly.

When playback is meant tuning the image with a sound recording. The pure audio track of a song without the vocals and usually with a fade-in of the lyrics for singing. B. in karaoke format is called the playback version. Singers who audition for another person, films, music videos or other visual productions are therefore also called playback singers or ghost singers (by ghostwriters ). A music video in which the performers move their lips to match the text of the recorded piece of music is known as a lipdub . Musical lip-syncing is particularly popular in Bollywood films. A computer enhanced voice is also known as an auto-tune .

When playing musical instruments there is a similar phenomenon, which is also known as finger synchronization.

Movie and TV

In film production, lip-syncing is often part of the post-production phase . Most films and television series today contain scenes in which the dialogue was subsequently resumed. The technology is mainly used to translate foreign films and TV series into another language by means of voice actors ( dubbing ) and to give animated characters a voice. Vocal interludes were also usually recorded beforehand. As Fandub refers to film or television productions of fans in their own work with a new soundtrack will be provided.

In some productions such as B. Anime series where linguistic synchronization is not economically viable or where the original setting loses its charm due to the translation, a subtitle is used for the translation instead . The lip-synchronization of translated dialogues is made more difficult by the fact that the spoken words and sentences in each language have a different length and do not have the same sentence structure . The translations therefore have to be adapted in some cases. Many anime, animated films and cartoons do without z. B. also on a representation of speech sounds in the mouth movements.

Computer games

For technical reasons, early computer games could not use speech output. In the 1970s and early 1980s , most computer games therefore used simple electronic sounds such as beeps and simulated explosion noises (compare also 8-bit sound / chip tune ). These games contained at most a few generic jaw or mouth movements in order to convey a communication process in addition to the text.

As games gained more and more audio output options in the 1990s and 2000s, lip syncing and voice control have become a major focus of many games.

Network culture

There are also numerous web videos and internet memes in net culture that use this technology.

The most popular platform for lip-syncing videos is TikTok (formerly Musical.ly ). It is especially popular with young people. A similar app is Dubsmash .

One of the best known and oldest lip synchnronization videos on the Internet is "Numa Numa", which was recorded by the American Gary Brolsma and refers to the song Dragostea din tei . It went so viral that it has been parodied on shows like South Park .

technology

Image transfer error

To enable authentic lip synchronization, it is important that there is no time delay and that image and sound run simultaneously and credibly. When transmitting images via terrestrial systems or the Internet , lip synchronization problems can arise if the audio and video tracks do not arrive at the same time. In order to maintain the audience rating and not to hurt customer satisfaction with lip-sync errors during the broadcast, the television industry tries to keep the errors low. In 2015, the SMPTE (Society of Motion Picture and Television Engineers) therefore introduced the ST2064 standard , which offers a technology for greatly reducing or eliminating lip-sync errors in television programs.

Video editing

In video editing, the audio track with the spoken text is compared with the video track. Different video editing software can be used for this.

As a voiceover techniques are commonly referred to, is placed in an audio recording on another video or audio track. Software is to provide artificial intelligence for face recognition and assistance to facilitate lip synchronization.

Reasons for using lip sync

In addition to pure deception for financial or recognition reasons, the use of lip-synching of well-known singers can have various reasons.

For example, the technique is used to allow the singer to focus more on acting , choreography, or some other strong physical or mental performance. A well-known example of this is e.g. B. Michael Jackson , who did this consciously in order to better stage his music videos. Due to the large number of elaborately produced music videos that can be seen on MTV and on the Internet, fans' expectations of the live performance are also increasing. Artists can therefore suffer from stage fright , fear of failure and perfection pressure and use lip-sync as a safety factor.

Sometimes musicians also switch between live singing and lip-syncing, e.g. B. to make difficult and show-intensive parts look more professional.

criticism

The authenticity and credibility of the singers who perform with lip-syncing comes under fire. It has been criticized that when buying an expensive concert ticket, buyers have a right to hear the live voice. Since this is usually not disclosed and there are no real laws for disclosure, z. B. the government of the Australian state of New South Wales to introduce new laws in this regard. Opponents therefore believe that it is better to make musical mistakes than to lie to fans in order to fake a perfect performance.

literature

  • Brian Lemay: Character Animation and Lip Sync. Animated Cartoon Factory

Individual evidence

  1. ^ A b Limor Shifman: Meme: Art, Culture and Politics in the Digital Age . Suhrkamp Verlag, 2014, ISBN 978-3-518-73807-8 ( google.de [accessed on July 5, 2019]).
  2. ^ Peter Epting: Music in Web 2.0: Aesthetic and social aspects . Logos Verlag, Berlin 2013, ISBN 978-3-8325-3539-1 ( google.de [accessed on July 5, 2019]).
  3. ^ Gregory D. Booth: Behind the curtain: making music in Mumbai's film studios . Oxford University Press, Oxford 2008, ISBN 0-19-532763-2 .
  4. ↑ Jordan Runtagh: Watch Your Mouth! The 10 Biggest Lip Syncing Scandals In Music History. January 31, 2014, accessed July 5, 2019 .
  5. ↑ Christine Birner: Film Synchronization: Terminology and Practice . VDM Publishing, 2009, ISBN 978-3-639-20710-1 ( google.de [accessed on July 5, 2019]).
  6. ↑ Carina Wurzinger: The problem of film synchronization: familiar dialogues and strange locations . VDM Publishing, 2010, ISBN 978-3-639-22811-3 ( google.de [accessed on July 5, 2019]).
  7. ^ Brian Lemay: Character Animation and Lip Sync . Brian Lemay, 2009 ( google.de [accessed July 5, 2019]).
  8. ↑ Chris Webster: Animation: The Mechanics of Motion . Taylor & Francis, 2005, ISBN 1-136-13501-4 ( google.de [accessed July 5, 2019]).
  9. ^ Jonathan Cooper: Game Anim: Video Game Animation Explained: A Complete Guide to Video Game Animation . CRC Press, 2019, ISBN 978-1-351-60246-4 ( google.de [accessed July 5, 2019]).
  10. ↑ Alberto Menache: Understanding Motion Capture for Computer Animation and Video Games . Morgan Kaufmann, 2000, ISBN 0-12-490630-3 ( google.de [accessed July 5, 2019]).
  11. ↑ This is why TikTok is so popular with young people. Retrieved July 5, 2019 .
  12. ↑ Götz Bonsen: Gary Brolsma: Ten years of viral video: Numa-Numa-Guy was a star without Youtube | shz.de. Retrieved July 5, 2019 .
  13. ↑ Lip synchronization :: lip sync :: ITWissen.info. Retrieved July 5, 2019 .
  14. ↑ http://www.curtpalme.com/docs/EffectsOfAudioVideoAsynchrony.pdf. (PDF) Retrieved July 5, 2019 .
  15. ↑ IEEE Xplore Search Results. Retrieved July 5, 2019 .
  16. ↑ Christina Deinhardt: Artificial Intelligence: The End of Bad Lip Sync. Retrieved July 5, 2019 .
  17. ^ Ian Inglis: Performance and popular music: history, place and time . Ashgate, Aldershot 2006, ISBN 0-7546-8157-2 .
  18. ^ Edna Gundersen: Style Over Sound: Pop stars take canned music on tour . In: USA Today .
  19. ↑ ABC News: Why Artists Lip-Sync, and How They Get Away With It. Retrieved July 5, 2019 .
  20. ↑ 'Live means live': lip-sync laws loom. Retrieved November 6, 2009, July 5, 2019 (Australian English).
  21. ^ Lip-sync Ethics. (No longer available online.) Archived from the original on December 1, 2016 ; accessed on July 5, 2019 .