Control Keys

→ move to next slide (also Enter or Spacebar).
← move to previous slide.
 d  enable/disable drawing on slides
 p  toggles between print and presentation view
CTRL  +  zoom in
CTRL  -  zoom out
CTRL  0  reset zoom

Slides can also be advanced by clicking on the left or right border of the slide.

Multimedia Signal Processing

  • Today, information is communicated through a variety of different media
    • Text
    • Photos
    • Audio
    • Video
    • etc.
  • Modern means of communication, such as the Internet, include different types of media and allow the user to receive information interactively or provide user-generated content

Qualification goals of the lecture

  • We focus on auditory and visual media
  • We learn how to understand and evaluate methods for the digital acquisition, processing, storage, and transmission of multimedia data
  • We create content for modern communication media
  • We improve our ability to design and evaluate media
  • We formulate and solve problems using practical examples

Course Structure

  1. Introduction and Organization
  2. Fundamentals and Applications
  3. Introduction to digital signal processing
  4. Digitization of audio, images, and video
  5. Audio effects
  6. Image processing
  7. Compression of images, audio, and video

Lecture

Exercise Class

  • Exercise class (2h per week)
  • Assignments are handed out, which are prepared and followed up in the exercise class (every 1 or 2 weeks)
  • Mondays after the lecture, HS III
  • Tutor: TBA
  • Structure of assignments:
    • Short film / interactive project (in groups of 1 to 4 students)
    • Practical and theoretical questions (everybody individually)
  • The assignments are made available every Friday around 12h00 on ILIAS
  • The first assignment will be available on April 26
  • Submission of the assignments is Fridays 12h00 via ILIAS
  • Submissions after the deadline will not be considered

Exam

  • Admission requirements for the exam:
    • Submission of the finished short film (or interactive project) at the end of the semester
    • Passed 5 out of 7 assignments (passed means ≥ 50%)
    • Important: These rules are strictly enforced

Exam

  • Oral exams
  • Approx. 25 minutes
  • Questions are selected by a random number generator (one question from each chapter)
  • Do not reproduce the exact text from the slides, but try to understand the concept
  • Difficulty of questions is similar to the ones known from the assignments

Exam

  • Registration for the exam takes place from mid-May to around the end of June (exact dates here) via Marvin
  • The oral exams will take place from July 22 to 26, 2024 (the exact dates will be subject to our discussion)
  • Due to the large number of participants, an e-exam will be held on Friday, July 19, 2024 (two time slots at 9:00 a.m. and 10:00 a.m.)
  • The grade for the lecture only depends on the grade in the final examination (i.e., the assignment points are only used for the admission to the exam)
  • 9 ECTS points for passing the exam

Film project

  • Film project: short film of maximum 5 minutes:
    • Development of the idea
    • Find a concept for realization and subsequent usage
    • Planning using script and storyboard
    • Recording the raw footage
    • Film editing and post-processing
    • Incorporate the video in a public or internal website
  • If you publish films with third party content, make sure that you respect the copyrights (this is your personal responsibility)

Film project

  • Hardware to borrow (on a daily basis by appointment)
    • 4K Camcorder Sony FDR-AX33
    • 128 GB SD Card
    • Tripod
    • Microphones
    • Boom pole (3 meters)
    • Light tent
  • Photo and video studio of the graphics and multimedia group (green screen)
  • Film editing software is installed in the photo and video studio
  • Free film editing software, e.g. DaVinci Resolve 18, Hitfilm Express, Shotcut

Alternative: Interactive/Audiovisual Project

  • Free choice of topic
  • Free choice of tools
  • For example:
    • Audiovisual web page (using Canvas, full screen video elements, SVG, WebGL, etc.)
    • Interactive mobile phone app
    • Realtime mobile phone camera filter
    • etc.

Literature

  • B Jähne: Digitale Bildverarbeitung, Springer, 2005, ISBN 978-3540249993
  • P Ackermann: Computer und Musik: Eine Einführung in die digitale Klang- und Musikverarbeitung, Springer, 1991, ISBN 978-3211822913
  • T Strutz: Bilddatenkompression: Grundlagen, Codierung, Wavelets, JPEG, MPEG, H.264, Vieweg+Teubner, 2009, ISBN 978-3834804723
  • A C.. Bovik: Handbook of Image and Video Processing, Academic Press, 2000, ISBN 978-0121197902
  • R. C. Gonzalez, R. E. Woods: Digital Image Processing, Prentice Hall International, 2001, ISBN 978-0132345637
  • D. Taubman, M. Marcellin: JPEG2000 Image Compression, Kluwer Academic Publishers, 2001
  • J Watkinson: The MPEG handbook : MPEG-1, MPEG-2, MPEG-4, Focal Press, 2004, ISBN 978-0240805788
  • I. E. G. Richardson: H.264 and MPEG-4 Video Compression, John Wiley & Sons, 2003, ISBN 978-0470848371
  • B. A. Wandell: Foundations of Vision,Sinauer Associates, 1995, ISBN 978-0878938537

Are there any questions?

questions

Please notify me by e-mail if you have questions, suggestions for improvement, or found typos: Contact

More lecture slides

Slides in German (Folien auf Deutsch)

Legal Notice, Privacy Policy,