CS5262-Outline-2024

CS5262 Multimedia Networking and Systems, Spring 2024

  • Time: Wednesday 10:10-12:00; Thursday 11:10-12:00
  • Location: Delta 102
  • Instructor: Cheng-Hsin Hsu (chsu@cs.nthu.edu.tw)
  • Office: Delta 643
  • TA: I-Chun Huang (aaron410932@gmail.com)
  • TA Office: Delta 741
  • Office Hour: By appointment

Summary: 

This course consists of two parts. In the first half, we will review the central concept of the broad area of multimedia and networking systems. By doing so, we make sure that all the students are ready to get into the second part, in which they will each study one of the cutting-edge multimedia networking systems, such as 3D content streaming to head-mounted displays, distributed extended reality games, machine-learning-enabled multimedia applications, and media-aware network elements. The goal is to have each student finish a research project/report at the end of the semester.


Course Description: 

This course covers the latest research in the areas of networking and multimedia systems. Despite the basic concepts will be reviewed, the course is a graduate-level course. The course requires students to work on intensive term projects, which last throughout the whole semester (instead of 2 weeks before the semester ends). Students are expected to actively participate in code tracing activities, present their term project progress, and regularly turn in progress reports. At the end of the semester, each student (or team) should have a publishable technical report in order to pass the course.

The lectures will be given in English. All the reports must be written in English.


Textbooks:

  • Li, Drew, and Liu, Fundamentals of Multimedia, 3rd Ed., Springer, 2021 (available online on campus).
  • Kurose and Rose, Computer Networking: A Top-down Approach, 8th Edition, Person, 2022.
  • Giuseppe Valenzise, Martin Alain, Emin Zerman, and Cagri Ozcinar, Immersive Video Technologies, 1st Ed., Academic Press, 2022 (available online on campus).

References:

  • Students will search, print, read, and present the latest search papers under the guidance of the instructor.

Teaching Methods:

  • Lectures given by the instructors to review the basic concepts.
  • Book (Immersive Video Technologies) chapters presented by students.
  • Paper presentations given by students.
  • Participation in an international grand challenge (to substitute the mid-term exam).
  • Completion of the term projects (with final presentations and technical report to substitute the final exam).

Syllabus:

The following tentative topics will be presented by the instructor if not all students are familiar with them already. 

  • Internet Architecture and Services
  • Audio/Video Coding Overview
  • Scalable Video Coding
  • Adaptive Multimedia Streaming
  • Stream Synchronization
  • Streaming to Wireless and Mobile Devices
  • Content-aware Multimedia Streaming and Storage
  • 3D Mobile Video

The following is not an exhausted list of the latest research topic in multimedia networking:

  • Volumetric videos streamed to head mounted displays (3DoF+ or 6DoF)
  • Multimedia Internet-of-Things
  • Media-Aware Network Elements
  • Virtual Reality and Augmented Reality
  • 3D Scene Reconstructions
  • Machine-learning Enabled Multimedia
  • Point Cloud Compression
  • Multimodal Speaker Recognition in Video Conferences
  • Decentralized Social Media

Evaluations:

  • Pop-up Quizzes : 30%
  • Grand Challenge Project: 20%
  • Term Project: 40% 
  • Open-source Contributions: 10%