CS5262-Outline-2019

CS5262 Multimedia Networking and Systems, Fall 2019

  • Instructor: Cheng-Hsin Hsu (chsu@cs.nthu.edu.tw)
  • Time: Tuesdays 11:10 a.m.-12:00 p.m.; Thursdays 10:10 a.m. – 12:00 p.m.
  • Location: Delta 106
  • Office Hour: By email appointment
  • TA: TBD
  • TA Office Hour: By email appointment

Summary: 

This course consists of two parts. In the first half, we will review the main concept of the broad area of multimedia and networking system. This is to make sure that all the students are ready to get into the second part, in which they will study one of the cutting-edge multimedia networking system, such as 360-degree video streaming to head-mounted display, decentralized social media, and P4 based Media-Aware Network Elements. The goal is to have each student finish a research project/report at the end of the semester.


Course Description: 

This course covers the latest research in the areas of networking and multimedia systems. Despite the basic concepts of multimedia networking will be reviewed, the course is a graduate-level course and requires each student to work on an intensive term project. Students are expected to regularly present their project progress and turn in publishable technical reports, in order to pass the course.

The lectures will be given in English. All the reports must be in English.


Textbooks:

  • Students will search, print, read, and present the latest search papers under the guidance of the instructor. 
  • Möller and Raake, Quality of Experience: Advanced Concepts, Applications and Methods, Springer, 2014. 
  • Jerald, The VR Book, ACM and Morgan & Claypool Publisher, 2016.

References:

  • Kurose and Rose, Computer Networking: A top-down Approach Featuring the Internet, Addison Wesley, 2016.
  • Schaar and Chou, Multimedia over IP and Wireless Networks: Compression, Networking, and Systems, Elsevier, 2007.
  • Li and Drew, Fundamentals of Multimedia, Pearson Education, 2004.
  • Steinmetz and Nahrstedt, Multimedia Systems, Springer, 2004.
  • Wang, Ostermann, Zhang, Video Processing and Communications, Prentice Hall, 2002.

Teaching Methods:

Each student will propose and carry out a research project. The expectation for each graduate student is to generate a research paper at the end of the semester. The expectation for each undergraduate student is to generate a report for a well-known multimedia grand-challenge problem; or to produce a good system demo with demo abstract at the end of the semester. Students who do not deliver publishable reports at the end of the semester will receive failing grades.  


Syllabus:

The following tentative topics will be presented by the instructor if not all students are familiar with them already. 

  • Internet Architecture and Services
  • Audio/Video Coding Overview
  • Scalable Video Coding
  • Adaptive Multimedia Streaming
  • Stream Synchronization
  • Streaming to Wireless and Mobile Devices
  • Content-aware Multimedia Streaming and Storage
  • 3D Mobile Video

Term Project Topics:

The following is not an exhausted list of the latest research topics in multimedia networking:

  • 360-degree videos and head-mounted displays
  • Multimedia Internet-of-Things
  • Media-Aware Network Elements
  • Virtual Reality and Augmented Reality
  • 3D Scene Reconstructions
  • Point Cloud Compression
  • Multimodal Speaker Recognition in Video Conferences
  • Decentralized Social Media

Evaluations:

  • Quizzes (10 times): 20%
  • Paper and book chapter presentation and discussions: 30%
  • Term paper: 50% 

Note that students who do not deliver publishable reports at the end of the semester will receive failed grades.