CS5262 Multimedia Networking and Systems, Fall 2021
- Instructor: Cheng-Hsin Hsu (chsu@cs.nthu.edu.tw)
- Time: Mondays 3:30 a.m.-5:20 p.m.; Thursdays 2:20 p.m. – 3:10 p.m.
- Location: Delta 102
- Office Hour: Wednesday 2:00 p.m.-4:00 p.m.
- TA: Tzu-Yi Fan (joyfan2@gmail.com)
- TA Office: EECS 742
- TA Office Hour: By appointment (please send the TA an email)
Summary:
This course covers two types of topics. First, we will review the key concepts of the broad area of multimedia and networks, which will prepare the students to get ready for more advanced topics. Second, we will study the cutting-edge multimedia networking systems, such as 6 Degree-of-Freedom (6DoF) video streaming to Head-Mounted Displays (HMDs), cloud-based Extended Reality (XR) gaming, decentralized social media, and P4 based media-aware network elements. The goal of the course is to have each student finish a term project by the end of the semester.
Course Description:
This course covers the latest research in the areas of networking and multimedia systems. Despite the basic concepts of multimedia networking will be reviewed, the course is a graduate-level course and requires each student to work on an intensive term project. Students are expected to regularly present their project progress and turn in publishable technical reports at the end of the semester, in order to pass the course.
The lectures will be given in English. All the reports must be written in English.
Textbooks:
- Students will search, print, read, and present the latest search papers under the guidance of the instructor.
- Li, Drew, and Liu, Fundamentals of Multimedia, 2nd Ed., Springer, 2014 (available online with an NTHU IP address).
References:
- Kurose and Rose, Computer Networking: A top-down Approach Featuring the Internet, Addison Wesley, 2016.
- Burg, The Science of Digital Media, Pearson Prentice Hall, Inc., 2010 (available online).
- Möller and Raake, Quality of Experience: Advanced Concepts, Applications and Methods, Springer, 2014.
- Jerald, The VR Book, ACM and Morgan & Claypool Publisher, 2016.
Teaching Methods:
Each student will propose and carry out a research project. The expectation for each graduate student is to generate a research paper at the end of the semester. The expectation for each undergraduate student is to generate a report for a well-known multimedia grand-challenge problem; or to produce a good system demo with demo abstract at the end of the semester. Students who do not deliver publishable reports at the end of the semester will receive failing grades.
Syllabus:
The following tentative topics will be presented by the instructor if not all students are familiar with them already.
- Internet Architecture and Services
- Audio/Video Coding Overview
- Scalable Video Coding
- Adaptive Multimedia Streaming
- Stream Synchronization
- Streaming to Wireless and Mobile Devices
- Content-aware Multimedia Streaming and Storage
- 3D Mobile Video
Term Project Topics:
The following is not an exhausted list of the latest research topics in multimedia networking:
- 360-degree Videos to Head-Mounted Displays
- Point Cloud Compression and Streaming
- Point Cloud Error Concealment
- 6-DoF Video Streaming
- 3D Scene Reconstructions
- Intelligent Chatbot: An Integration of VoIP and ML
- Multimedia Internet-of-Things
- Media-Aware Network Elements
- Virtual Reality and Augmented Reality
- Multimodal Speaker Recognition in Video Conferences
- Decentralized Social Media
Evaluations:
- Midterm exam: 30%
- Paper presentations: 20%
- Term paper: 50%
Note that students who do not deliver publishable reports at the end of the semester will receive failed grades.
