publications

2023

1. CVPR

   AccelIR: Task-aware Image Compression for Accelerating Neural Restoration

   Juncheol Ye,  Hyunho Yeo, Jinwoo Park, and Dongsu Han

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Jun 2023
2. HotStorage

   Neural Cloud Storage: Innovative Cloud Storage Solution for Cold Video

   Jinyeong Lim, Juncheol Ye, Jaehong Kim, Hwijoon Lim,  Hyunho Yeo, and Dongsu Han

   In Proceedings of the 15th ACM Workshop on Hot Topics in Storage and File Systems Jul 2023
3. HotStorage

   SAND: A Storage Abstraction for Video-based Deep Learning

   Uitaek Hong, Hwijoon Lim,  Hyunho Yeo, Jinwoo Park, and Dongsu Han

   In Proceedings of the 15th ACM Workshop on Hot Topics in Storage and File Systems Jul 2023

2022

1. SIGCOMM

   NeuroScaler: Neural Video Enhancement at Scale

   Hyunho Yeo, Hwijoon Lim, Jaehong Kim, Youngmok Jung, Juncheol Ye, and Dongsu Han

   In Proceedings of the ACM SIGCOMM 2022 conference Aug 2022

2020

1. MobiCom

   NEMO: Enabling Neural-Enhanced Video Streaming on Commodity Mobile Devices

   Hyunho Yeo, Chan Ju Chong, Youngmok Jung, Juncheol Ye, and Dongsu Han

   In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking Aug 2020

   Abs PDF Website

   The demand for mobile video streaming has experienced tremendous growth over the last decade. However, existing methods of video delivery fall short of delivering high-quality video. Recent advances in neural super-resolution have opened up the possibility of enhancing video quality by leveraging client-side computation. Unfortunately, mobile devices cannot benefit from this because it is too expensive in computation and power-hungry.To overcome the limitation, we present NEMO, a system that enables real-time video super-resolution on mobile devices. NEMO applies neural super-resolution to a few select frames and transfers the outputs to benefit the remaining frames. The frames to which super-resolution is applied are carefully chosen to maximize the overall quality gains. NEMO leverages fine-grained dependencies using information from the video codec and strives to provide guarantees in the quality degradation compared to per-frame super-resolution. Our evaluation using a full system implementation on Android shows NEMO improves the overall processing throughput by x11.5, reduces energy consumption by 88.6%, and maintains device temperatures at acceptable levels compared to per-frame super-resolution, while ensuring high video quality. Overall, this leads to a 31.2% improvement in quality of experience for mobile users.

2. SIGCOMM

   Neural-Enhanced Live Streaming: Improving Live Video Ingest via Online Learning

   Jaehong Kim^, Youngmok Jung^,  Hyunho Yeo, Juncheol Ye, and Dongsu Han

   In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication Aug 2020

   Abs PDF Website

   Live video accounts for a significant volume of today’s Internet video. Despite a large number of efforts to enhance user quality of experience (QoE) both at the ingest and distribution side of live video, the fundamental limitations are that streamer’s upstream bandwidth and computational capacity limit the quality of experience of thousands of viewers.To overcome this limitation, we design LiveNAS, a new live video ingest framework that enhances the origin stream’s quality by leveraging computation at ingest servers. Our ingest server applies neural super-resolution on the original stream, while imposing minimal overhead on ingest clients. LiveNAS employs online learning to maximize the quality gain and dynamically adjusts the resource use to the real-time quality improvement. LiveNAS delivers high-quality live streams up to 4K resolution, outperforming WebRTC by 1.96 dB on average in Peak-Signal-to-Noise-Ratio on real video streams and network traces, which leads to 12%-69% QoE improvement for live stream viewers.

2018

1. OSDI

   Neural Adaptive Content-aware Internet Video Delivery

   Hyunho Yeo, Youngmok Jung, Jaehong Kim, Jinwoo Shin, and Dongsu Han

   In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) Oct 2018

   Abs PDF Website

   Internet video streaming has experienced tremendous growth over the last few decades. However, the quality of existing video delivery critically depends on the bandwidth resource. Consequently, user quality of experience (QoE) suffers inevitably when network conditions become unfavorable. We present a new video delivery framework that utilizes client computation and recent advances in deep neural networks (DNNs) to reduce the dependency for delivering high-quality video. The use of DNNs enables us to enhance the video quality independent to the available bandwidth. We design a practical system that addresses several challenges, such as client heterogeneity, interaction with bitrate adaptation, and DNN transfer, in enabling the idea. Our evaluation using 3G and broadband network traces shows the proposed system outperforms the current state of the art, enhancing the average QoE by 43.08% using the same bandwidth budget or saving 17.13% of bandwidth while providing the same user QoE.

2017

1. HotNets

   How Will Deep Learning Change Internet Video Delivery?

   Hyunho Yeo, Sunghyun Do, and Dongsu Han

   In Proceedings of the 16th ACM Workshop on Hot Topics in Networks Oct 2017

   Abs PDF

   Much effort has been put into video delivery infrastructure for scaling video delivery and enhancing quality of experience. Existing designs successfully combine traditional systems and networking approaches to achieve the goals. This paper explores unforeseen opportunities enabled by recent advances in deep learning. Traditional video delivery relies on standard signal processing, while deep neural networks (DNNs) present unprecedented ways in handling images and video data. In particular, leveraging deep neural networks opens up new possibilities in exploiting long-term redundancies found in video. Based on this observation, we show multiple case studies that showcase how content delivery infrastructure can utilize DNNs to effectively enhance the video quality at reduced bandwidth overhead. We examine its implications on video delivery by exploring the design space for DNN-based content-aware video delivery. Finally, we quantify the potential benefit and overhead of the design through proof-of-concept evaluation on real video.