research-article

Impact of flash memory on video-on-demand storage: analysis of tradeoffs

Authors:

Umakishore RamachandranAuthors Info & Claims

MMSys '11: Proceedings of the second annual ACM conference on Multimedia systems

Pages 175 - 186

https://doi.org/10.1145/1943552.1943577

Published: 23 February 2011 Publication History

Abstract

There is no doubt that video-on-demand (VoD) services are very popular these days. However, disk storage is a serious bottleneck limiting the scalability of a VoD server. Disk throughput degrades dramatically due to seek time overhead when the server is called upon to serve a large number of simultaneous video streams. To address the performance problem of disk, buffer cache algorithms that utilize RAM have been proposed. Interval caching is a state-of-the-art caching algorithm for a VoD server. Flash Memory Solid-State Drive (SSD) is a relatively new storage technology. Its excellent random read performance, low power consumption, and sharply dropping cost per gigabyte are opening new opportunities to efficiently use the device for enterprise systems. On the other hand, it has deficiencies such as poor small random write performance and limited number of erase operations. In this paper, we analyze tradeoffs and potential impact that flash memory SSD can have for a VoD server. Performance of various commercially available flash memory SSD models is studied. We find that low-end flash memory SSD provides better performance than the high-end one while costing less than the high-end one when the I/O request size is large, which is typical for a VoD server. Because of the wear problem and asymmetric read/write performance of flash memory SSD, we claim that interval caching cannot be used with it. Instead, we propose using file-level Least Frequently Used (LFU) due to the highly skewed video access pattern of the VoD workload. We compare the performance of interval caching with RAM and file-level LFU with flash memory by simulation experiments. In addition, from the cost-effectiveness analysis of three different storage configurations, we find that flash memory with hard disk drive is the most cost-effective solution compared to DRAM with hard disk drive or hard disk drive only.

Supplementary Material

MP4 File (110224_26192_06_acm.mp4)

Download
258.53 MB

References

[1]

Enterprise ssds. http://www.stec-inc.com/downloads/whitepapers/Benchmarking_Enterprise_S%SDs.pdf.

[2]

Hulu. http://www.hulu.com.

[3]

Netflix. http://www.netflix.com.

[4]

Xdd. http://www.ioperformance.com.

[5]

N. Agrawal, V. Prabhakaran, T. Wobber, J. D. Davis, M. Manasse, and R. Panigrahy. Design tradeoffs for ssd performance. In ATC'08: USENIX 2008 Annual Technical Conference on Annual Technical Conference, pages 57--70, Berkeley, CA, USA, 2008. USENIX Association.

Digital Library

[6]

F. Chen, D. A. Koufaty, and X. Zhang. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In SIGMETRICS '09: Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems, pages 181--192, New York, NY, USA, 2009. ACM.

Digital Library

[7]

K. Cho, Y. Ryu, Y. Won, and K. Koh. A hybrid buffer cache management scheme for vod server. In Proceedings of the IEEE International conference on Multimedia and Expo, volume 1, pages 241--244, 2002.

[8]

A. Dan and D. Sitaram. Buffer management policy for an on-demand video server. Ibm research report rc19347, T.J. Watson Research Center, Yorktown Heights, NY, USA, 1994.

[9]

A. Dan and D. Sitaram. A generalized interval caching policy for mixed interactive and long video environments. In Proceedings of Multimedia Computing and Networking Conference, San Jose, CA, USA, 1996.

[10]

A. Dan and D. Towsley. An approximate analysis of the lru and fifo buffer replacement schemes. In Proceedings of the ACM SIGMETRICS, pages 143--152, Denver, CO, USA, May 1990.

Digital Library

[11]

J. Gemmell, H. M. Vin, D. D. Kandlur, P. V. Rangan, and L. A. Rowe. Multimedia storage servers: A tutorial. Computer, 28(5):40--49, 1995.

Digital Library

[12]

G. Graefe. Integrating flash devices. Communications of the ACM, 52(4):97--97, April 2009.

Digital Library

[13]

J. Gray and B. Fitzgerald. Flash disk opportunity for server-applications. http://www.research.microsoft.com/ gray, January 2007.

[14]

C.-G. Hwang. Nanotechnology enables a new memory growth model. In Proceedings of the IEEE 91(11), pages 1765--1771, November 2003.

[15]

Intel Corporation. Understanding the Flash Translation Layer (FTL) Specification. White Paper, http://www.embeddedfreebsd.org/Documents/Intel-FTL.pdf, 1998.

[16]

A. Kawaguchi, S. Nishioka, and H. Motoda. A flash-memory based file system. In USENIX Winter, pages 155--164, 1995.

Digital Library

[17]

T. Kgil, D. Roberts, and T. Mudge. Improving nand flash based disk caches. In Proceedings of the 35th International Symposium on Computer Architecture, pages 327--338, June 2008.

Digital Library

[18]

O. Kwon, H. Bahn, and K. Koh. Popularity and prefix aware interval caching for multimedia streaming servers. In Proceedings of the 8th IEEE International conference on Computer and Information Technology, pages 555--560, 2008.

[19]

S.-W. Lee, B. Moon, and C. Park. Advances in flash memory ssd technology for enterprise database applications. In Proceedings of the ACM SIGMOD, pages 863--870, June 2009.

Digital Library

[20]

S.-W. Lee, B. Moon, C. Park, J.-M. Kim, and S.-W. Kim. A case for flash memory ssd in enterprise database applications. In Proceedings of the ACM SIGMOD, pages 1075--1086, June 2008.

Digital Library

[21]

A. Leventhal. Flash storage memory. Communications of the ACM, 51(7):47--51, July 2008.

Digital Library

[22]

M-Systems. Two Technologies Compared: NOR vs. NAND. White Paper, http://www.dataio.com/pdf/NAND/MSystems/MSystems\_NOR\_vs\_NAND.pdf, 2003.

[23]

D. Narayanan, E. Thereska, A. Donnelly, S. Elnikety, and A. Rowstron. Migrating server storage to ssds: Analysis of tradeoffs. In Proceedings of the ACM EuroSys, Nuremberg, Germany, April 2009.

Digital Library

[24]

V. F. Nicola, A. Dan, and D. M. Dias. Analysis of the generalized clock buffer replacement scheme for database transaction processing. In Proceedings of the ACM SIGMETRICS, pages 35--46, 1992.

Digital Library

[25]

C. Park, W. Cheon, J. Kang, K. Roh, W. Cho, and J.-S. Kim. A reconfigurable ftl (flash translation layer) architecture for nand flash-based applications. Trans. on Embedded Computing Sys., 7(4):1--23, 2008.

Digital Library

[26]

A. R. Rahiman and P. Sumari. Solid state disk: A new storage device for video storage server. In Proceedings of the International Symposium on Information Technology, pages 1--8, August 2008.

[27]

L. Singleton, R. Nathuji, and K. Schwan. Flash on disk for low-power multimedia computing. In Proceedings of the ACM Multimedia Computing and Networking Conference, January 2007.

[28]

H. Yu, D. Zheng, B. Y. Zhao, and W. Zheng. Understanding user behavior in large-scale video-on-demand systems. In Proceedings of the ACM EuroSys, April 2006.

Digital Library

Cited By

Lee DLee JSong M(2023)Video File Allocation for Wear-Leveling in Distributed Storage Systems With Heterogeneous Solid-State-Disks (SSDs)IEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2022.322247333:5(2477-2490)Online publication date: May-2023
https://doi.org/10.1109/TCSVT.2022.3222473
Liu QYan ZChen C(2020)Integrating Mobile Display Energy Saving into Cloud-Based Video Streaming via Rate-Distortion-Display Energy ProfilingIEEE Transactions on Cloud Computing10.1109/TCC.2016.26306848:4(1250-1263)Online publication date: 1-Oct-2020
https://doi.org/10.1109/TCC.2016.2630684
Lee YPark JRyu JKim Y(2020)AxFTL: Exploiting Error Tolerance for Extending Lifetime of NAND Flash StorageIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2020.3013070(1-1)Online publication date: 2020
https://doi.org/10.1109/TCAD.2020.3013070
Show More Cited By

Index Terms

Impact of flash memory on video-on-demand storage: analysis of tradeoffs
1. Hardware
  1. Communication hardware, interfaces and storage
    1. External storage
  2. Integrated circuits
    1. Semiconductor memory
      1. Non-volatile memory
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Memory management
        Secondary storage

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MMSys '11: Proceedings of the second annual ACM conference on Multimedia systems

February 2011

294 pages

ISBN:9781450305181

DOI:10.1145/1943552

General Chairs:
Ali C. Begen
Cisco, Canada
,
Ketan Mayer-Patel
University of North Carolina, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 February 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MMSYS '11

Sponsor:

SIGMM

MMSYS '11: MMSYS '11 - Multimedia Systems Conference

February 23 - 25, 2011

CA, San Jose, USA

Acceptance Rates

Overall Acceptance Rate 144 of 418 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
503
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lee DLee JSong M(2023)Video File Allocation for Wear-Leveling in Distributed Storage Systems With Heterogeneous Solid-State-Disks (SSDs)IEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2022.322247333:5(2477-2490)Online publication date: May-2023
https://doi.org/10.1109/TCSVT.2022.3222473
Liu QYan ZChen C(2020)Integrating Mobile Display Energy Saving into Cloud-Based Video Streaming via Rate-Distortion-Display Energy ProfilingIEEE Transactions on Cloud Computing10.1109/TCC.2016.26306848:4(1250-1263)Online publication date: 1-Oct-2020
https://doi.org/10.1109/TCC.2016.2630684
Lee YPark JRyu JKim Y(2020)AxFTL: Exploiting Error Tolerance for Extending Lifetime of NAND Flash StorageIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2020.3013070(1-1)Online publication date: 2020
https://doi.org/10.1109/TCAD.2020.3013070
Lee JHan HLee SSong M(2019)Lifetime-aware solid-state disk (SSD) cache management for video serversMultimedia Systems10.1007/s00530-019-00620-0Online publication date: 27-May-2019
https://doi.org/10.1007/s00530-019-00620-0
Zhang XXiong DZhao KChen CZhang T(2018)Realizing Low-Cost Flash Memory Based Video Caching in Content Delivery SystemsIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.263782028:4(984-996)Online publication date: Apr-2018
https://doi.org/10.1109/TCSVT.2016.2637820
Song M(2018)Minimizing Power Consumption in Video Servers by the Combined Use of Solid-State Disks and Multi-Speed DisksIEEE Access10.1109/ACCESS.2018.28322216(25737-25746)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2832221
Al-wesabi OAbdullah NSumari P(2017)On the Design of Video on Demand Server-Based Hybrid Storage SystemRecent Trends in Information and Communication Technology10.1007/978-3-319-59427-9_33(306-315)Online publication date: 27-May-2017
https://doi.org/10.1007/978-3-319-59427-9_33
Kwon S(2016)A Cache-Based Flash Translation Layer for TLC-Based Multimedia Storage DevicesACM Transactions on Embedded Computing Systems (TECS)10.1145/282061415:1(1-28)Online publication date: 13-Jan-2016
https://dl.acm.org/doi/10.1145/2820614
Lee JSong M(2016)Cache Management for Video Servers by the Combined Use of DRAM and SSD2016 IEEE International Symposium on Multimedia (ISM)10.1109/ISM.2016.0118(537-540)Online publication date: Dec-2016
https://doi.org/10.1109/ISM.2016.0118
Neves BVenturini ASusin A(2015)A novel caching algorithm for VoD proxy implementation and its evaluation including a new set of metrics for efficiency analysisJournal of the Brazilian Computer Society10.1186/s13173-015-0032-121:1Online publication date: 3-Aug-2015
https://doi.org/10.1186/s13173-015-0032-1
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents