Article

SmartSwitch: blurring the line between network infrastructure & cloud applications

Authors:

Wei Zhang,

Timothy Wood,

K. K. Ramakrishnan,

Jinho HwangAuthors Info & Claims

HotCloud'14: Proceedings of the 6th USENIX conference on Hot Topics in Cloud Computing

Page 11

Published: 17 June 2014 Publication History

Publisher Site

Abstract

A revolution is beginning in communication networks with the adoption of network function virtualization, which allows network services to be run on common off-the-shelf hardware--even in virtual machines--to increase flexibility and lower cost. An exciting prospect for cloud users is that these software-based network services can be merged with compute and storage resources to flexibly integrate all of the cloud's resources.

We are developing an application aware networking platform that can perform not only basic packet switching, but also typical functions left to compute platforms such as load balancing based on application-level state, localized data caching, and even arbitrary computation. Our prototype "memcached-aware smart switch" reduces request latency by half and increases throughput by eight fold compared to Twitter's TwemProxy. We also describe how a Hadoop-aware switch could automatically cache data blocks near worker nodes, or perform some computation directly on the data stream. This approach enables a new breed of application designs that blur the line between the cloud's network and its servers.

References

[1]

Frank Yue, "Network functions virtualization - everything old is new again," http://www.f5.com/pdf/white-papers/service-provider-nfv-white-paper.pdf, 2013.

Google Scholar

[2]

SDN and OpenFlow World Congress-Introductory White Paper, "Network functions virtualisation," http://portal.etsi.org/NFV/NFV_White_Paper.pdf, 2012.

Google Scholar

[3]

Wei Zhang, Jinho Hwang, Timothy Wood, K.K. Ramakrishnan, and Howie Huang, "Load balancing of heterogeneous workloads in memcached clusters," in 9th International Workshop on Feedback Computing (Feedback Computing 14), Philadelphia, PA, June 2014, USENIX Association.

Google Scholar

[4]

Luigi Rizzo, "netmap: A novel framework for fast packet I/O," in Presented as part of the 2012 USENIX Annual Technical Conference, Berkeley, CA, 2012, pp. 101-112, USENIX.

Crossref

Google Scholar

[5]

Jinho Hwang, K.K. Ramakrishnan, and Timothy Wood, "NetVM: high performance and flexible networking using virtualization on commodity platforms," in Symposium on Networked System Design and Implementation (NSDI), Apr. 2014.

Crossref

Google Scholar

[6]

Intel Corporation, "Intel data plane development kit: Getting started guide," 2013.

Google Scholar

[7]

Van Jacobson, Diana K. Smetters, James D. Thornton, Michael F. Plass, Nicholas H. Briggs, and Rebecca L. Braynard, "Networking named content," in Proceedings of the 5th International Conference on Emerging Networking Experiments and Technologies, New York, NY, USA, 2009, CoNEXT '09, p. 112, ACM.

Crossref

Google Scholar

[8]

"Twemproxy: A fast, light-weight proxy for memcached," Feb. 2012, https://blog.twitter.com/2012/twemproxy.

Google Scholar

[9]

Sangjin Han, Keon Jang, KyoungSoo Park, and Sue Moon, "PacketShader: a GPU-accelerated software router," in Proceedings of the ACM SIGCOMM 2010 Conference, New York, NY, USA, 2010, SIGCOMM '10, p. 195206, ACM.

Crossref

Google Scholar

[10]

Guohan Lu, Chuanxiong Guo, Yulong Li, Zhiqiang Zhou, Tong Yuan, Haitao Wu, Yongqiang Xiong, Rui Gao, and Yongguang Zhang, "Serverswitch: A programmable and high performance platform for data center networks," in Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation, Berkeley, CA, USA, 2011, NSDI'11, pp. 2-2, USENIX Association.

Crossref

Google Scholar

[11]

Mihai Dobrescu, Norbert Egi, Katerina Argyraki, Byung-Gon Chun, Kevin Fall, Gianluca Iannaccone, Allan Knies, Maziar Manesh, and Sylvia Ratnasamy, "RouteBricks: exploiting parallelism to scale software routers," in Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles, New York, NY, USA, 2009, SOSP '09, p. 1528, ACM.

Crossref

Google Scholar

[12]

Rajesh Nishtala, Hans Fugal, Steven Grimm, Marc Kwiatkowski, Herman Lee, Harry C. Li, Ryan McElroy, Mike Paleczny, Daniel Peek, and Paul Saab, "Scaling memcache at facebook," in Proceedings of the 10th USENIX conference on Networked Systems Design and Implementation, 2013, p. 385398.

Crossref

Google Scholar

[13]

Michaela Blott, Kimon Karras, Ling Liu, Kees Vissers, Jeremia Br, and Zsolt Istvn, "Achieving 10Gbps line-rate key-value stores with FPGAs," in Presented as part of the 5th USENIX Workshop on Hot Topics in Cloud Computing, Berkeley, CA, 2013, USENIX.

Google Scholar

[14]

Brendan Cully, Jake Wires, Dutch Meyer, Kevin Jamieson, Keir Fraser, Tim Deegan, Daniel Stodden, Geoffre Lefebvre, Daniel Ferstay, and Andrew Warfield, "Strata: High-performance scalable storage on virtualized non-volatile memory," in Proceedings of the 12th USENIX Conference on File and Storage Technologies, Berkeley, CA, 2014, pp. 17-31, USENIX.

Crossref

Google Scholar

Cited By

View all

István ZSidler DAlonso GVukolic MArgyraki KIsaacs R(2016)Consensus in a boxProceedings of the 13th Usenix Conference on Networked Systems Design and Implementation10.5555/2930611.2930639(425-438)Online publication date: 16-Mar-2016
https://dl.acm.org/doi/10.5555/2930611.2930639
Zhang WHwang JRajagopalan SRamakrishnan KWood TMarkopoulou AFaloutsos MSekar VKostic D(2016)FlurriesProceedings of the 12th International on Conference on emerging Networking EXperiments and Technologies10.1145/2999572.2999602(3-17)Online publication date: 6-Dec-2016
https://dl.acm.org/doi/10.1145/2999572.2999602

Index Terms

SmartSwitch: blurring the line between network infrastructure & cloud applications
1. General and reference
  1. Cross-computing tools and techniques
    1. Performance

Index terms have been assigned to the content through auto-classification.

Recommendations

Nosv

nOSV can provide a bare-metal like performance for HPC applications on Cloud.The CPU cores and main memory are not shared among guest VMs of nOSV.Dedicated I/O resources are allocated to I/O sensitive HPC guests.Other virtualization environments can run ...
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16: Proceedings of the12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...
VirtualWire: system support for live migrating virtual networks across clouds
VTDC '13: Proceedings of the 7th international workshop on Virtualization technologies in distributed computing

Despite significant advances in enabling live virtual machine (VM) migration within a virtualized--cloud--infrastructure, cross-cloud live migration remains an ad hoc, complex process. To create a network environment in which live migration can occur, ...

Comments

Information & Contributors

Information

Published In

HotCloud'14: Proceedings of the 6th USENIX conference on Hot Topics in Cloud Computing

June 2014

17 pages

Program Chairs:
Michael A. Kozuch
Intel Labs
,
Minlan Yu
University of Southern California

Publisher

USENIX Association

United States

Publication History

Published: 17 June 2014

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

István ZSidler DAlonso GVukolic MArgyraki KIsaacs R(2016)Consensus in a boxProceedings of the 13th Usenix Conference on Networked Systems Design and Implementation10.5555/2930611.2930639(425-438)Online publication date: 16-Mar-2016
https://dl.acm.org/doi/10.5555/2930611.2930639
Zhang WHwang JRajagopalan SRamakrishnan KWood TMarkopoulou AFaloutsos MSekar VKostic D(2016)FlurriesProceedings of the 12th International on Conference on emerging Networking EXperiments and Technologies10.1145/2999572.2999602(3-17)Online publication date: 6-Dec-2016
https://dl.acm.org/doi/10.1145/2999572.2999602

Abstract

References

Cited By

Index Terms

Recommendations

Nosv

SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices

VirtualWire: system support for live migrating virtual networks across clouds

Comments

Information

Published In

Sponsors

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations