research-article

Public Access

Optimizing Bulk Transfers with Software-Defined Optical WAN

Authors:

Jennifer RexfordAuthors Info & Claims

SIGCOMM '16: Proceedings of the 2016 ACM SIGCOMM Conference

Pages 87 - 100

https://doi.org/10.1145/2934872.2934904

Published: 22 August 2016 Publication History

Abstract

Bulk transfer on the wide-area network (WAN) is a fundamental service to many globally-distributed applications. It is challenging to efficiently utilize expensive WAN bandwidth to achieve short transfer completion time and meet mission-critical deadlines. Advancements in software-defined networking (SDN) and optical hardware make it feasible and beneficial to quickly reconfigure optical devices in the optical layer, which brings a new opportunity for traffic management on the WAN.

We present Owan, a novel traffic management system that optimizes wide-area bulk transfers with centralized joint control of the optical and network layers. \sysname can dynamically change the network-layer topology by reconfiguring the optical devices. We develop efficient algorithms to jointly optimize optical circuit setup, routing and rate allocation, and dynamically adapt them to traffic demand changes. We have built a prototype of Owan with commodity optical and electrical hardware. Testbed experiments and large-scale simulations on two ISP topologies and one inter-DC topology show that \sysname completes transfers up to 4.45x faster on average, and up to 1.36x more transfers meet their deadlines, as compared to prior methods that only control the network layer.

Supplementary Material

MP4 File (p87.mp4)

Download
249.38 MB

References

[1]

S. Jain, A. Kumar, S. Mandal, J. Ong, L. Poutievski, A. Singh, S. Venkata, J. Wanderer, J. Zhou, M. Zhu, J. Zolla, U. Hölzle, S. Stuart, and A. Vahdat, “B4: Experience with a globally-deployed software defined WAN,” in ACM SIGCOMM, August 2013.

Digital Library

[2]

C.-Y. Hong, S. Kandula, R. Mahajan, M. Zhang, V. Gill, M. Nanduri, and R. Wattenhofer, “Achieving high utilization with software-driven WAN,” in ACM SIGCOMM, August 2013.

Digital Library

[3]

S. Kandula, I. Menache, R. Schwartz, and S. R. Babbula, “Calendaring for wide area networks,” in ACM SIGCOMM, August 2014.

Digital Library

[4]

H. Zhang, K. Chen, W. Bai, D. Han, C. Tian, H. Wang, H. Guan, and M. Zhang, “Guaranteeing deadlines for inter-datacenter transfers,” in EuroSys, April 2015.

Digital Library

[5]

“Internet2.” http://www.internet2.edu.

[6]

A. L. Chiu, G. Choudhury, G. Clapp, R. Doverspike, M. Feuer, J. W. Gannett, J. Jackel, G. T. Kim, J. G. Klincewicz, T. J. Kwon, et al., “Architectures and protocols for capacity efficient, highly dynamic and highly resilient core networks,” IEEE/OSA Journal of Optical Communications and Networking, vol. 4, pp. 1–14, January 2012.

[7]

N. Farrington, G. Porter, S. Radhakrishnan, H. H. Bazzaz, V. Subramanya, Y. Fainman, G. Papen, and A. Vahdat, “Helios: A hybrid electrical/optical switch architecture for modular data centers,” in ACM SIGCOMM, August 2010.

Digital Library

[8]

G. Wang, D. G. Andersen, M. Kaminsky, K. Papagiannaki, T. Ng, M. Kozuch, and M. Ryan, “c-Through: Part-time optics in data centers,” in ACM SIGCOMM, August 2010.

Digital Library

[9]

K. Chen, A. Singla, A. Singh, K. Ramachandran, L. Xu, Y. Zhang, X. Wen, and Y. Chen, “OSA: An optical switching architecture for data center networks with unprecedented flexibility,” in USENIX NSDI, April 2012.

Digital Library

[10]

N. Hamedazimi, Z. Qazi, H. Gupta, V. Sekar, S. R. Das, J. P. Longtin, H. Shah, and A. Tanwer, “FireFly: A reconfigurable wireless data center fabric using free-space optics,” in ACM SIGCOMM, August 2014.

Digital Library

[11]

K. Chen, X. Wen, X. Ma, Y. Chen, Y. Xia, C. Hu, Q. Dong, and Y. Liu, “WaveCube: A scalable, fault-tolerant, high-performance optical data center architecture,” in IEEE INFOCOM, April 2015.

[12]

“Infinera ROADM Specification.” http://tinyurl.com/jjog6no.

[13]

“Oclaro WSS.” http://tinyurl.com/hotq4s3.

[14]

D. Xu, G. Li, B. Ramamurthy, A. Chiu, D. Wang, and R. Doverspike, “On provisioning diverse circuits in heterogeneous multi-layer optical networks,” Computer Communications, vol. 36, no. 6, pp. 689–697, 2013.

Digital Library

[15]

B. G. Bathula, R. K. Sinha, A. L. Chiu, M. D. Feuer, G. Li, S. L. Woodward, W. Zhang, R. Doverspike, P. Magill, and K. Bergman, “Constraint routing and regenerator site concentration in roadm networks,” IEEE/OSA Journal of Optical Communications and Networking, vol. 5, pp. 1202–1214, November 2013.

[16]

M. Alizadeh, S. Yang, M. Sharif, S. Katti, N. McKeown, B. Prabhakar, and S. Shenker, “pFabric: Minimal near-optimal datacenter transport,” in ACM SIGCOMM, August 2013.

Digital Library

[17]

S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, “Optimization by simulated annealing,” Science, vol. 220, pp. 671–680, May 1983.

[18]

M. A. Bonuccelli and M. C. Clò, “Scheduling of real-time messages in optical broadcast-and-select networks,” IEEE/ACM Transactions on Networking, vol. 9, pp. 541–552, October 2001.

Digital Library

[19]

X. Jin, H. H. Liu, R. Gandhi, S. Kandula, R. Mahajan, M. Zhang, J. Rexford, and R. Wattenhofer, “Dynamic scheduling of network updates,” in ACM SIGCOMM, August 2014.

Digital Library

[20]

M. Chowdhury, Y. Zhong, and I. Stoica, “Efficient coflow scheduling with Varys,” in ACM SIGCOMM, August 2014.

Digital Library

[21]

M. Chowdhury and I. Stoica, “Efficient coflow scheduling without prior knowledge,” in ACM SIGCOMM, August 2015.

Digital Library

[22]

Z. Galil, “Efficient algorithms for finding maximum matching in graphs,” ACM Computing Surveys, vol. 18, pp. 23–38, March 1986.

Digital Library

[23]

“JGraphT Graph Library.” http://jgrapht.org.

[24]

“Floodlight OpenFlow Controller.” http://floodlight.openflowhub.org/.

[25]

D. Applegate and E. Cohen, “Making intra-domain routing robust to changing and uncertain traffic demands: Understanding fundamental tradeoffs,” in ACM SIGCOMM, August 2003.

Digital Library

[26]

B. Fortz and M. Thorup, “Internet traffic engineering by optimizing OSPF weights,” in IEEE INFOCOM, March 2000.

[27]

S. Kandula, D. Katabi, B. Davie, and A. Charny, “Walking the tightrope: Responsive yet stable traffic engineering,” in ACM SIGCOMM, August 2005.

Digital Library

[28]

E. Danna, A. Hassidim, H. Kaplan, A. Kumar, Y. Mansour, D. Raz, and M. Segalov, “Upward max min fairness,” in IEEE INFOCOM, March 2012.

[29]

E. Danna, S. Mandal, and A. Singh, “A practical algorithm for balancing the max-min fairness and throughput objectives in traffic engineering,” in IEEE INFOCOM, March 2012.

[30]

H. H. Liu, S. Kandula, R. Mahajan, M. Zhang, and D. Gelernter, “Traffic engineering with forward fault correction,” in ACM SIGCOMM, 2014.

Digital Library

[31]

A. Kumar, S. Jain, U. Naik, A. Raghuraman, B. Carlin, M. Amarandei-Stavila, M. Robin, A. Siganporia, S. Stuart, and A. Vahdat, “BwE: Flexible, hierarchical bandwidth allocation for WAN distributed computing,” in ACM SIGCOMM, August 2015.

Digital Library

[32]

R. Hartert, S. Vissicchio, P. Schaus, O. Bonaventure, C. Filsfils, T. Telkamp, and P. Francois, “A declarative and expressive approach to control forwarding paths in carrier-grade networks,” in ACM SIGCOMM, August 2015.

Digital Library

[33]

B. B. Chen and P. V.-B. Primet, “Scheduling deadline-constrained bulk data transfers to minimize network congestion,” in IEEE CCGRID, May 2007.

Digital Library

[34]

K. Rajah, S. Ranka, and Y. Xia, “Advance reservations and scheduling for bulk transfers in research networks,” IEEE Transactions on Parallel and Distributed Systems, vol. 20, pp. 1682–1697, November 2009.

Digital Library

[35]

N. Laoutaris, M. Sirivianos, X. Yang, and P. Rodriguez, “Inter-datacenter bulk transfers with NetStitcher,” in ACM SIGCOMM, August 2011.

Digital Library

[36]

H. H. Liu, R. Viswanathan, M. Calder, A. Akella, R. Mahajan, J. Padhye, and M. Zhang, “Efficiently delivering online services over integrated infrastructure,” in USENIX NSDI, March 2016.

Digital Library

[37]

D. G. Andersen, A. C. Snoeren, and H. Balakrishnan, “Best-path vs. multi-path overlay routing,” in ACM SIGCOMM Conference on Internet Measurement Conference, October 2003.

Digital Library

[38]

Z. Li and P. Mohapatra, “QRON: QoS-aware routing in overlay networks,” vol. 22, no. 1, pp. 29–40, 2004.

Digital Library

[39]

Y. Liu, H. Zhang, W. Gong, and D. Towsley, “On the interaction between overlay routing and underlay routing,” in IEEE INFOCOM, March 2005.

[40]

M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat, “Hedera: Dynamic flow scheduling for data center networks.,” in USENIX NSDI, April 2010.

Digital Library

[41]

T. Benson, A. Anand, A. Akella, and M. Zhang, “MicroTE: Fine grained traffic engineering for data centers,” in ACM CoNEXT, December 2011.

Digital Library

[42]

A. R. Curtis, J. C. Mogul, J. Tourrilhes, P. Yalagandula, P. Sharma, and S. Banerjee, “DevoFlow: Scaling flow management for high-performance networks,” in ACM SIGCOMM, August 2011.

Digital Library

[43]

Z. Shao, X. Jin, W. Jiang, M. Chen, and M. Chiang, “Intra-data-center traffic engineering with ensemble routing,” in IEEE INFOCOM, April 2013.

[44]

X. Wu and X. Yang, “Dard: Distributed adaptive routing for datacenter networks,” in IEEE ICDCS, June 2012.

Digital Library

[45]

S. Radhakrishnan, M. Tewari, R. Kapoor, G. Porter, and A. Vahdat, “Dahu: Commodity switches for direct connect data center networks,” in ACM/IEEE Symposium on Architectures for Networking and Communications Systems, October 2013.

Digital Library

[46]

M. Alizadeh, T. Edsall, S. Dharmapurikar, R. Vaidyanathan, K. Chu, A. Fingerhut, V. T. Lam, F. Matus, R. Pan, N. Yadav, and G. Varghese, “CONGA: Distributed congestion-aware load balancing for datacenters,” in ACM SIGCOMM, August 2014.

Digital Library

[47]

M. Alizadeh, A. Greenberg, D. A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, and M. Sridharan, “Data center TCP (DCTCP),” in ACM SIGCOMM, August 2011.

Digital Library

[48]

C. Wilson, H. Ballani, T. Karagiannis, and A. Rowtron, “Better never than late: Meeting deadlines in datacenter networks,” in ACM SIGCOMM, August 2011.

Digital Library

[49]

B. Vamanan, J. Hasan, and T. Vijaykumar, “Deadline-aware datacenter TCP (D2TCP),” in ACM SIGCOMM, August 2012.

Digital Library

[50]

D. Zats, T. Das, P. Mohan, D. Borthakur, and R. Katz, “DeTail: Reducing the flow completion time tail in datacenter networks,” in ACM SIGCOMM, August 2012.

Digital Library

[51]

C.-Y. Hong, M. Caesar, and P. Godfrey, “Finishing flows quickly with preemptive scheduling,” in ACM SIGCOMM, August 2012.

Digital Library

[52]

J. Perry, A. Ousterhout, H. Balakrishnan, D. Shah, and H. Fugal, “Fastpass: A centralized zero-queue datacenter network,” in ACM SIGCOMM, August 2014.

Digital Library

[53]

W. Bai, L. Chen, K. Chen, D. Han, C. Tian, and H. Wang, “Information-agnostic flow scheduling for commodity data centers,” in USENIX NSDI, May 2015.

Digital Library

[54]

H. Ballani, P. Costa, T. Karagiannis, and A. Rowstron, “Towards predictable datacenter networks,” in ACM SIGCOMM, August 2011.

Digital Library

[55]

V. Jeyakumar, M. Alizadeh, D. Mazières, B. Prabhakar, C. Kim, and A. Greenberg, “EyeQ: Practical network performance isolation at the edge,” in USENIX NSDI, April 2013.

Digital Library

[56]

L. Popa, P. Yalagandula, S. Banerjee, J. C. Mogul, Y. Turner, and J. R. Santos, “ElasticSwitch: Practical work-conserving bandwidth guarantees for cloud computing,” in ACM SIGCOMM, August 2013.

Digital Library

[57]

J. Lee, Y. Turner, M. Lee, L. Popa, S. Banerjee, J.-M. Kang, and P. Sharma, “Application-driven bandwidth guarantees in datacenters,” in ACM SIGCOMM, August 2014.

Digital Library

[58]

K. C. Guan, Cost-effective optical network architecture: A joint optimization of topology, switching, routing and wavelength assignment. PhD thesis, Massachusetts Institute of Technology, February 2007.

[59]

A. Brzezinski and E. Modiano, “Dynamic reconfiguration and routing algorithms for IP-over-WDM networks with stochastic traffic,” Journal of Lightwave Technology, vol. 23, pp. 3188–3205, October 2005.

[60]

B. Ramamurthy and A. Ramakrishnan, “Virtual topology reconfiguration of wavelength-routed optical WDM networks,” in IEEE GLOBECOM, November 2000.

[61]

Y. J. Liu, P. X. Gao, B. Wong, and S. Keshav, “Quartz: A new design element for low-latency dcns,” in ACM SIGCOMM, August 2014.

Digital Library

[62]

H. Wang, Y. Xia, K. Bergman, T. Ng, S. Sahu, and K. Sripanidkulchai, “Rethinking the physical layer of data center networks of the next decade: Using optics to enable efficient*-cast connectivity,” ACM SIGCOMM Computer Communication Review, vol. 43, pp. 52–58, July 2013.

Digital Library

[63]

P. Samadi, D. Calhoun, H. Wang, and K. Bergman, “Accelerating cast traffic delivery in data centers leveraging physical layer optics and SDN,” in International Conference on Optical Network Design and Modeling, May 2014.

[64]

P. Samadi, H. Wang, D. Calhoun, Y. Xia, K. Sripanidkulchai, T. Ng, and K. Bergman, “An optical programmable network architecture supporting iterative multicast for data-intensive applications,” in IEEE Optical Interconnects Conference, May 2014.

[65]

Y. Xia and T. Ng, “A cross-layer sdn control plane for optical multicast-featured datacenters,” in ACM SIGCOMM HotSDN Workshop, August 2014.

Digital Library

[66]

G. Porter, R. Strong, N. Farrington, A. Forencich, P. Chen-Sun, T. Rosing, Y. Fainman, G. Papen, and A. Vahdat, “Integrating microsecond circuit switching into the data center,” in ACM SIGCOMM, August 2013.

Digital Library

[67]

H. Liu, F. Lu, A. Forencich, R. Kapoor, M. Tewari, G. M. Voelker, G. Papen, A. C. Snoeren, and G. Porter, “Circuit switching under the radar with REACToR,” in USENIX NSDI, April 2014.

Digital Library

[68]

S. Liu, Q. Cheng, A. Wonfor, R. V. Penty, I. White, and P. M. Watts, “A low latency optical top of rack switch for data centre networks with minimized processor energy load,” in Optical Fiber Communication Conference, March 2014.

Cited By

Nance-Hall MBarford PFoerster KDurairajan R(2024)Improving Scalability in Traffic Engineering via Optical Topology ProgrammingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.333589821:2(1581-1600)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2023.3335898
Fan LZhang XZhao YSood KYu S(2024)Online Training Flow Scheduling for Geo-Distributed Machine Learning Jobs Over Heterogeneous and Dynamic NetworksIEEE Transactions on Cognitive Communications and Networking10.1109/TCCN.2023.332633110:1(277-291)Online publication date: Feb-2024
https://doi.org/10.1109/TCCN.2023.3326331
Ding WXu H(2024)Dynamic Learning-based Link Restoration in Traffic Engineering with ArchieIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621357(2428-2437)Online publication date: 20-May-2024
https://doi.org/10.1109/INFOCOM52122.2024.10621357
Show More Cited By

Index Terms

Optimizing Bulk Transfers with Software-Defined Optical WAN
1. Networks

Recommendations

Software-defined optical networks (SDONs): a survey

This paper gives an overview of software-defined optical networks (SDONs). It explains the general concepts on software-defined networks (SDNs), their relationship with network function virtualization, and also about OpenFlow, which is a pioneer ...
A survey on multi-layer IP and optical Software-Defined Networks
Abstract
As Software-Defined Networks become more and more popular, they start to appear in various architectures. The most common utilization of SDN is to control the network in the electric layers, including OSI/ISO layers 2 and above. ...
Efficient software-defined passive optical network with network coding

The huge increase in broadband service requires much more bandwidth than ever before; however, due to the cost sensitivity, it is not possible to pursue high transmission rate blindly in the access network, which requires us to consider how to improve ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '16: Proceedings of the 2016 ACM SIGCOMM Conference

August 2016

645 pages

ISBN:9781450341936

DOI:10.1145/2934872

General Chairs:
Marinho Barcellos
UFRGS
,
Jon Crowcroft
University of Cambridge
,
Program Chairs:
Amin Vahdat
Google
,
Sachin Katti
Stanford University

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 August 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SIGCOMM '16

Sponsor:

SIGCOMM

SIGCOMM '16: ACM SIGCOMM 2016 Conference

August 22 - 26, 2016

Florianopolis, Brazil

Acceptance Rates

SIGCOMM '16 Paper Acceptance Rate 39 of 231 submissions, 17%;

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

97
Total Citations
View Citations
3,231
Total Downloads

Downloads (Last 12 months)217
Downloads (Last 6 weeks)25

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nance-Hall MBarford PFoerster KDurairajan R(2024)Improving Scalability in Traffic Engineering via Optical Topology ProgrammingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.333589821:2(1581-1600)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2023.3335898
Fan LZhang XZhao YSood KYu S(2024)Online Training Flow Scheduling for Geo-Distributed Machine Learning Jobs Over Heterogeneous and Dynamic NetworksIEEE Transactions on Cognitive Communications and Networking10.1109/TCCN.2023.332633110:1(277-291)Online publication date: Feb-2024
https://doi.org/10.1109/TCCN.2023.3326331
Ding WXu H(2024)Dynamic Learning-based Link Restoration in Traffic Engineering with ArchieIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621357(2428-2437)Online publication date: 20-May-2024
https://doi.org/10.1109/INFOCOM52122.2024.10621357
Wu YChen QLiu JLi FCheng L(2024)Approximate Multicast Coflow Scheduling in Reconfigurable Data Center NetworksAlgorithms and Architectures for Parallel Processing10.1007/978-981-97-0798-0_9(139-154)Online publication date: 1-Mar-2024
https://doi.org/10.1007/978-981-97-0798-0_9
Kirchner VKarl H(2023)Embedding Delay-Constrained VNF Forwarding Graphs into Reconfigurable WDM Optical Networks2023 International Conference on Software, Telecommunications and Computer Networks (SoftCOM)10.23919/SoftCOM58365.2023.10271569(1-6)Online publication date: 21-Sep-2023
https://doi.org/10.23919/SoftCOM58365.2023.10271569
Kiran M(2023)Engineering Autonomous Self-Driving NetworksACM SIGMETRICS Performance Evaluation Review10.1145/3626570.362660651:2(97-99)Online publication date: 2-Oct-2023
https://dl.acm.org/doi/10.1145/3626570.3626606
Miao CZhong ZZhang YHe KLi FChen MZhao YLi XHe ZZou XWang JSchulzrinne HKohler EMaltz DMisra V(2023)FlexWAN: Software Hardware Co-design for Cost-Effective and Resilient Optical BackbonesProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604824(319-332)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3603269.3604824
Dai WFoerster KFuchssteiner DSchmid S(2023)Load-optimization in Reconfigurable Data-center Networks: Algorithms and Complexity of Flow RoutingACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/35972008:3(1-30)Online publication date: 18-Jul-2023
https://dl.acm.org/doi/10.1145/3597200
Zhang HYin XShi XWang JWang ZGuo YLan TLi YZhu YRuan KGeng H(2023)Achieving High Availability in Inter-DC WAN Traffic EngineeringIEEE/ACM Transactions on Networking10.1109/TNET.2022.321659231:6(2406-2421)Online publication date: Dec-2023
https://doi.org/10.1109/TNET.2022.3216592
Peres BSouza OGoussevskaia OAvin CSchmid S(2023)Distributed Self-Adjusting Tree NetworksIEEE Transactions on Cloud Computing10.1109/TCC.2021.311206711:1(716-729)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TCC.2021.3112067
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents