Article

Free access

S³: a scalable sensing service for monitoring large networked systems

Authors:

Praveen Yalagandula,

Sujata Banerjee,

Sung-Ju LeeAuthors Info & Claims

INM '06: Proceedings of the 2006 SIGCOMM workshop on Internet network management

Pages 71 - 76

https://doi.org/10.1145/1162638.1162650

Published: 11 September 2006 Publication History

Abstract

Efficiently operating and managing large scale distributed and federated systems is an extremely challenging problem. Current solutions are a combination of centralized management and significant over-provisioning of the infrastructure. With the explosion of new resource-intensive media applications and services, over provisioning of the infrastructure is no longer a viable option. Timely and accurate knowledge of the global environment (particularly the highly dynamic network path properties) is necessary for management of performance SLAs, just-in-time resource provisioning, near-optimal dynamic service placement and reuse, construction of network service overlays, and fast detection of failures and malicious attacks. Further, different applications require information about different aspects of the environment at different timescales. We propose S³, a Scalable Sensing Service, that achieves the above requirements and enables personalized sensing of the environment as dictated by applications.

References

[1]

Appmanager: Planetlab application manager. http://appmanager.berkeley.intel-research.net/.

[2]

D. Clark, C. Partridge, J. Ramming, and J. Wroclawski. A Knowledge Plane for the Internet. In SIGCOMM, Aug 2003.

Digital Library

[3]

C. Dovrolis, P. Ramanathan, and D. Moore. What do packet dispersion techniques measure? In Proceedings of the IEEE INFOCOM 2001, Anchorage, AK, April 2001.

[4]

FCAPS Overview: White paper. http://www.futsoft.com/pdf/fcapswp.pdf.

[5]

R. Fonseca, P. Sharma, S. Banerjee, S.-J. Lee, and S. Basu. Distributed querying of internet distance information. In Proceedings of the IEEE Global Internet 2005, Miami, FL, March 2005.

[6]

P. Francis, S. Jamin, C. Jin, Y. Jin, D. Raz, Y. Shavitt, and L. Zhang. IDMaps: A global internet host distance estimation service. IEEE/ACM Transactions on Networking, 9(5):525--540, October 2001.

Digital Library

[7]

http://ganglia.sourceforge.net.

[8]

K. P. Gummadi, S. Saroiu, and S. D. Gribble. King: Estimating latency between arbitrary internet end hosts. In Proceedings of the ACM IMW 2002, pages 5--18.

Digital Library

[9]

J. M. Hellerstein, V. Paxson, L. Peterson, T. Roscoe, S. Shenker, and D. Wetherall. The Network Oracle. In Bulletin of the IEEE Computer Society Technical Committee on Data Engineering. 2005.

[10]

R. Huebsch, J. M. Hellerstein, N. Lanham, B. T. Loo, S. Shenker, and I. Stoica. Querying the Internet with PIER. In Proceedings of the VLDB Conference, May 2003.

Digital Library

[11]

N. Jain, P. Yalagandula, M. Dahlin, and Y. Zhang. INSIGHT: A Distributed Monitoring System for Tracking Continuous Queries. Work-in-Progress Session at SOSP 2005.

Digital Library

[12]

R. Mahajan, N. Spring, D. Wetherall, and T. Anderson. User-level Internet Path Diagnosis. In Proceedings of the SOSP, Oct 2003.

Digital Library

[13]

T. S. E. Ng and H. Zhang. Predicting Internet network distance with coordinates-based approaches. In Proceedings of the IEEE INFOCOM 2002.

[14]

V. N. Padmanabhan, S. Ramabhadran, and J. Padhye. NetProfiler: Profiling Wide-Area Networks Using Peer Cooperation. In IPTPS, Feb 2005.

Digital Library

[15]

G. Phillip B, B. Karp, Y. Ke, S. Nath, and S. Seshan. Irisnet: An architecture for a world-wide sensor web. In IEEE Pervasive Computing, Oct 2003.

Digital Library

[16]

M. Pias, J. Crowcroft, S. Wilbur, T. Harris, and S. Bhatti. Lighthouses for scalable distributed location. In Proceedings of the IPTPS 2003.

[17]

S. Ratnasamy, M. Handley, R. Karp, and S. Shenker. Topologically-aware overlay construction and server selection. In Proceedings of the IEEE INFOCOM 2002, June 2002.

[18]

V. Ribeiro, R. Riedi, R. Baraniuk, J. Navratil, and L. Cottrell. pathChirp: Efficient available bandwidth estimation for network paths. In Proceedings of the PAM 2003, La Jolla, CA, April 2003.

[19]

S. Saroiu. SProbe: A Fast Tool for Measuring Bottleneck Bandwidth in Uncooperative Environments.

[20]

S. Srinivasan and E. Zegura. M-coop: A scalable infrastructure for network measurement. In Proceedings of the IEEE WIAPP 2003.

Digital Library

[21]

I. Stoica, R. Morris, D. Karger, F. Kaashoek, and H. Balakrishnan. Chord: A scalable Peer-To-Peer lookup service for internet applications. In ACM SIGCOMM, 2001.

Digital Library

[22]

J. Strauss, D. Katabi, and F. Kaashoek. A measurement study of available bandwidth estimation tools. In Proceedings of the ACM IMC 2003, Miami, FL, October 2003.

Digital Library

[23]

R. VanRenesse, K. P. Birman, and W. Vogels. Astrolabe: A Robust and Scalable Technology for Distributed System Monitoring, Management, and Data Mining. TOCS, 2003.

Digital Library

[24]

Vxargs. http://dharma.cis.upenn.edu/planetlab/vxargs/.

[25]

H. Wang, J. Platt, Y. Chen, R. Zhang, and Y. Wang. Automatic Misconfiguration Troubleshooting with PeerPressure. In OSDI, Dec 2004.

Digital Library

[26]

Y. Wang, C. Verbowski, J. Dunagan, Y. Chen, Y. Chun, H. Wang, and Z. Zhang. STRIDER: A Black-box, State-based Approach to Change and Configuration Management and Support. In Usenix LISA, Oct 2003.

Digital Library

[27]

M. Wawrzoniak, L. Peterson, and T. Roscoe. Sophia: An Information Plane for Networked Systems. In HotNets-II, 2003.

[28]

B. Wong, A. Slivkins, and E. Sirer. Meridian: A lightweight network location service without virtual coordinates. In Proceedings of the ACM SIGCOMM, Philadelphia, PA, August 2005.

Digital Library

[29]

Z. Xu, P. Sharma, S.-J. Lee, and S. Banerjee. Netvigator: Scalable network proximity estimation. Technical report, HP Laboratories, 2005.

[30]

H. S. Y. Chen, D. Bindel and R. H. Katz. An algebraic approach to practical and scalable overlay network monitoring. In Proceedings of ACM Sigcomm, 2004.

Digital Library

[31]

P. Yalagandula and M. Dahlin. A scalable distributed information management system. In ACM SIGCOMM 2004, Aug. 2004.

Digital Library

Cited By

Nobre JMelchiors CMarquezan CTarouco LGranville L(2018)A Survey on the Use of P2P Technology for Network ManagementJournal of Network and Systems Management10.1007/s10922-017-9413-426:1(189-221)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s10922-017-9413-4
Gavrilov ABezukladnikov IKavalerov M(2017)The problem of management and monitoring in distributed telecommunication systems2017 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus)10.1109/EIConRus.2017.7910513(140-143)Online publication date: 2017
https://doi.org/10.1109/EIConRus.2017.7910513
Brennand CDuarte JSilva A(2016)SimGrid: A simulator of network monitoring topologies for peer-to-peer based computational grids2016 8th IEEE Latin-American Conference on Communications (LATINCOM)10.1109/LATINCOM.2016.7811594(1-6)Online publication date: Nov-2016
https://doi.org/10.1109/LATINCOM.2016.7811594
Show More Cited By

Index Terms

S³: a scalable sensing service for monitoring large networked systems

Recommendations

Practical Amazon EC2, SQS, Kinesis, and S3: A Hands-On Approach to AWS
S3: A Service-Oriented Reference Architecture

The Service-Oriented Solution Stack provides an architectural framework based on a range of industry best practices.
Comparison between Amazon S3 and Google Cloud Drive
ICCIS 2017: Proceedings of the 2017 2nd International Conference on Communication and Information Systems

Cloud computing has exhibited major advantages for large organizations; however, deciding on the best cloud storage provider depends on the organization business nature, needs, and size. The decision making process requires analyzing the cloud providers'...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

INM '06: Proceedings of the 2006 SIGCOMM workshop on Internet network management

September 2006

94 pages

ISBN:1595935703

DOI:10.1145/1162638

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGCOMM06

SIGCOMM06: ACM SIGCOMM 2006 Conference

September 11 - 15, 2006

Pisa, Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

63
Total Citations
View Citations
574
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)15

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nobre JMelchiors CMarquezan CTarouco LGranville L(2018)A Survey on the Use of P2P Technology for Network ManagementJournal of Network and Systems Management10.1007/s10922-017-9413-426:1(189-221)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s10922-017-9413-4
Gavrilov ABezukladnikov IKavalerov M(2017)The problem of management and monitoring in distributed telecommunication systems2017 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus)10.1109/EIConRus.2017.7910513(140-143)Online publication date: 2017
https://doi.org/10.1109/EIConRus.2017.7910513
Brennand CDuarte JSilva A(2016)SimGrid: A simulator of network monitoring topologies for peer-to-peer based computational grids2016 8th IEEE Latin-American Conference on Communications (LATINCOM)10.1109/LATINCOM.2016.7811594(1-6)Online publication date: Nov-2016
https://doi.org/10.1109/LATINCOM.2016.7811594
Du WLiao YTao NGeurts PFu XLeduc G(2015)Rating network paths for locality-aware overlay construction and routingIEEE/ACM Transactions on Networking10.1109/TNET.2014.233737123:5(1661-1673)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.1109/TNET.2014.2337371
Zeng HKazemian PVarghese GMcKeown N(2014)Automatic test packet generationIEEE/ACM Transactions on Networking10.1109/TNET.2013.225312122:2(554-566)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.1109/TNET.2013.2253121
Eyraud-Dubois LUznanski P(2014)Point-to-Point and Congestion Bandwidth EstimationProceedings of the 2014 IEEE International Parallel & Distributed Processing Symposium Workshops10.1109/IPDPSW.2014.15(89-96)Online publication date: 19-May-2014
https://dl.acm.org/doi/10.1109/IPDPSW.2014.15
Blanton ETozal MSarac KFahmy S(2013)Location matters: Eliciting responses to direct probes2013 IEEE 32nd International Performance Computing and Communications Conference (IPCCC)10.1109/PCCC.2013.6742782(1-10)Online publication date: Dec-2013
https://doi.org/10.1109/PCCC.2013.6742782
Nobre JGranville LClemm APrieto A(2013)Coordination in P2P management overlays to improve decentralized detection of SLA violations2013 IEEE International Conference on Communications (ICC)10.1109/ICC.2013.6655084(3456-3460)Online publication date: Jun-2013
https://doi.org/10.1109/ICC.2013.6655084
Brasileiro FAndrade N(2012)Open, Scalable and Self-Regulated Federations of Desktop Grids with OurGridDesktop Grid Computing10.1201/b12206-4(29-51)Online publication date: 5-Jun-2012
https://doi.org/10.1201/b12206-4
Zeng HKazemian PVarghese GMcKeown NBarakat CTeixeira RRamakrishnan KThiran P(2012)Automatic test packet generationProceedings of the 8th international conference on Emerging networking experiments and technologies10.1145/2413176.2413205(241-252)Online publication date: 10-Dec-2012
https://dl.acm.org/doi/10.1145/2413176.2413205
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents