Abstract
In this paper we use analytic modeling and simulation to evaluate network servers implemented on clusters of workstations. More specifically, we model the potential benefits of locality-conscious request distribution within the cluster and evaluate the performance of a cluster-based server (called L2S) we designed in light of our experience with the model. Our most important modeling results show that locality-conscious distribution on a 16-node cluster can increase server throughput with respect to a locality-oblivious server by up to 5-fold, depending on the average size of the files requested and on the size of the server's working set. Our simulation results demonstrate that L2S achieves throughput that is within 28% of the full potential of locality-conscious distribution on 16 nodes, outperforming and significantly outscaling the best-known locality-conscious server. Based on our results and on the fact that the files serviced by network servers are becoming larger and more numerous, we conclude that our locality-conscious network server should prove very useful for its performance, scalability, and availability properties.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Akamai (2000), Akamai Technologies, Inc., http://www.akamai.com/.
Andresen, D., T. Yang, V. Holmedahl, and O.H. Ibarra (1996), “SWEB: Towards a Scalable WWW Server on Multicomputers,” In Proceedings of the 10th International Parallel Processing Symposium, pp. 850–856.
Aron, M., P. Druschel, and W. Zwaenepoel (1999), “Efficient Support for P-HTTP in Cluster-Based Web Servers,” In Proceedings of USENIX'99 Technical Conference.
Aron, M., D. Sanders, P. Druschel, and W. Zwaenepoel (2000), “Scalable Content-Aware Request Distribution in Cluster-Based Network Servers,” In Proceedings of USENIX'2000 Technical Conference.
Baker, S.M. and B. Moon (1999), “Distributed Cooperative Web Servers,” In Proceedings of the 8th World Wide Web Conference, pp. 1215–1229.
Berners-Lee, T., R. Fielding, and H. Frystyk (1996), “RFC 1945: Hyper-Text Transfer Protocol – HTTP/1.0,” Technical Report, HTTP Working Group.
Bestavros, A., M. Crovella, J. Liu, and D. Martin (1998), “Distributed Packet Rewriting and its Application to Scalable Server Architectures,” In Proceedings of the International Conference on Network Protocols.
Bozemana, P. and B. Saphir (1999), “A Modular High Performance Implementation of the Virtual Interface Architecture,” In Proceedings of the 2nd Extreme Linux Workshop.
Breslau, L., P. Cao, L. Fan, G. Phillips, and S. Shenker (1999), “Web Caching and Zipf-like Distributions: Evidence and Implications,” In Proceedings of IEEE InfoCom'99, pp. 126–134.
Carrera, E.V. and R. Bianchini (1999), “Analytical and Experimental Evaluation of Cluster-Based Network Servers,” Technical Report 718, Department of Computer Science, University of Rochester, Originally published in August 1999, revised in April 2000.
Carrera, E.V. and R. Bianchini (2000), “Evaluating Cluster-Based Network Servers,” In Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing, pp. 63–70.
Cisco (2000), “Cisco LocalDirector,” http://www.cisco.com/.
Dias, D.M., W. Kish, R. Mukherjee, and R. Tewari (1996), “A Scalable and Highly Available Web Server,” In Proceedings of COMPCON'96, pp. 85–92.
Douglis, F. and J. Ousterhout (1991), “Transparent Process Migration: Design and Alternatives and the Sprite Implementation,” Software – Practice and Experience 21, 8, 757–785.
Fan, L., P. Cao, J. Almeida, and A. Broder (1998), “Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol,” In Proceedings of ACM SIGCOMM'98, pp. 254–265.
Fielding, R., J. Gettys, J. Mogul, H. Frystyk, L. Masinter, P. Leach, and T. Berners-Lee (1999), “RFC 2616: HyperText Transfer Protocol – HTTP/1.1,” Technical Report, HTTP Working Group.
Fox, A., S. Gribble, Y. Chawathe, E. Brewer, and P. Gauthier (1997), “Cluster-Based Scalable Network Services,” In Proceedings of the International Symposium on Operating Systems Principles, pp. 78–91.
Gross, D. and C.M. Harris (1998), Fundamentals of Queueing Theory, Wiley, New York.
HA Linux (2000), “High Availability Linux Project,” http://www.linux-ha.org/.
Holmedahl, V., B. Smith, and T. Yang (1998), “Cooperative Caching of Dynamic Content on a Distributed Web Server,” In Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing, pp. 243–250.
IBM (2000), “IBM SecureWay Network Dispatcher,” http://www.software.ibm.com/network/dispatcher.
Katz, E.D., M. Butler, and R. McGrath (1994), “A Scalable HTTP Server: The NCSA Prototype,” Computer Networks and ISDN Systems 27, 155–164.
Markatos, E.P. and T. LeBlanc (1994), “Using Processor Affinity in Loop Scheduling on Shared-Memory Multiprocessors,” IEEE Transactions on Parallel and Distributed Processing 5, 4, 379–400.
Pai, V., M. Aron, G. Banga, M. Svendsen, P. Druschel, W. Zwaenepoel, and E. Nahum (1998), “Locality-Aware Request Distribution in Cluster-based Network Servers,” In Proceedings of the 8th ACM Conference on Architectural Support for Programming Languages and Operating Systems, pp. 205–216.
Red Hat (2000), “Piranha – Load-Balanced Web and FTP Clusters,” http://www.redhat.com/support/wpapers/piranha/.
Resonate (1999), “Resonate Central Dispatch,” http://www.resonateinc.com/.
Song, J., E. Levy-Abegnoli, A. Iyengar, and D. Dias (2000), “Design Alternatives for Scalable Web Server Accelerators,” In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software.
Speight, E., H. Abdel-Shafi, and J. Bennett (1999), “Realizing the Performance of the Virtual Interface Architecture,” In Proceedings of the International Conference on Supercomputing’ 99, pp. 184–192.
VIA (1997), Virtual Interface Architecture Specification, Version 1.0, Compaq Corp., Intel Corp., and Microsoft Corp.
Zhu, H., B. Smith, and T. Yang (1999), “A Scheduling Optimization for Resource-Intensive Web Requests on Server Clusters,” In Proceedings of the 11th Annual Symposium on Parallel Algorithms and Architectures, pp. 13–22.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bianchini, R., Carrera, E.V. Analytical and experimental evaluation of cluster-based network servers. World Wide Web 3, 215–229 (2000). https://doi.org/10.1023/A:1018734706376
Issue Date:
DOI: https://doi.org/10.1023/A:1018734706376