skip to main content
10.1145/3269206.3269263acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
short-paper

Efficient Energy Management in Distributed Web Search

Published: 17 October 2018 Publication History

Abstract

Distributed Web search engines (WSEs) require warehouse-scale computers to deal with the ever-increasing size of the Web and the large amount of user queries they daily receive. The energy consumption of this infrastructure has a major impact on the economic profitability of WSEs. Recently several approaches to reduce the energy consumption of WSEs have been proposed. Such solutions leverage dynamic voltage and frequency scaling techniques in modern CPUs to adapt the WSEs' query processing to the incoming query traffic without negative impacts on latencies.
A state-of-the-art research approach is the PESOS (Predictive Energy Saving Online Scheduling) algorithm, which can reduce the energy consumption of a WSE' single server by up to 50%. We evaluate PESOS on a simulated distributed WSE composed of a thousand of servers, and we compare its performance w.r.t. an industry-level baseline, called PEGASUS. Our results show that PESOS can reduce the CPU energy consumption of a distributed WSE by up to 18% with respect to PEGASUS, while providing query response times which are in line with user expectations.

References

[1]
Ioannis Arapakis, Xiao Bai, and B. Barla Cambazoglu. 2014. Impact of Response Latency on User Behavior in Web Search. In Proc. SIGIR . 103--112.
[2]
Luiz André Barroso, Jimmy Clidaras, and Urs Hölzle. 2013. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines 2nd ed.). Morgan & Claypool Publishers.
[3]
B. Barla Cambazoglu and Ricardo A. Baeza-Yates. 2015. Scalability Challenges in Web Search Engines .Morgan & Claypool Publishers.
[4]
Matteo Catena and Nicola Tonellotto. 2017. Energy-Efficient Query Processing in Web Search Engines. IEEE TKDE, Vol. 29, 7 (2017), 1412--1425.
[5]
Daniele De Sensi, Massimo Torquati, and Marco Danelutto. 2017. Mammut: High-level management of system knobs and sensors. SoftwareX, Vol. 6 (2017), 150 -- 154.
[6]
Jeffrey Dean and Luiz André Barroso. 2013. The tail at scale. Commun. ACM, Vol. 56, 2 (2013), 74--80.
[7]
Enver Kayaaslan, B. Barla Cambazoglu, Roi Blanco, Flavio P. Junqueira, and Cevdet Aykanat. 2011. Energy-price-driven Query Processing in Multi-center Web Search Engines. In Proc. SIGIR . 983--992.
[8]
David Lo, Liqun Cheng, Rama Govindaraju, Luiz André Barroso, and Christos Kozyrakis. 2014. Towards Energy Proportionality for Large-scale Latency-critical Workloads. In Proc. ISCA . 301--312.
[9]
Craig Macdonald, Richard McCreadie, Rodrygo LT Santos, and Iadh Ounis. 2012a. From puppy to maturity: Experiences in developing Terrier . Proc. OSIR at SIGIR (2012), 60--63.
[10]
Craig Macdonald, Nicola Tonellotto, and Iadh Ounis. 2012b. Learning to Predict Response Times for Online Query Scheduling. In Proc. SIGIR . 621--630.
[11]
David Meisner, Christopher M. Sadler, Luiz André Barroso, Wolf-Dietrich Weber, and Thomas F. Wenisch. 2011. Power Management of Online Data-intensive Services. In Proc. ISCA . 319--330.
[12]
Alistair Moffat, William Webber, Justin Zobel, and Ricardo Baeza-Yates. 2007. A Pipelined Architecture for Distributed Text Query Evaluation . Information Retrieval, Vol. 10, 3 (2007), 205--231. Kluwer Academic Publishers.
[13]
David C. Snowdon, Sergio Ruocco, and Gernot Heiser. 2005. Power Management and Dynamic Voltage Scaling: Myths and Facts. In Proc. Workshop on Power Aware Real-time Computing .
[14]
Amin Teymorian, Ophir Frieder, and Marcus A. Maloof. 2013. Rank-energy Selective Query Forwarding for Distributed Search Systems. In Proc. CIKM . 389--398.
[15]
Sebastiano Vigna. 2013. Quasi-succinct indices. In Proc. WSDM. 83--92.
[16]
F. Yao, A. Demers, and S. Shenker. 1995. A scheduling model for reduced CPU energy. In Proc. FOCS. 374--382.

Cited By

View all
  • (2023)Beyond CO2 Emissions: The Overlooked Impact of Water Consumption of Information Retrieval ModelsProceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3578337.3605121(283-289)Online publication date: 9-Aug-2023
  • (2022)Reduce, Reuse, RecycleProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531766(2825-2837)Online publication date: 6-Jul-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge Management
October 2018
2362 pages
ISBN:9781450360142
DOI:10.1145/3269206
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cpu dynamic voltage and frequency scaling
  2. distributed web search
  3. energy consumption

Qualifiers

  • Short-paper

Funding Sources

Conference

CIKM '18
Sponsor:

Acceptance Rates

CIKM '18 Paper Acceptance Rate 147 of 826 submissions, 18%;
Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Beyond CO2 Emissions: The Overlooked Impact of Water Consumption of Information Retrieval ModelsProceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3578337.3605121(283-289)Online publication date: 9-Aug-2023
  • (2022)Reduce, Reuse, RecycleProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531766(2825-2837)Online publication date: 6-Jul-2022

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media