skip to main content
10.1145/2505515.2507870acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
poster

Exploiting query term correlation for list caching in web search engines

Published: 27 October 2013 Publication History

Abstract

Caching technologies have been widely employed to boost the performance of Web search engines. Motivated by the correlation between terms in query logs from a commercial search engine, we explore the idea of a caching scheme based on pairs of terms, rather than individual terms (which is the typical approach used by search engines today). We propose an inverted list caching policy, based on the Least Recently Used method, in which the co-occurring correlation between terms in the query stream is accounted for when deciding on which terms to keep in the cache. We consider not only the term co-occurrence within the same query but also the co-occurrence between separate queries. Experimental results show that the proposed approach can improve not only the cache hit ratio but also the overall throughput of the system when compared to existing list caching algorithms.

References

[1]
R. A. Baeza-Yates, A. Gionis, F. Junqueira, V. Murdock, V. Plachouras, and F. Silvestri. The impact of caching on search engines. In SIGIR, 2007.
[2]
R. A. Baeza-Yates and S. Jonassen. Modeling static caching in web search engines. In ECIR, 2012.
[3]
R. A. Baeza-Yates, F. Junqueira, V. Plachouras, and H. F. Witschel. Admission policies for caches of search engine results. In SPIRE, 2007.
[4]
R. A. Baeza-Yates and F. Saint-Jean. A three level search engine index based in query log distribution. In SPIRE, 2003.
[5]
M. Chau, Y. Lu, X. Fang, and C. C. Yang. Characteristics of character usage in chinese web searching. Inf. Process. Manage., 45(1):115--130, 2009.
[6]
S. Chaudhuri, K. W. Church, A. C. König, and L. Sui. Heavy-tailed distributions and multi-keyword queries. In SIGIR, 2007.
[7]
E. D. Demaine, A. López-Ortiz, and J. I. Munro. Experiments on adaptive set intersections for text retrieval systems. In ALENEX, 2001.
[8]
Q. Gan and T. Suel. Improved techniques for result caching in web search engines. In WWW, 2009.
[9]
X. Long and T. Suel. Three-level caching for efficient query processing in large web search engines. In WWW, 2005.
[10]
E. P. Markatos. On caching search engine query results. Computer Communications, 24(2):137--143, 2001.
[11]
R. Ozcan, I. S. Altingovde, B. B. Cambazoglu, F. P. Junqueira, and Ö. Ulusoy. A five-level static cache architecture for web search engine. Inf. Process. Manage., 48(5):828--840, 2012.
[12]
P. C. Saraiva, E. S. de Moura, R. C. Fonseca, W. M. Jr., B. A. Ribeiro-Neto, and N. Ziviani. Rank-preserving two-level caching for scalable search engines. In SIGIR, 2001.
[13]
C. Silverstein, M. R. Henzinger, H. Marais, and M. Moricz. Analysis of a very large web search engine query log. SIGIR Forum, 33(1):6--12, 1999.
[14]
J. Zhang, X. Long, and T. Suel. Performance of compressed inverted list caching in search engines. In WWW, 2008.

Cited By

View all
  • (2016)Power Law Distributions in Information RetrievalACM Transactions on Information Systems10.1145/281681534:2(1-37)Online publication date: 16-Feb-2016
  • (2015)OLAP-enabled web search of complex objectsProceedings of the 17th International Conference on Information Integration and Web-based Applications & Services10.1145/2837185.2837243(1-10)Online publication date: 11-Dec-2015
  • (2014)Towards a Framework for Supporting Web Search of Complex Objects via Multidimensional ParadigmsProceedings of the 2014 14th International Conference on Computational Science and Its Applications10.1109/ICCSA.2014.49(217-220)Online publication date: 30-Jun-2014

Index Terms

  1. Exploiting query term correlation for list caching in web search engines

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge Management
    October 2013
    2612 pages
    ISBN:9781450322638
    DOI:10.1145/2505515
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 October 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. list caching
    2. query logs
    3. search engines
    4. term co-occurrence

    Qualifiers

    • Poster

    Conference

    CIKM'13
    Sponsor:
    CIKM'13: 22nd ACM International Conference on Information and Knowledge Management
    October 27 - November 1, 2013
    California, San Francisco, USA

    Acceptance Rates

    CIKM '13 Paper Acceptance Rate 143 of 848 submissions, 17%;
    Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 15 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2016)Power Law Distributions in Information RetrievalACM Transactions on Information Systems10.1145/281681534:2(1-37)Online publication date: 16-Feb-2016
    • (2015)OLAP-enabled web search of complex objectsProceedings of the 17th International Conference on Information Integration and Web-based Applications & Services10.1145/2837185.2837243(1-10)Online publication date: 11-Dec-2015
    • (2014)Towards a Framework for Supporting Web Search of Complex Objects via Multidimensional ParadigmsProceedings of the 2014 14th International Conference on Computational Science and Its Applications10.1109/ICCSA.2014.49(217-220)Online publication date: 30-Jun-2014

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media