Automatic web query classification using labeled and unlabeled training data

SM Beitzel, EC Jensen, O Frieder… - Proceedings of the 28th …, 2005 - dl.acm.org
SM Beitzel, EC Jensen, O Frieder, D Grossman, DD Lewis, A Chowdhury, A Kolcz
Proceedings of the 28th annual international ACM SIGIR conference on …, 2005dl.acm.org
Accurate topical categorization of user queries allows for increased effectiveness, efficiency,
and revenue potential in general-purpose web search systems. Such categorization
becomes critical if the system is to return results not just from a general web collection but
from topic-specific databases as well. Maintaining sufficient categorization recall is very
difficult as web queries are typically short, yielding few features per query. We examine three
approaches to topical categorization of general web queries: matching against a list of …
Accurate topical categorization of user queries allows for increased effectiveness, efficiency, and revenue potential in general-purpose web search systems. Such categorization becomes critical if the system is to return results not just from a general web collection but from topic-specific databases as well. Maintaining sufficient categorization recall is very difficult as web queries are typically short, yielding few features per query. We examine three approaches to topical categorization of general web queries: matching against a list of manually labeled queries, supervised learning of classifiers, and mining of selectional preference rules from large unlabeled query logs. Each approach has its advantages in tackling the web query classification recall problem, and combining the three techniques allows us to classify a substantially larger proportion of queries than any of the individual techniques. We examine the performance of each approach on a real web query stream and show that our combined method accurately classifies 46% of queries, outperforming the recall of the best single approach by nearly 20%, with a 7% improvement in overall effectiveness.
ACM Digital Library