Article

Free access

Proximity in context: an empirically grounded computational model of proximity for processing topological spatial expressions

Authors:

John D. Kelleher,

Geert-Jan M. Kruijff,

Fintan J. CostelloAuthors Info & Claims

ACL-44: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics

Pages 745 - 752

https://doi.org/10.3115/1220175.1220269

Published: 17 July 2006 Publication History

Abstract

The paper presents a new model for context dependent interpretation of linguistic expressions about spatial proximity between objects in a natural scene. The paper discusses novel psycholinguistic experimental data that tests and verifies the model. The model has been implemented, and enables a conversational robot to identify objects in a scene through topological spatial relations (e.g. "X near Y"). The model can help motivate the choice between topological and projective prepositions.

References

[1]

J. Baldridge and G. J. M. Kruijff. 2002. Coupling CCG and hybrid logic dependency semantics. In Proceedings of ACL 2002, Philadelphia, Pennsylvania.

Digital Library

[2]

J. Baldridge and G. J. M. Kruijff. 2003. Multi-modal combinatory categorial grammar. In Proceedings of EACL 2003, Budapest, Hungary.

Digital Library

[3]

H. Clark and D. Wilkes-Gibbs. 1986. Referring as a collaborative process. Cognition, 22:1--39.

[4]

K. R. Coventry and S. Garrod. 2004. Saying, Seeing and Acting. The Psychological Semantics of Spatial Prepositions. Essays in Cognitive Psychology Series. Lawrence Erlbaum Associates.

[5]

R. Dale and E. Reiter. 1995. Computational interpretations of the gricean maxims in the generation of referring expressions. Cognitive Science, 18:233--263.

[6]

D. DeVault and M. Stone. 2004. Interpreting vague utterances in context. In Proceedings of COLING 2004, volume 2, pages 1247--1253, Geneva, Switzerland.

Digital Library

[7]

K. P. Grapp. 1994. Basic meanings of spatial relations: Computation and evaluation in 3d space. In Proceedings of AAAI-94, pages 1393--1398.

Digital Library

[8]

P. Gorniak and D. Roy. 2004. Grounded semantic composition for visual scenes. Journal of Artificial Intelligence Research, 21:429--470.

[9]

E. Hajicová. 1993. Issues of Sentence Structure and Discourse Patterns, volume 2 of Theoretical and Computational Linguistics. Charles University Press.

[10]

A Herskovits. 1986. Language and spatial cognition: An interdisciplinary study of prepositions in English. Studies in Natural Language Processing. Cambridge University Press.

Digital Library

[11]

J. D. Kelleher and G. J. Kruijff. 2006. Incremental generation of spatial referring expressions in situated dialog. In Proceedings ACL/COLING '06, Sydney, Australia.

Digital Library

[12]

J. Kelleher and J. van Genabith. 2004. Visual salience and reference resolution in simulated 3d environments. AI Review, 21(3-4):253--267.

Digital Library

[13]

E. Krahmer and M. Theune. 1999. Efficient generation of descriptions in context. In R. Kibble and K. van Deemter, editors, Workshop on the Generation of Nominals, ESS-LLI'99, Utrecht, The Netherlands.

[14]

G. D. Logan and D. D. Sadler. 1996. A computational analysis of the apprehension of spatial relations. In M. Bloom, P. and Peterson, L. Nadell, and M. Garrett, editors, Language and Space, pages 493--529. MIT Press.

[15]

G. D. Logan. 1994. Spatial attention and the apprehension of spatial relations. Journal of Experimental Psychology: Human Perception and Performance, 20:1015--1036.

[16]

G. D. Logan. 1995. Linguistic and conceptual control of visual spatial attention. Cognitive Psychology, 12:523--533.

[17]

R. Moratz and T. Tenbrink. 2006. Spatial reference in linguistic human-robot interaction: Iterative, empirically supported development of a model of projective relations. Spatial Cognition and Computation.

[18]

T. Oates, Z. Eyler-Walker, and P. R. Cohen. 2000. Toward natural language interfaces for robotic agents: Grounding linguistic meaning in sensors. In Proceedings of the Fourth International Conference on Autonomous Agents, pages 227--228.

Digital Library

[19]

T. Regier and L. Carlson. 2001. Grounding spatial language in perception: An empirical and computational investigation. Journal of Experimental Psychology: General, 130(2):273--298.

[20]

D. K. Roy. 2002. Learning words and syntax for a scene description task. Computer Speech and Language, 16(3).

[21]

I. F. van der Sluis and E. J. Krahmer. 2004. The influence of target size and distance on the production of speech and gesture in multimodal referring expressions. In R. Kibble and K. van Deemter, editors, ICSLP04.

Cited By

Goyal AYang KYang DDeng JLarochelle HRanzato MHadsell RBalcan MLin H(2020)Rel3DProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496606(10514-10525)Online publication date: 6-Dec-2020
https://dl.acm.org/doi/10.5555/3495724.3496606
Spranger MSuchan JBhatt M(2016)Robust natural language processingProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3060832.3061028(2908-2914)Online publication date: 9-Jul-2016
https://dl.acm.org/doi/10.5555/3060832.3061028
Hanlon NNamee BKelleher J(2009)Just say itProceedings of the 20th Irish conference on Artificial intelligence and cognitive science10.5555/1939047.1939065(134-143)Online publication date: 19-Aug-2009
https://dl.acm.org/doi/10.5555/1939047.1939065
Show More Cited By

Recommendations

An enhanced context-sensitive proximity model for probabilistic information retrieval
SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval

We propose to enhance proximity-based probabilistic retrieval models with more contextual information. A term pair with higher contextual relevance of term proximity is assigned a higher weight. Several measures are proposed to estimate the contextual ...
Context of Utterance and Intended Context
CONTEXT '01: Proceedings of the Third International and Interdisciplinary Conference on Modeling and Using Context

In this paper I expose and criticise the distinction between pure indexicals and demonstratives, held by David Kaplan and John Perry. I oppose the context of material production of the utterance to the "intended context" (the context of interpretation, ...
On the Representation of Context

This paper revisits some foundational questions concerning the abstract representation of a discourse context. The context of a conversation is represented by a body of information that is presumed to be shared by the participants in the conversation – the ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL-44: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics

July 2006

1214 pages

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 17 July 2006

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
331
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)20

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Goyal AYang KYang DDeng JLarochelle HRanzato MHadsell RBalcan MLin H(2020)Rel3DProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496606(10514-10525)Online publication date: 6-Dec-2020
https://dl.acm.org/doi/10.5555/3495724.3496606
Spranger MSuchan JBhatt M(2016)Robust natural language processingProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3060832.3061028(2908-2914)Online publication date: 9-Jul-2016
https://dl.acm.org/doi/10.5555/3060832.3061028
Hanlon NNamee BKelleher J(2009)Just say itProceedings of the 20th Irish conference on Artificial intelligence and cognitive science10.5555/1939047.1939065(134-143)Online publication date: 19-Aug-2009
https://dl.acm.org/doi/10.5555/1939047.1939065
Kelleher JCostello F(2009)Applying computational models of spatial prepositions to visually situated dialogComputational Linguistics10.1162/coli.06-78-prep1435:2(271-306)Online publication date: 1-Jun-2009
https://dl.acm.org/doi/10.1162/coli.06-78-prep14
Brenner MHawes NKelleher JWyatt J(2007)Mediating between qualitative and quantitative representations for task-orientated human-robot interactionProceedings of the 20th international joint conference on Artifical intelligence10.5555/1625275.1625610(2072-2077)Online publication date: 6-Jan-2007
https://dl.acm.org/doi/10.5555/1625275.1625610
Corradini AMase KMassaro DTakeda KRoy DPotamianos A(2007)A computational model for spatial expression resolutionProceedings of the 9th international conference on Multimodal interfaces10.1145/1322192.1322234(240-246)Online publication date: 12-Nov-2007
https://dl.acm.org/doi/10.1145/1322192.1322234
Kelleher JKruijff G(2006)Incremental generation of spatial referring expressions in situated dialogProceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics10.3115/1220175.1220306(1041-1048)Online publication date: 17-Jul-2006
https://dl.acm.org/doi/10.3115/1220175.1220306

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents