skip to main content
research-article
Free access

Moving beyond the Turing Test with the Allen AI Science Challenge

Published: 23 August 2017 Publication History

Abstract

Answering questions correctly from standardized eighth-grade science tests is itself a test of machine intelligence.

References

[1]
Allen Institute for Artificial Intelligence. Datasets; http://allenai.org/data
[2]
Aron, J. Software tricks people into thinking it is human. New Scientist 2829 (Sept. 6, 2011).
[3]
BBC News. Computer AI passes Turing Test in 'world first.' BBC News (June 9, 2014); http://www.bbc.com/news/technology-27762088
[4]
Berant, J., Chou, A., Frostig, R., and Liang, P. Semantic parsing on Freebase from question-answer pairs. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (Seattle, WA, Oct. 18--21). Association for Computational Linguistics, Stroudsburg, PA, 2013, 6.
[5]
Fader, A., Zettlemoyer, L., and Etzioni, O. Open question answering over curated and extracted knowledge bases. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (New York, Aug. 24--27). ACM Press, New York, 2014.
[6]
Grishman, R. and Sundheim, B. Message understanding Conference-6: A brief history. In Proceedings of the 16th Conference on Computational Linguistics (Copenhagen, Denmark, Aug. 5--9). Association for Computational Linguistics, Stroudsburg, PA, 1996, 466--471.
[7]
Kaggle. The Allen AI Science Challenge; https://www.kaggle.com/c/the-allen-ai-science-challenge
[8]
Katz, B., Borchardt, G., and Felshin, S. Natural language annotations for question answering. In Proceedings of the 19th International Florida Artificial Intelligence Research Society Conference (Melbourne Beach, FL, May 11--13). AAAI Press, Menlo Park, CA, 2006.
[9]
Marcus, G., Rossi, F., and Veloso, M., Eds. Beyond the Turing Test. AI Magazine (Special Edition) 37, 1 (Spring 2016).
[10]
Simmons, J. True Knowledge: The natural language question answering Wikipedia for facts. Semantic Focus (Feb. 26, 2008); http://www.semanticfocus.com/blog/entry/title/true-knowledge-the-natural-language-question-answering-wikipedia-for-facts/
[11]
Turing, A.M. Computing machinery and intelligence. Mind59, 236 (Oct. 1950), 433--460.
[12]
Turk, V. The plan to replace the Turing Test with a 'Turing Olympics' Motherboard (Jan. 28, 2015); https://motherboard.vice.com/en_us/article/the-plan-to-replace-the-turing-test-with-a-turing-olympics
[13]
Voorhees, E. and Ellis, A., Eds. In Proceedings of the 24th Text REtrieval Conference (Gaithersburg, MD, Nov. 17--20). Publication SP 500--319, National Institute of Standards and Technology, Gaithersburg, MD, 2015.
[14]
Wolfram, S. Making the world's data computable. Stephen Wolfram Blog (Sept. 24, 2010); http://blog.stephenwolfram.com/2010/09/making-the-worlds-data-computable/
[15]
Yao, X. and Van Durme, B. Information extraction over structured data: Question answering with Freebase. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Baltimore, MD, June 22--27). Association for Computational Linguistics, Stroudsburg, PA, 2014, 956--966.

Cited By

View all
  • (2024)Science Teacher Perceptions of the State of Knowledge and Education at the Advent of Generative Artificial Intelligence PopularityScience & Education10.1007/s11191-024-00534-yOnline publication date: 3-Jun-2024
  • (2024)Main Martechs in BriefDigital Marketing Technologies10.1007/978-981-97-0607-5_5(109-157)Online publication date: 20-Apr-2024
  • (2023)Ensemble Text Summarization Model for COVID-19-Associated DatasetsInternational Journal of Intelligent Systems10.1155/2023/31066312023Online publication date: 1-Jan-2023
  • Show More Cited By

Index Terms

  1. Moving beyond the Turing Test with the Allen AI Science Challenge

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image Communications of the ACM
        Communications of the ACM  Volume 60, Issue 9
        September 2017
        94 pages
        ISSN:0001-0782
        EISSN:1557-7317
        DOI:10.1145/3134526
        Issue’s Table of Contents
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 23 August 2017
        Published in CACM Volume 60, Issue 9

        Permissions

        Request permissions for this article.

        Check for updates

        Qualifiers

        • Research-article
        • Popular
        • Refereed

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)156
        • Downloads (Last 6 weeks)29
        Reflects downloads up to 15 Sep 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Science Teacher Perceptions of the State of Knowledge and Education at the Advent of Generative Artificial Intelligence PopularityScience & Education10.1007/s11191-024-00534-yOnline publication date: 3-Jun-2024
        • (2024)Main Martechs in BriefDigital Marketing Technologies10.1007/978-981-97-0607-5_5(109-157)Online publication date: 20-Apr-2024
        • (2023)Ensemble Text Summarization Model for COVID-19-Associated DatasetsInternational Journal of Intelligent Systems10.1155/2023/31066312023Online publication date: 1-Jan-2023
        • (2023)Explore deep reinforcement learning for efficient task processing based on federated optimization in big dataFuture Generation Computer Systems10.1016/j.future.2023.06.027149(150-161)Online publication date: Dec-2023
        • (2023)Video Turing TestAI Magazine10.1002/aaai.1212844:4(537-554)Online publication date: 8-Dec-2023
        • (2022)Machines augmenting entrepreneurs: Opportunities (and threats) at the Nexus of artificial intelligence and entrepreneurshipJournal of Business Venturing10.1016/j.jbusvent.2022.10622737:4(106227)Online publication date: Jul-2022
        • (2022)Investigation on Some Aspects of Modeling, Forecasting, and Evaluating the Impact of Global Coronavirus Disease 2019Computational Intelligence for COVID-19 and Future Pandemics10.1007/978-981-16-3783-4_16(333-349)Online publication date: 1-Jan-2022
        • (2022)MEAU: A Method for the Evaluation of the Artificial UnintelligenceHandbook on Artificial Intelligence-Empowered Applied Software Engineering10.1007/978-3-031-08202-3_11(251-301)Online publication date: 4-Sep-2022
        • (2022)Artificial Intelligence and Machine LearningHandbook of e-Tourism10.1007/978-3-030-48652-5_25(435-455)Online publication date: 2-Sep-2022
        • (2020)From F to A on the New York Regents Science Exams — An Overview of the Aristo ProjectAI Magazine10.1609/aimag.v41i4.530441:4(39-53)Online publication date: 1-Dec-2020
        • Show More Cited By

        View Options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Digital Edition

        View this article in digital edition.

        Digital Edition

        Magazine Site

        View this article on the magazine site (external)

        Magazine Site

        Get Access

        Login options

        Full Access

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media