arXiv (Cornell University) · 2020 · 16 citations · 19 references
ComputingComputer ScienceInformation SystemsDatabasesMachine LearningNatural Language ProcessingLanguage ModelsNatural Language UnderstandingParsingQuery ProcessingQuestion AnsweringStructured Query LanguageAutomated Query GenerationCross-language Question AnsweringLarge-scale Natural Language ProcessingNeural Language ModelsNeural Question AnsweringQuestion Answering SystemsTable Question AnsweringTable-to-text Generation
Parsing natural language to corresponding SQL (NL2SQL) with data driven approaches like deep neural networks attracts much attention in recent years. Existing NL2SQL datasets assume that condition values should appear exactly in natural language questions and the queries are answerable given the table. However, these assumptions may fail in practical scenarios, because user may use different expressions for the same content in the table, and query information outside the table without the full picture of contents in table. Therefore we present TableQA, a large-scale cross-domain Natural Language to SQL dataset in Chinese language consisting 64,891 questions and 20,311 unique SQL queries on over 6,000 tables. Different from exisiting NL2SQL datasets, TableQA requires to generalize well not only to SQL skeletons of different questions and table schemas, but also to the various expressions for condition values. Experiment results show that the state-of-the-art model with 95.1% condition value accuracy on WikiSQL only gets 46.8% condition value accuracy and 43.0% logic form accuracy on TableQA, indicating the proposed dataset is challenging and necessary to handle. Two table-aware approaches are proposed to alleviate the problem, the end-to-end approaches obtains 51.3% and 47.4% accuracy on the condition value and logic form tasks, with improvement of 4.7% and 3.4% respectively.
19
Oriol Vinyals, Meire Fortunato, Navdeep Jaitly · Neural Information Processing Systems · 2015 · 1.3K citations
Long Short-Term Memory-Networks for Machine Reading
Jianpeng Cheng, Li Dong, Mirella Lapata · 2016 · 1.1K citations · Full text