2019 · 50 citations · 10 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingText AnalyticsClinical Natural Language ProcessingData SummarizationInformation ExtractionLanguage ModelingText Feature EngineeringText SummarizationAutomatic Summarization EvaluationLegal Document SummarizationMaskingMetricsSummarizationSummarization EvaluationSummarization Of Legal TextsText Type Classification
We report on a pilot experiment in automatic, extractive summarization of legal cases concerning Post-traumatic Stress Disorder from the US Board of Veterans' Appeals. We hypothesize that length-constrained extractive summaries benefit from choosing among sentences that are predictive for the case outcome. We develop a novel train-attribute-mask pipeline using a CNN classifier to iteratively select predictive sentences from the case, which measurably improves prediction accuracy on partially masked decisions. We then select a subset for the summary through type classification, maximum marginal relevance, and a summarization template. We use ROUGE metrics and a qualitative survey to evaluate generated summaries along with expert-extracted and expert-drafted summaries. We show that sentence predictiveness does not reliably cover all decision-relevant aspects of a case, illustrate that lexical overlap metrics are not well suited for evaluating legal summaries, and suggest that future work should focus on case-aspect coverage.
10
Convolutional Neural Networks for Sentence Classification
Ashish Vaswani, Noam Shazeer, Niki Parmar et al. · 2025 · 6.6K citations · Full text
Extractive summarisation of legal texts
Ben Hachey, Claire Grover · Artificial Intelligence and Law · 2007 · 151 citations