Enumeration of Extractive Oracle Summaries

Jun Suzuki; Masaaki Nagata; Masaaki Nishino; Tsutomu Hirao

REVIEW

Enumeration of Extractive Oracle Summaries

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1701.01614 v1 pith:SCIXDMAS submitted 2017-01-06 cs.CL

Enumeration of Extractive Oracle Summaries

Tsutomu Hirao , Masaaki Nishino , Jun Suzuki , Masaaki Nagata This is my paper

classification cs.CL

keywords summariesoracleextractivederivedf-measuressummarizationalgorithmanalyze

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

0 comments

read the original abstract

To analyze the limitations and the future directions of the extractive summarization paradigm, this paper proposes an Integer Linear Programming (ILP) formulation to obtain extractive oracle summaries in terms of ROUGE-N. We also propose an algorithm that enumerates all of the oracle summaries for a set of reference summaries to exploit F-measures that evaluate which system summaries contain how many sentences that are extracted as an oracle summary. Our experimental results obtained from Document Understanding Conference (DUC) corpora demonstrated the following: (1) room still exists to improve the performance of extractive summarization; (2) the F-measures derived from the enumerated oracle summaries have significantly stronger correlations with human judgment than those derived from single oracle summaries.

Enumeration of Extractive Oracle Summaries

discussion (0)