REVIEW 13 cited by
InstructUIE: Multi-task Instruction Tuning for Unified Information Extraction
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
InstructUIE: Multi-task Instruction Tuning for Unified Information Extraction
read the original abstract
Large language models have unlocked strong multi-task capabilities from reading instructive prompts. However, recent studies have shown that existing large models still have difficulty with information extraction tasks. For example, gpt-3.5-turbo achieved an F1 score of 18.22 on the Ontonotes dataset, which is significantly lower than the state-of-the-art performance. In this paper, we propose InstructUIE, a unified information extraction framework based on instruction tuning, which can uniformly model various information extraction tasks and capture the inter-task dependency. To validate the proposed method, we introduce IE INSTRUCTIONS, a benchmark of 32 diverse information extraction datasets in a unified text-to-text format with expert-written instructions. Experimental results demonstrate that our method achieves comparable performance to Bert in supervised settings and significantly outperforms the state-of-the-art and gpt3.5 in zero-shot settings.
Forward citations
Cited by 13 Pith papers
-
MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
MedStruct-S benchmark shows encoder-only models outperform larger decoder-only ones on key-conditioned QA from noisy OCR clinical reports, with fine-tuned large models winning only when scale is ignored.
-
LC-ICL: Label-Guided Contrastive In-Context Learning for Robust Information Extraction
LC-ICL improves few-shot NER and RE by using label-guided contrastive demonstrations that pair positive samples with error-annotated negative samples.
-
iPOE: Interpretable Prompt Optimization via Explanations
iPOE generates and optimizes annotation guidelines from explanations to produce interpretable prompts, reporting up to 39% gains over baselines on four datasets with LLM explanations substituting for human ones.
-
Job Skill Extraction via LLM-Centric Multi-Module Framework
SRICL combines semantic retrieval from ESCO, in-context learning, fine-tuning, and output verification to achieve higher STRICT-F1 scores and fewer invalid or hallucinated skill spans than GPT-3.5 baselines on six pub...
-
Relational Probing: LM-to-Graph Adaptation for Financial Prediction
Relational Probing replaces the LM output head with a trainable relation head that induces graphs from hidden states and optimizes them end-to-end for stock trend prediction, showing gains over co-occurrence baselines.
-
Can Heterogeneous Language Models Be Fused?
HeteroFusion fuses heterogeneous LLMs via topology-based alignment and conflict-aware denoising, outperforming merging and ensemble baselines in cross-family and multi-source settings.
-
EXCEEDS: Extracting Complex Events via Nugget-based Grid Modeling in Scientific Domain
Introduces the SciEvents dataset for scientific event extraction and the EXCEEDS nugget-grid modeling framework that reports state-of-the-art results on the new data.
-
iPOE: Interpretable Prompt Optimization via Explanations
iPOE derives and optimizes guidelines from explanations to create interpretable prompts, yielding up to 31% and 35% gains over standard and random-guideline prompts on four datasets.
-
SAM-NER: Semantic Archetype Mediation for Zero-Shot Named Entity Recognition
SAM-NER improves cross-domain zero-shot NER by discovering entities, projecting them into domain-invariant semantic archetypes, and then calibrating those archetypes to target labels with a frozen LLM.
-
Gender Bias in YouTube Exposure: Allocative and Structural Inequalities in Political Information Environments
A social-bot experiment finds allocative and structural gender biases in YouTube political recommendations, with differences in content distribution and community clusters that a collaborative filtering model can reproduce.
-
SchemaRAG: Dynamic Large Schema Reduction for LLM-driven Structured Information Extraction
SchemaRAG dynamically reduces large schemas via RAG for LLM information extraction, reporting up to 8.8% micro-F1 gain, 47% latency cut, and 48% token cost reduction on healthcare and e-commerce data.
-
JD Oxygen AI Item Center (Oxygen AIIC) V1: An Industrial-Scale LLM/VLM-Centric Solution for Item Understanding, Management, and Applications
Oxygen AIIC is an industrial platform using LLMs and VLMs for scalable item knowledge production and service at JD.com, reporting 94.2% precision and 82.8% recall along with business metric improvements.
-
JD Oxygen AI Item Center (Oxygen AIIC) V1: An Industrial-Scale LLM/VLM-Centric Solution for Item Understanding, Management, and Applications
JD.com's Oxygen AIIC applies LLMs/VLMs with a Semantic Search then Discrimination architecture and self-evolving models to produce item knowledge at industrial scale, reporting 94.2% precision and 82.8% recall.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.