REVIEW 6 cited by
Loghub: A Large Collection of System Log Datasets for AI-driven Log Analytics
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Loghub: A Large Collection of System Log Datasets for AI-driven Log Analytics
read the original abstract
Logs have been widely adopted in software system development and maintenance because of the rich runtime information they record. In recent years, the increase of software size and complexity leads to the rapid growth of the volume of logs. To handle these large volumes of logs efficiently and effectively, a line of research focuses on developing intelligent and automated log analysis techniques. However, only a few of these techniques have reached successful deployments in industry due to the lack of public log datasets and open benchmarking upon them. To fill this significant gap and facilitate more research on AI-driven log analytics, we have collected and released loghub, a large collection of system log datasets. In particular, loghub provides 19 real-world log datasets collected from a wide range of software systems, including distributed systems, supercomputers, operating systems, mobile systems, server applications, and standalone software. In this paper, we summarize the statistics of these datasets, introduce some practical usage scenarios of the loghub datasets, and present our benchmarking results on loghub to benefit the researchers and practitioners in this field. Up to the time of this paper writing, the loghub datasets have been downloaded for roughly 90,000 times in total by hundreds of organizations from both industry and academia. The loghub datasets are available at https://github.com/logpai/loghub.
Forward citations
Cited by 6 Pith papers
-
State Machine Guided Multi-Relational Synthetic Data from Logs for Anomaly Detection
A framework extracts a latent state machine from logs, induces a multi-table relational schema, and uses it as a generative prior to create synthetic data that augments real logs for better anomaly detection.
-
Seeing the Needle in the Haystack: Towards Weakly-Supervised Log Instance Anomaly Localization via Counterfactual Perturbation
LogMILP enables both bag-level anomaly detection and instance-level localization in logs using only bag-level labels via prototype-guided structural modeling and counterfactual perturbation regularization.
-
From IOCs to Regex: Automating CTI Operationalization for SOC with LLMs
IOCRegex-gen automates IOC-to-regex conversion with LLMs via group-aware grouping and multi-stage validation, reporting 99.1% hit rate and 0.8% false-positive rate on 3000+ CTI reports and 2400 ground-truth strings.
-
AnomalyGen: Enhancing Log-Based Anomaly Detection with Code-Guided Data Augmentation
AnomalyGen synthesizes realistic labeled log sequences from source code via Log-Oriented Control Flow Graphs and LLM CoT verification to boost F1 scores of 12 anomaly detection models on HDFS and Zookeeper.
-
LLM-Enhanced Log Anomaly Detection: A Comprehensive Benchmark of Large Language Models for Automated System Diagnostics
A benchmark finds prompt-based LLMs achieve F1 scores of 0.82-0.91 for log anomaly detection in zero-shot settings without any labeled training data, while fine-tuned transformers reach 0.96-0.99.
-
NLLog: Lightweight, Explainable SOC Anomaly Detection via Log-to-Language Rewriting
NLLog rewrites log templates into WHO-WHAT-SEVERITY sentences, applies TF-IDF pooling and tree-ensemble classification with TreeSHAP back-projection, and reports better performance than two reproduced baselines on HDF...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.