Pith. sign in

REVIEW 9 cited by

The ArtBench Dataset: Benchmarking Generative Models with Artworks

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2206.11404 v1 pith:VW3MJ2PK submitted 2022-06-22 cs.CV cs.AIcs.LG

The ArtBench Dataset: Benchmarking Generative Models with Artworks

classification cs.CV cs.AIcs.LG
keywords artbench-10artworkdatasetimagesbenchmarkingartbenchclass-balanceddatasets
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

We introduce ArtBench-10, the first class-balanced, high-quality, cleanly annotated, and standardized dataset for benchmarking artwork generation. It comprises 60,000 images of artwork from 10 distinctive artistic styles, with 5,000 training images and 1,000 testing images per style. ArtBench-10 has several advantages over previous artwork datasets. Firstly, it is class-balanced while most previous artwork datasets suffer from the long tail class distributions. Secondly, the images are of high quality with clean annotations. Thirdly, ArtBench-10 is created with standardized data collection, annotation, filtering, and preprocessing procedures. We provide three versions of the dataset with different resolutions ($32\times32$, $256\times256$, and original image size), formatted in a way that is easy to be incorporated by popular machine learning frameworks. We also conduct extensive benchmarking experiments using representative image synthesis models with ArtBench-10 and present in-depth analysis. The dataset is available at https://github.com/liaopeiyuan/artbench under a Fair Use license.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Training-free Task Classification for Multi-Task Model Merging

    cs.LG 2026-06 conditional novelty 7.0

    SiM enables training-free routing in multi-task model merging by scoring test inputs via projection residuals onto SVD-based task manifolds precomputed from small support sets.

  2. Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing

    cs.CV 2026-05 unverdicted novelty 7.0

    Chameleon proposes the first large-scale cross-domain compositing dataset and a disentangled encoder plus gated diffusion transformer that outperforms prior in-domain and cross-domain methods on plausibility and fidelity.

  3. MM-JudgeBias: A Benchmark for Evaluating Compositional Biases in MLLM-as-a-Judge

    cs.CL 2026-04 unverdicted novelty 7.0

    MM-JudgeBias benchmark shows that many MLLM judges neglect modalities and produce unstable evaluations under small input changes, based on tests of 26 models with over 1,800 samples.

  4. Learning to Recover Task Experts from a Multi-Task Merged Model

    cs.AI 2026-06 unverdicted novelty 6.0

    ReTeX predicts additive offsets to undo merging interference and uses an SVD subspace signature task identifier to recover over 95% of expert performance while improving generalization to unseen tasks.

  5. Training data attribution in diffusion models via mirrored unlearning and noise-consistent skew

    cs.LG 2026-05 unverdicted novelty 6.0

    MUCS uses mirrored unlearning and noise-consistent skew to outperform prior TDA methods for diffusion models on three datasets.

  6. Stylistic Attribute Control in Latent Diffusion Models

    cs.CV 2026-05 unverdicted novelty 6.0

    A technique for parametric stylistic control in latent diffusion models learns disentangled directions from synthetic datasets and applies them via guidance composition while preserving semantics.

  7. HyCal: A Training-Free Prototype Calibration Method for Cross-Discipline Few-Shot Class-Incremental Learning

    cs.CV 2026-04 unverdicted novelty 6.0

    HyCal mitigates Domain Gravity in cross-discipline imbalanced few-shot class-incremental learning by calibrating prototypes with complementary directional and covariance-aware distances on frozen CLIP embeddings.

  8. Insert In Style: A Zero-Shot Generative Framework for Harmonious Cross-Domain Object Composition

    cs.CV 2025-11 unverdicted novelty 6.0

    Insert In Style is a zero-shot framework that disentangles identity, style, and composition via multi-stage training, masked attention, and prior preservation to enable harmonious cross-domain object insertion in images.

  9. Stitching Gaps: Fusing Situated Perceptual Knowledge with Vision Transformers for High-Level Image Classification

    cs.CV 2024-02 unverdicted novelty 4.0

    Hybrid knowledge graph embeddings fused with vision transformer features outperform standard techniques on abstract concept classification by integrating situated perceptual knowledge from a new cultural image resource.