Research Project

GraphMaster

Automated Graph Synthesis via LLM Agents in Data-Limited Environments

NeurIPS 2025 Spotlight
Enjun Du1, Xunkai Li1, Tian Jin2, Zhihan Zhang1, Rong-Hua Li1*, Guoren Wang1
1Beijing Institute of Technology    2HKUST(GZ)
Affiliation logoAffiliation logo
GraphMaster overview
Figure 1: GraphMaster — a hierarchical multi-agent framework orchestrating four specialized LLM agents for automated text-attributed graph synthesis.
4 agents A coordinated synthesis team Manager, Perception, Enhancement, and Evaluation agents refine graphs together.
6 benchmarks Designed for data-limited graphs New “Sub” variants test semantic and structural fidelity under realistic scarcity.
0.988 Label homogeneity Synthesized graphs preserve task-relevant semantic structure.

Abstract

Graph Foundation Models need large, diverse graph corpora, but real-world graphs are often small, private, or expensive to annotate. GraphMaster turns graph synthesis into a coordinated agent workflow: four specialized LLM agents iteratively expand a text-attributed graph while preserving both its meaning and topology.


Motivation

The goal is not merely to make a graph larger. The new nodes must read naturally, connect plausibly, and remain useful for downstream learning.

Classical augmentation methods mainly manipulate topology and cannot generate meaningful textual attributes. Direct LLM generation introduces a different set of problems: whole graphs exceed context windows, locally plausible additions may violate global structure, and hallucinated nodes or edges can silently corrupt the training signal.


Method

Framework

GraphMaster decomposes synthesis into four accountable roles:

  • Manager Agent — Selects semantic or topological enhancement according to the current graph state and coordinates the workflow.
  • Perception Agent — Overcomes context-window limitations via semantic-aware community detection, mode-adaptive seed selection, and hierarchical PPR-based diffusion sampling to extract representative subgraphs.
  • Enhancement Agent — Generates new nodes and edges conditioned on extracted knowledge, with dual-mode generation for semantic coherence and structural fidelity.
  • Evaluation Agent — Scores semantic and structural quality, then decides whether another refinement round is needed.

Experimental Results

Evaluated on 6 data-limited benchmarks with 4 GNN architectures (GCN, JKNET, GraphSage, GAT) on 8x A100 GPUs using QwQ-32B as the base LLM.

Main Results

GraphMaster consistently outperforms all baselines across all datasets. The bottom row (blue) shows GraphMaster achieving the highest accuracy and F1 scores on every benchmark.

Graph Feature Preservation

Feature Analysis

The synthesized graphs maintain high fidelity: KS statistic 0.357 (p=0.059) for degree distribution, 0.835 clustering coefficient similarity, and 0.988 label homogeneity — indicating near-perfect structural preservation.

Ablation Study

Ablation

Removing the Evaluation Agent causes the largest performance drop, confirming the critical role of iterative quality control. Each agent contributes uniquely to the final synthesis quality.

Citation

@inproceedings{du2025graphmaster,
  title     = {GraphMaster: Automated Graph Synthesis via LLM Agents
               in Data-Limited Environments},
  author    = {Du, Enjun and Li, Xunkai and Jin, Tian and Zhang, Zhihan
               and Li, Rong-Hua and Wang, Guoren},
  booktitle = {Advances in Neural Information Processing Systems (NeurIPS)},
  year      = {2025},
  note      = {Spotlight}
}