Computer Science > Machine Learning
[Submitted on 8 Sep 2021 (v1), revised 1 Dec 2021 (this version, v2), latest version 27 Jun 2022 (v4)]
Title:Local Augmentation for Graph Neural Networks
View PDFAbstract:Data augmentation has been widely used in image data and linguistic data but remains under-explored for Graph Neural Networks (GNNs). Existing methods focus on augmenting the graph data from a global perspective and largely fall into two genres: structural manipulation and adversarial training with feature noise injection. However, recent graph data augmentation methods ignore the importance of local information for the GNNs' message passing mechanism. In this work, we introduce the local augmentation, which enhances the locality of node representations by their subgraph structures. Specifically, we model the data augmentation as a feature generation process. Given a node's features, our local augmentation approach learns the conditional distribution of its neighbors' features and generates more neighbors' features to boost the performance of downstream tasks. Based on the local augmentation, we further design a novel framework: LA-GNN, which can apply to any GNN models in a plug-and-play manner. Extensive experiments and analyses show that local augmentation consistently yields performance improvement for various GNN architectures across a diverse set of benchmarks.
Submission history
From: Songtao Liu [view email][v1] Wed, 8 Sep 2021 18:10:08 UTC (136 KB)
[v2] Wed, 1 Dec 2021 14:13:30 UTC (149 KB)
[v3] Fri, 17 Jun 2022 02:21:01 UTC (241 KB)
[v4] Mon, 27 Jun 2022 22:05:24 UTC (241 KB)
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
IArxiv Recommender
(What is IArxiv?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.