Recursive kernel trick for network segmentation

S. Y. Kung, Yuhui Luo

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Kernel K-means has been a powerful unsupervised machine learning tool for cluster discovery. This paper explores its application towards network segmentation, a type of cluster discovery. Very commonly we encounter networks of extremely large size, making computational complexity a major issue in the algorithmic development. In this regard, the sparse structure of kernel matrices can be an invaluable asset. For partitioning nonvectorial data such as network graphs, we need to use a vector-free clustering criterion for K-means. The kernel matrix constructed from nonvectorial data usually needs to be preprocessed to assure Mercer's condition, which is required to guarantee monotonic convergence of the kernel K-means algorithm. This paper describes a centroid-free criterion for K-means so that it can be applied to nonvectorial data such as network segmentation. Such a criterion leads to our introduction of pattern-centroid similarity which ultimately leads to a kernel trick algorithm based on updating of the pattern-centroid similarity. Furthermore, by adopting a recursive updating scheme, the recursive kernel-trick allows a computational saving from O(N2/K) to O(N). For networks with high sparsity structure, the amount of computation required can be further reduced from O(N) to O(Ns), where Ns is the average number of nonzero elements per column in the kernel matrix.

Original languageEnglish (US)
Pages (from-to)1807-1822
Number of pages16
JournalInternational Journal of Robust and Nonlinear Control
Volume21
Issue number15
DOIs
StatePublished - Oct 2011

All Science Journal Classification (ASJC) codes

  • Mechanical Engineering
  • Aerospace Engineering
  • General Chemical Engineering
  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Industrial and Manufacturing Engineering
  • Biomedical Engineering

Keywords

  • computational saving
  • graph partitioning
  • kernel k-means for cluster discovery and network segmentation
  • recursive kernel trick
  • sparsity

Fingerprint

Dive into the research topics of 'Recursive kernel trick for network segmentation'. Together they form a unique fingerprint.

Cite this