Patents

FACE SYNTHESIS FOR PRIVATIZATION

Published:

Abstract

TBD

Recommended citation: Guangyu Shen, Dongsheng An, Qin Zhang, Tianjun Xiao, Tong He, Ying Nian Wu, Onkar Dabeer, Dripta Raychaudhuri, Yifan Xing

HIERARCHICAL GRAPH NEURAL NETWORKS FOR VISUAL CLUSTERING

Published:

Abstract

Visual clustering is an essential technology for many real-world applications, for instance, automatic photo grouping, image tagging and data annotation for machine learning systems. We propose a hierarchical graph neural network framework as well as a joint linkage prediction and density estimation graph model for visual clustering. Visual clustering is the task of grouping visually similar images together from an unorganized set. Graph neural network deals with complex graph structure to extract useful semantic information. Graph neural network based visual clustering methods rely on the construction of a k-nearest neighbor graph built from the visual embedding set of the input images. However, single graph neural network based visual clustering is very sensitive to the selection of the k-bandwidth parameter during the construction process of the k-nearest neighbor graph. For instance, one might need very different k to make the model work on face image and clothing image clustering. To this end, this invention proposes a method to deal with the sensitivity of the k-bandwidth parameter and bypass the need to tune it for different applications.

Recommended citation: Tianjun Xiao, Yifan Xing, Tong He, Yuanjun Xiong, Wei Xia, David Wipf, Zheng Zhang, Stefano, Soatto

IMAGE ANNOTATION

Published:

Abstract

The description relates to diversified hybrid image annotation for annotating images. One implementation includes generating first image annotations for a query image using a retrieval-based image annotation technique. Second image annotations can be generated for the query image using a model-based image annotation technique. The first and second image annotations can be integrated to generate a diversified hybrid image annotation result for the query image.

Recommended citation: Yokesh KUMAR, Kuang-Huei LEE, Houdong HU, Li HUANG, Arun SACHETI, Meenaz MERCHANT, Linjun YANG, Tianjun XIAO, Saurajit MUKHERJEE. US Patent 20190294705