人工智能培训

搜索

人工智能论文:图像社会关系识别的多粒度推理(Multi-Granularity Reasoning for Social Relation Recognitio

[复制链接]
xc133280 发表于 2019-1-11 10:39:41 | 显示全部楼层 |阅读模式
xc133280 2019-1-11 10:39:41 293 0 显示全部楼层
人工智能论文:图像社会关系识别的多粒度推理(Multi-Granularity Reasoning for Social Relation Recognition from Images)发现图像中的社会关系可以使机器更好地解释人类的行为。然而,由于视觉内容和社会关系领域之间存在显着差异,因此自动识别图像中的社交关系是一项具有挑战性的任务。现有的研究分别处理各种特征,如人脸表情,身体外观和情境对象,因此无法全面捕捉多粒度语义,如场景,人物的区域线索,以及人与物之间的相互作用。为了弥合领域差距,我们提出了一种用于社交关系识别的多粒度推理框架。全局知识和中级细节分别从整个场景以及人和物体的区域中学习。最重要的是,我们探索人的细粒度姿势关键点,以发现人与物之间的相互作用。具体而言,建议使用姿势引导的人 - 对象图和人 - 姿势图来模拟人与对象之间的动作以及成对人之间的交互。在图形的基础上,社会关系推理由图形卷积网络完成。最后,将全局特征和推理知识结合为社会关系识别的综合表示。两个公共数据集的广泛实验表明了拟议框架的有效性。
Discovering social relations in images can make machines better interpret thebehavior of human beings.However, automatically recognizing social relationsin images is a challenging task due to the significant gap between the domainsof visual content and social relation.Existing studies separately processvarious features such as faces expressions, body appearance, and contextualobjects, thus they cannot comprehensively capture the multi-granularitysemantics, such as scenes, regional cues of persons, and interactions amongpersons and objects.To bridge the domain gap, we propose a Multi-GranularityReasoning framework for social relation recognition from images.The globalknowledge and mid-level details are learned from the whole scene and theregions of persons and objects, respectively.Most importantly, we explore thefine-granularity pose keypoints of persons to discover the interactions amongpersons and objects.Specifically, the pose-guided Person-Object Graph andPerson-Pose Graph are proposed to model the actions from persons to object andthe interactions between paired persons, respectively.Based on the graphs,social relation reasoning is performed by graph convolutional networks.Finally, the global features and reasoned knowledge are integrated as acomprehensive representation for social relation recognition.Extensiveexperiments on two public datasets show the effectiveness of the proposedframework.人工智能论文:图像社会关系识别的多粒度推理(Multi-Granularity Reasoning for Social Relation Recognition from Images) APL9XWxYrlxpvQ1L.jpg
URL地址:https://arxiv.org/abs/1901.03067     ----pdf下载地址:https://arxiv.org/pdf/1901.03067    ----人工智能论文:图像社会关系识别的多粒度推理(Multi-Granularity Reasoning for Social Relation Recognition from Images)
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则 返回列表 发新帖

xc133280当前离线
新手上路

查看:293 | 回复:0

快速回复 返回顶部 返回列表