Affordance diffusion: Synthesizing hand-object interactions

Y Ye, X Li, A Gupta, S De Mello… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent successes in image synthesis are powered by large-scale diffusion models.
However, most methods are currently limited to either text-or image-conditioned generation
for synthesizing an entire image, texture transfer or inserting objects into a user-specified
region. In contrast, in this work we focus on synthesizing complex interactions (ie, an
articulated hand) with a given object. Given an RGB image of an object, we aim to
hallucinate plausible images of a human hand interacting with it. We propose a two step …

[PDF][PDF] Affordance Diffusion: Synthesizing Hand-Object Interactions Supplementary Materials

Y Ye, X Li, A Gupta, S De Mello, S Birchfield, J Song… - openaccess.thecvf.com
In the supplementary material, we provide more implementation details and more qualitative
results. We discuss the details of articulation-agnostic hand proxy and how to apply DDPM
loss in the image space for training the LayoutNet (Sec. A. 1). We also present ablations on
Content-Net (Sec. A. 2). We further show:(i) the paired data construction method being
robust, in Sec. A. 3,(ii) baseline implementations details in Sec. A. 4,(iii) details of integrating
our approach to scene-level affordance prediction in Sec. A. 5. Finally, we discuss the …
この検索の最上位の結果を表示しています。 検索結果をすべて見る