Controllable Group Choreography Using Contrastive Diffusion



Le, Nhat ORCID: 0009-0007-1122-4981, Do, Tuong ORCID: 0000-0002-3290-3787, Do, Khoa ORCID: 0009-0008-3819-1312, Nguyen, Hien ORCID: 0009-0003-1589-6583, Tjiputra, Erman ORCID: 0009-0003-6909-4623, Tran, Quang D ORCID: 0000-0001-5839-5875 and Nguyen, Anh ORCID: 0000-0002-1449-211X
(2023) Controllable Group Choreography Using Contrastive Diffusion. ACM Transactions on Graphics, 42 (6). pp. 1-14.

[img] PDF
2023_SIGGRAPHAsia_CGD.pdf - Author Accepted Manuscript

Download (24MB) | Preview

Abstract

<jats:p>Music-driven group choreography poses a considerable challenge but holds significant potential for a wide range of industrial applications. The ability to generate synchronized and visually appealing group dance motions that are aligned with music opens up opportunities in many fields such as entertainment, advertising, and virtual performances. However, most of the recent works are not able to generate high-fidelity long-term motions, or fail to enable controllable experience. In this work, we aim to address the demand for high-quality and customizable group dance generation by effectively governing the consistency and diversity of group choreographies. In particular, we utilize a diffusion-based generative approach to enable the synthesis of flexible number of dancers and long-term group dances, while ensuring coherence to the input music. Ultimately, we introduce a Group Contrastive Diffusion (GCD) strategy to enhance the connection between dancers and their group, presenting the ability to control the consistency or diversity level of the synthesized group animation via the classifier-guidance sampling technique. Through intensive experiments and evaluation, we demonstrate the effectiveness of our approach in producing visually captivating and consistent group dance motions. The experimental results show the capability of our method to achieve the desired levels of consistency and diversity, while maintaining the overall quality of the generated group choreography.</jats:p>

Item Type: Article
Uncontrolled Keywords: Mind and Body
Divisions: Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User: Symplectic Admin
Date Deposited: 15 Dec 2023 11:08
Last Modified: 17 Mar 2024 19:09
DOI: 10.1145/3618356
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3177435