Data · dataset · 2022
Replication Data for: Learning Facial Representations from the Cycle-consistency of Face
Listed in NYCU Dataverse
Faces manifest large variations in many aspects, such as identity, expression, pose, and face styling.
Description
Therefore, it is a great challenge to disentangle and extract these characteristics from facial images, especially in an unsupervised manner. In this work, we introduce cycle-consistency in facial characteristics as free supervisory signal to learn facial representations from unlabeled facial images.
The learning is realized by superimposing the facial motion cycle-consistency and identity cycle-consistency constraints. The main idea of the facial motion cycle-consistency is that, given a face with expression, we can perform de-expression to a neutral face via the removal of facial motion and further perform re-expression to reconstruct back to the original face. The main idea of the identity cycle-consistency is to exploit both de-identity into mean face by depriving the given neutral face of its identity via feature re-normalization and re-identity into neutral face by adding the personal attributes to the mean face.
Read the rest (2 more)
At training time, our model learns to disentangle two distinct facial representations to be useful for performing cycle-consistent face reconstruction. At test time, we use the linear protocol scheme for evaluating facial representations on various tasks, including facial expression recognition and head pose regression. We also can directly apply the learnt facial representations to person recognition, frontalization and image-to-image translation.
Our experiments show that the results of our approach is competitive with those of existing methods, demonstrating the rich and unique information embedded in the disentangled representations.
Links
Where it is published
- Dataverse dataset page dataverse.lib.nycu.edu.tw/dataset.xhtml?persistentId=doi%3A10.57770%2FP7TNVX ↗
landing page · from dataverse lib nycu edu tw
- DOI doi.org/10.57770/p7tnvx ↗
DOI / persistent id · from dataverse lib nycu edu tw
Catalogue records · 1
- Dataverse API dataverse.lib.nycu.edu.tw/api/datasets/:persistentId/?persistentId=doi%3A10.57770%2FP7TN… ↗
metadata API · from dataverse lib nycu edu tw
Topics
- Stated by source
- Computer and Information Science
- Inferred from text
- Image 65%
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| NYCU Dataverse | doi:10.57770/P7TNVX | 16 h ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].dataverse_subject:computer-and-information-science | source · dataverse lib nycu edu tw | connector:dataverse_lib_nycu_edu_tw@1.0.0 | /subjects |
| concepts[modality].local:modality:image | enrichment · dataverse lib nycu edu tw | keyword-concept-rules@1.0.0 | title+description (65%) |
| created_date | source · dataverse lib nycu edu tw | connector:dataverse_lib_nycu_edu_tw@1.0.0 | |
| description | source · dataverse lib nycu edu tw | connector:dataverse_lib_nycu_edu_tw@1.0.0 | /description |
| publication_date | source · dataverse lib nycu edu tw | connector:dataverse_lib_nycu_edu_tw@1.0.0 | |
| title | source · dataverse lib nycu edu tw | connector:dataverse_lib_nycu_edu_tw@1.0.0 | /name |
| updated_date | source · dataverse lib nycu edu tw | connector:dataverse_lib_nycu_edu_tw@1.0.0 | |
| version_label | source · dataverse lib nycu edu tw | connector:dataverse_lib_nycu_edu_tw@1.0.0 |