Official Github repository for the CVPR 2022 paper "GIRAFFE HD: A High-Resolution 3D-aware Generative Model"

Overview

GIRAFFE HD: A High-Resolution 3D-aware Generative Model

Project Page
Paper

concept

Usage

Create and activate conda environment 'giraffehd':

conda env create -f environment.yml
conda activate giraffehd

Train

Create lmdb dataset:

python prepare_data.py --out LMDB_PATH --n_worker N_WORKER --size SIZE DATASET_PATH

This will convert images to jpeg and pre-resizes them.

Train model in distributed settings:

python -m torch.distributed.launch --nproc_per_node=N_GPU --master_port=PORT train.py \
--wandb --batch BATCH_SIZE --dataset DATASET --size SIZE --datasize DATASIZE LMDB_PATH

Evaluate

Evaluate trained model:

python eval.py --ckpt CKPT --batch BATCH_SIZE --control_i CONTROL_I

Use --control_i to specify which feature to control,

0: fg_shape; 1: fg_app; 2: bg_shape; 3: bg_app; 4: camera rotation angle; 5: elevation angle;
7: scale; 8: translation; 9: rotation;

Change L168-183 in eval.py to specify interpolation interval if needed (training intervals will be used if not specified). For example, set --control_i to 8, and

args.translation_range_min = [0., 0., -0.1]
args.translation_range_max = [0., 0., 0.1]

to perform object vertical translation.

Checkpoints

Model checkpoints are available in google drive.

Acknowledgment

Thanks to giraffe and stylegan2-pytorch

License

This repository is released under the MIT license.

Citation

@inproceedings{xue2022giraffehd,
author    = {Yang Xue and Yuheng Li and Krishna Kumar Singh and Yong Jae Lee},
title     = {GIRAFFE HD: A High-Resolution 3D-aware Generative Model},
booktitle   = {CVPR},
year      = {2022},
}
You might also like...

The official implementation of the CVPR'2022 paper SimVP: Simpler Yet Better Video Prediction.

The official implementation of the CVPR'2022 paper SimVP: Simpler Yet Better Video Prediction.

SimVP: Simpler yet Better Video Prediction This repository contains the implementation code for paper: SimVP: Simpler yet Better Video Prediction Zhan

Sep 29, 2022

Official repo for CVPR 2022 (Oral) paper: Revisiting the "Video" in Video-Language Understanding. Contains code for the Atemporal Probe (ATP).

Official repo for CVPR 2022 (Oral) paper: Revisiting the

Revisiting the "Video" in Video-Language Understanding Welcome to the official repo for our paper: Revisiting the "Video" in Video-Language Understand

Sep 21, 2022

The official PyTorch implementation of oral paper "FocusCut: Diving into a Focus View in Interactive Segmentation" in CVPR 2022.

FocusCut The official PyTorch implementation of oral paper "FocusCut: Diving into a Focus View in Interactive Segmentation" in CVPR2022. Prepare See r

Sep 19, 2022

GitHub repository for Edinburgh-UHAS Ghana iGEM 2022 team

Edi_iGEM_2022 GitHub repository for Edinburgh-UHAS Ghana iGEM 2022 team Hi everyone! Here is the GitHub repository where we will be storing our code a

Jun 14, 2022

The official repository for Efficient Long-Text Understanding Using Short-Text Models (Ivgi et al., 2022) paper

SLED The official repository for Efficient Long-Text Understanding Using Short-Text Models (Ivgi et al., 2022). SLED models use pretrained, short-rang

Sep 13, 2022

Official Repository for the 3D 2022 paper "The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs"

Official Repository for the 3D 2022 paper

The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs (3DV 2022) Chris Rockwell, Justin Johnson and David F. Fouhey Project

Sep 24, 2022

Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data - Official PyTorch Implementation (CVPR 2022)

Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data - Official PyTorch Implementation (CVPR 2022)

Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data (CVPR 2022) Potentials of primitive shapes f

Aug 2, 2022

Official source code of Fast Point Transformer, CVPR 2022

Official source code of Fast Point Transformer, CVPR 2022

Fast Point Transformer Project Page | Paper This repository contains the official source code and data for our paper: Fast Point Transformer Chunghyun

Sep 30, 2022

Official implementation for "QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translation" (CVPR 2022)

Official implementation for

QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translation (CVPR2022) https://arxiv.org/abs/2203.08483 Unpaired image-to-image (I2I

Sep 8, 2022
Comments
  • Set --control_i to 10 or 11

    Set --control_i to 10 or 11

    Thank you for releasing the code. Why do I get an error when I set -- CONTROL_i to 10 and 11? File "eval.py", line 120, in eval img_rep[args.control_i] = p IndexError: list assignment index out of range

    opened by hhuyujie 2
GitHub Issues Blog, powered by GitHub Issues and GitHub Actions

看看月亮吧 置顶 ?? 为什么会出现这个博客 0 ?? 最新 ?? 为什么会出现这个博客 0 ?? 2022-05-12 06:03:26 ??️ : ?? 置顶, ✏️ 随笔 碎碎念 关于为什么现在才开始写博客,其实我更愿意把这称为笔记 之前看过一篇文章,他提到,快速改变人生的五件事情:早起,阅读

Kyun Wong 1 Jul 14, 2022
[CVPR 2022 Oral] Official repository for "MAXIM: Multi-Axis MLP for Image Processing". SOTA for denoising, deblurring, deraining, dehazing, and enhancement.

MAXIM: Multi-Axis MLP for Image Processing (CVPR 2022 Oral) This repo is the official implementation of [CVPR 2022 Oral] paper: "MAXIM: Multi-Axis MLP

Google Research 444 Sep 24, 2022
[CVPR2022] This repository contains code for the paper "Nested Collaborative Learning for Long-Tailed Visual Recognition", published at CVPR 2022

Nested Collaborative Learning for Long-Tailed Visual Recognition This repository is the official PyTorch implementation of the paper in CVPR 2022: Nes

Jun Li 59 Sep 21, 2022
Official PyTorch implementation of the paper "Deep Constrained Least Squares for Blind Image Super-Resolution", CVPR 2022.

Deep Constrained Least Squares for Blind Image Super-Resolution [Paper] This is the official implementation of 'Deep Constrained Least Squares for Bli

MEGVII Research 111 Sep 23, 2022
Official code of the paper "Expanding Low-Density Latent Regions for Open-Set Object Detection" (CVPR 2022)

OpenDet Expanding Low-Density Latent Regions for Open-Set Object Detection (CVPR2022) Jiaming Han, Yuqiang Ren, Jian Ding, Xingjia Pan, Ke Yan, Gui-So

csuhan 54 Sep 14, 2022
Official implementation of the paper 'Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolution' in CVPR 2022

LDL Paper | Supplementary Material Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolution Jie Liang*, Hu

null 132 Sep 28, 2022
Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning

Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning This is the official PyTorch implementation of our C

null 37 Sep 28, 2022
Official Implement of CVPR 2022 paper 'Boosting Crowd Counting via Multifaceted Attention'

Boosting-Crowd-Counting-via-Multifaceted-Attention Official Implement of CVPR 2022 paper 'Boosting Crowd Counting via Multifaceted Attention' arxiv |

Lora 34 Sep 23, 2022
An official implementation of CVPR 2022 paper "Label Matching Semi-Supervised Object Detection".

MMDetection-based Toolbox for Semi-Supervised Object Detection Supported algorithms STAC:A Simple Semi-Supervised Learning Framework for Object Detect

Hikvision Research Institute 44 Sep 28, 2022