VehicleX: Simulating Content Consistent Vehicle Datasets with Attribute Descent (ECCV 2020)

yorkeyao, updated 🕥 2022-04-15 09:40:21



This repository includes our code for the paper 'Simulating Content Consistent Vehicle Datasets with Attribute Descent' in ECCV2020. The VehicleX data is also with CVPR AI City Challenge 2021 and Alice Challenge.

Related material: Paper, Demo, 6min Presentation, 1min Intro.

You may play with our Demo for a quick view of our data. This demo contains 70 ids out of 1362. The whole procedure of using VehicleX images is in three steps:

1) Attribute distribution learning and generate images by VehicleX engine with learned attributes (content level domain adaptation);

2) Perform style level domain adaptation (SPGAN) for generated images;

3) Train a re-ID model for style transfered images.

The code for the three steps is available on ./VehicleX Interface, ./StyleDA and ./Re-ID respectively. You are welcomed to use every single part of the code for your research purpose. Unity source code for VehicleX is also available on ./Unity Source.

VehicleX Adapted Images

We make generated images from VehicleX directly. We have performed domain adaptation (both content level and style level) from VehicleX to VeRi-776, VehicleID and CityFlow respectively. They can be used to augment real-world data. The adaptated images can be downloaded the tabel below.

| | VeRi-776 | VehicleID | CityFlow | |--------------|------------------|------------------|-----------| | w Style | Baidu(pwd:nz36),Google | Baidu(pwd:akjh),Google | Website |

The adapted image for CityFlow is used in AI City Challenge 2020 track 2. You may need to sign up to get CityFlow dataset access. The labeling format for all vehicleX data is "id_cam_num.jpg":

Taking "0001_c001_33.jpg" as an example: * 0001 means the vehicle id is 0001 * c001 means the camera id is 001 * 33 is the counting number

We also provide detailed labeling include vechile orientation, light intensity, light direction, camera distance, camera height, vehicle type and vehicle color in the XML file. The detailed labeling allows multi task learning.

We released our joint training code (two stage training) with VeRi-776, VehicleID and CityFlow in ./Re-ID

VehicleX Engine (Unity-python Interface)

We provide a Unity-Python Interface, which you may generate your own images from python code without modifying Unity Environment or C# programming. You can perform attribute learning using attribute descent and then generate vehicle data with learned attributes. Please check ./VehicleX Interface for more details.

VehicleX Source Code and 3D Vehicle Models

If you want to make modification to the 3D environment or use our 3D vehicle models only (i.e. for 3D related project). We provide .fbx format vehicle models, which you may import to Unity, Unreal or Blender. We also released entire Unity project. Please check ./Unity Source for more details.

If you find this code useful, please kindly cite:

@inproceedings{yao2020simulating, title={Simulating Content Consistent Vehicle Datasets with Attribute Descent}, author={Yao, Yue and Zheng, Liang and Yang, Xiaodong and Naphade, Milind and Gedeon, Tom}, booktitle={ECCV}, year={2020} } @inproceedings{tang2019pamtri, title={Pamtri: Pose-aware multi-task learning for vehicle re-identification using highly randomized synthetic data}, author={Tang, Zheng and Naphade, Milind and Birchfield, Stan and Tremblay, Jonathan and Hodge, William and Kumar, Ratnesh and Wang, Shuo and Yang, Xiaodong}, booktitle={ICCV}, year={2019} }

If you have any question, feel free to contact [email protected]


Blender problem

opened on 2022-09-14 02:53:37 by DDXDaniel

Hello,I couldn't find .fbx files that I can import to Blender, could you please tell me the location? Thank you!

background images download problem

opened on 2022-07-25 06:27:48 by windspire

Hi, The background image cannot be downloaded via the sharing link , would you please provide other download links? thank you

How to set camera intrinsics?

opened on 2022-05-22 18:12:06 by srikanthmalla

Hi, Is it possible to set different camera parameters while creating images from the 3d models using your plugin? Please let me know.

Thank you, Srikanth

car keypoint extraction

opened on 2022-05-20 20:06:07 by srikanthmalla

Hi, Thanks for open sourcing such an amazing simulator. Is there any update on the keypoint generation using the vehicle X interface ( If the annotations are not available, can you point us to how to access 3D models (so we can annotate 3d keypoints) and how to put them in the plugin to generate 2d locations of the keypoints? Please let us know.

Thank you!

yue yao

PhD student at Australian National University

GitHub Repository

vehicle-search vehicle-reid vehicle-reidentification cityflow unity reid re-identification