Tencent Video Dataset (TVD)

Learning-based visual data compression and analysis have attracted strong interest from academia and industry. High-quality video datasets are highly desirable for related research and standardization activities for training and testing purposes. A few examples of these standardization activities include JPEG AI, JVET Neural Network Video Coding (NNVC), and MPEG Video Coding for Machines (VCM). The TVD dataset serves various purposes for activities such as training neural-network-based coding tools and testing machine vision tasks like object detection and tracking.

The TVD dataset includes 86 video sequences with a variety of content coverage. Each video sequence consists of 65 frames at 3840x2160 spatial resolution. JVET NNVC exploration activities have utilized this video dataset as a training set. Additional sets for various exploration activities are available as described below.

For object detection exploration, Media Lab created a specialized set by sampling 166 images from the TVD dataset at 1920x1080 spatial resolution in RGB24 png format along with bounding box annotations.

For instance segmentation exploration, Media Lab created a specialized set with segmentation mask annotations for the images from the object detection set. This set with the 166 images, bounding boxes, and segmentation mask annotations is a test set for the common test conditions (CTC) of MPEG VCM.

For object tracking exploration, Media Lab provides a specialized set with longer versions of three video sequences with object tracking annotations. This set with the video sequences and annotations is also a test set for the common test conditions (CTC) of MPEG VCM.

Keywords
  • Video Compression
  • Machine Learning
  • Video Coding for Machines
  • Object Detection
  • Instance Segmentation
  • Object Tracking
References
  • X. Xu, S. Liu and Z. Li, "A Video Dataset for Learning-based Visual Data Compression and Analysis", 2021 International Conference on Visual Communications and Image Processing (VCIP) (link)
  • W. Gao, X. Xu, M. Qin, S. Liu, "An Open Dataset for Video Coding for Machines Standardization", 2022 IEEE International Conference on Image Processing (ICIP) (link)
  • Haiqiang Wang, Xin Zhao, Ding Ding, Xiang Pan, Zizheng Liu, Xiaozhong Xu, and Shan Liu, "Improvements of the BD-rate model using monotonic curve-fitting method", arXiv, 2023

Download

Preview

No.ThumbnailFilenameBrief Description
1GrassLand_3840x2160_50fps_8bit_420GrassLand_3840x2160_50fps_8bit_420Grass swinging
2MovingBikes_3840x2160_50fps_8bit_420MovingBikes_3840x2160_50fps_8bit_420Bikes passing by
3FallingLeaves_3840x2160_50fps_8bit_420FallingLeaves_3840x2160_50fps_8bit_420Leaves falling down
4FallenLeaves_3840x2160_50fps_8bit_420FallenLeaves_3840x2160_50fps_8bit_420Fallen leaves on the ground
5GirlThrowingLeaves_3840x2160_50fps_8bit_420GirlThrowingLeaves_3840x2160_50fps_8bit_420Girl collecting the leaves on the ground
6TreeTrunkMoving_3840x2160_50fps_8bit_420TreeTrunkMoving_3840x2160_50fps_8bit_420Tree trunk(moving camera)
7LeavesOnTree_3840x2160_50fps_8bit_420LeavesOnTree_3840x2160_50fps_8bit_420Leaves swinging on the tree
8FruitOnTree_3840x2160_50fps_8bit_420FruitOnTree_3840x2160_50fps_8bit_420Fruit hanging on the tree
9WaterOnGrass1_3840x2160_50fps_8bit_420WaterOnGrass1_3840x2160_50fps_8bit_420Water squirting out(distant view)
10WaterOnGrass2_3840x2160_50fps_8bit_420WaterOnGrass2_3840x2160_50fps_8bit_420Water squirting out(close view)
11GirlWalkingOnStreet_3840x2160_50fps_8bit_420GirlWalkingOnStreet_3840x2160_50fps_8bit_420Girl walking on the street at night
12GirlWatchingPhone_3840x2160_50fps_8bit_420GirlWatchingPhone_3840x2160_50fps_8bit_420Girl watching her cell phone in the dark
13StaticWaterAndBikes2_3840x2160_50fps_10bit_420StaticWaterAndBikes2_3840x2160_50fps_10bit_420Static water with bikes passing by
14FlowingWater_3840x2160_50fps_10bit_420FlowingWater_3840x2160_50fps_10bit_420Water flowing
15Fountain_3840x2160_50fps_10bit_420Fountain_3840x2160_50fps_10bit_420Fountain squirting
16TreesAndLeaves_3840x2160_50fps_10bit_420TreesAndLeaves_3840x2160_50fps_10bit_420Trees and leaves
17GirlRunningOnGrass_3840x2160_50fps_10bit_420GirlRunningOnGrass_3840x2160_50fps_10bit_420Girl running on the grass
18GirlsOnGrass1_3840x2160_50fps_10bit_420GirlsOnGrass1_3840x2160_50fps_10bit_420Two girls running on the grass
19GirlsOnGrass2_3840x2160_50fps_10bit_420GirlsOnGrass2_3840x2160_50fps_10bit_420One girl taking photo of the other on the grass
20PeopleOnGrass_3840x2160_50fps_10bit_420PeopleOnGrass_3840x2160_50fps_10bit_420People walking on the grass
21StaticRocks_3840x2160_50fps_10bit_420StaticRocks_3840x2160_50fps_10bit_420Static rocks
22MovingBikesAndPedestrian4_3840x2160_50fps_10bit_420MovingBikesAndPedestrian4_3840x2160_50fps_10bit_420Bikes and pedestrians passing by
23BoyMakingUp1_3840x2160_50fps_10bit_420BoyMakingUp1_3840x2160_50fps_10bit_420Boy making up on the Great Wall
24BoyMakingUp2_3840x2160_50fps_10bit_420BoyMakingUp2_3840x2160_50fps_10bit_420Boy making up on the Great Wall
25BoyDressing1_3840x2160_50fps_10bit_420BoyDressing1_3840x2160_50fps_10bit_420Boy dressing on the Great Wall
26BoyDressing2_3840x2160_50fps_10bit_420BoyDressing2_3840x2160_50fps_10bit_420Boy dressing on the Great Wall
27BoyWithCostume_3840x2160_50fps_10bit_420BoyWithCostume_3840x2160_50fps_10bit_420Boy wearing opera costume standing on the Great Wall
28SunriseMountainHuang_3840x2160_25fps_10bit_420SunriseMountainHuang_3840x2160_25fps_10bit_420Sunrise at Mountain Huang
29MountainsView1_3840x2160_25fps_10bit_420MountainsView1_3840x2160_25fps_10bit_420The view of Mountain Huang
30MountainsView2_3840x2160_25fps_10bit_420MountainsView2_3840x2160_25fps_10bit_420The view of Mountain Huang
31MountainsView3_3840x2160_25fps_10bit_420MountainsView3_3840x2160_25fps_10bit_420The view of Mountain Huang
32MountainsView4_3840x2160_25fps_10bit_420MountainsView4_3840x2160_25fps_10bit_420The view of Mountain Huang
33MountainsAndStairs1_3840x2160_24fps_10bit_420MountainsAndStairs1_3840x2160_24fps_10bit_420Mountains and stairs
34MountainsAndStairs2_3840x2160_25fps_10bit_420MountainsAndStairs2_3840x2160_25fps_10bit_420Mountains and stairs
35MountainsAndStairs3_3840x2160_25fps_10bit_420MountainsAndStairs3_3840x2160_25fps_10bit_420Mountains and stairs
36MountainsAndStairs4_3840x2160_25fps_10bit_420MountainsAndStairs4_3840x2160_25fps_10bit_420Mountains and stairs
37TreesOnMountains1_3840x2160_25fps_10bit_420TreesOnMountains1_3840x2160_25fps_10bit_420Trees on Mountain Huang
38TreesOnMountains2_3840x2160_25fps_10bit_420TreesOnMountains2_3840x2160_25fps_10bit_420Trees on Mountain Huang
39TreesOnMountains3_3840x2160_25fps_10bit_420TreesOnMountains3_3840x2160_25fps_10bit_420Trees on Mountain Huang
40SunAndTrees_3840x2160_25fps_10bit_420SunAndTrees_3840x2160_25fps_10bit_420Sunlight
41GirlWithTeaSet1_3840x2160_25fps_10bit_420GirlWithTeaSet1_3840x2160_25fps_10bit_420Girl pouring the tea into the cups
42GirlWithTeaSet2_3840x2160_25fps_10bit_420GirlWithTeaSet2_3840x2160_25fps_10bit_420Girl making tea
43GirlWithTeaSet3_3840x2160_25fps_10bit_420GirlWithTeaSet3_3840x2160_25fps_10bit_420Girl take out the tea from the bottle
44RedRibbonsWithLocks_3840x2160_25fps_10bit_420RedRibbonsWithLocks_3840x2160_25fps_10bit_420Red ribbons with locks on them
45SunsetMountainHuang1_3840x2160_25fps_10bit_420SunsetMountainHuang1_3840x2160_25fps_10bit_420Sunset at Mountain Huang
46SunsetMountainHuang2_3840x2160_25fps_10bit_420SunsetMountainHuang2_3840x2160_25fps_10bit_420Sunset at Mountain Huang
47CableCar_3840x2160_25fps_10bit_420CableCar_3840x2160_25fps_10bit_420Cable car running
48HotelClerks_3840x2160_25fps_10bit_420HotelClerks_3840x2160_25fps_10bit_420Hotel clerks at the reception desk
49RestaurantWaitress1_3840x2160_25fps_10bit_420RestaurantWaitress1_3840x2160_25fps_10bit_420Restaurant waitress cleaning tables and chairs
50RestaurantWaitress2_3840x2160_25fps_10bit_420RestaurantWaitress2_3840x2160_25fps_10bit_420Restaurant waitress serving the dishes
51ChefCuttingUp1_3840x2160_25fps_10bit_420ChefCuttingUp1_3840x2160_25fps_10bit_420Chef cutting up the scallion
52ChefCuttingUp2_3840x2160_25fps_10bit_420ChefCuttingUp2_3840x2160_25fps_10bit_420Chef cutting up the potatoes
53RoastedDuck_3840x2160_25fps_10bit_420RoastedDuck_3840x2160_25fps_10bit_420Roasted duck
54ChefCooking1_3840x2160_25fps_10bit_420ChefCooking1_3840x2160_25fps_10bit_420Chef cooking in the kitchen
55ChefCooking2_3840x2160_25fps_10bit_420ChefCooking2_3840x2160_25fps_10bit_420Chef cooking in the kitchen
56ChefCooking3_3840x2160_25fps_10bit_420ChefCooking3_3840x2160_25fps_10bit_420Chef cooking in the kitchen
57ChefCooking4_3840x2160_25fps_10bit_420ChefCooking4_3840x2160_25fps_10bit_420Chef cooking in the kitchen
58ChefCooking5_3840x2160_25fps_10bit_420ChefCooking5_3840x2160_25fps_10bit_420Chef cooking in the kitchen
59RawDucks_3840x2160_25fps_10bit_420RawDucks_3840x2160_25fps_10bit_420Raw ducks hanging on the hooks
60PeopleNearDesk_3840x2160_25fps_10bit_420PeopleNearDesk_3840x2160_25fps_10bit_420People standing near the table
61HotPot_3840x2160_25fps_10bit_420HotPot_3840x2160_25fps_10bit_420Hot dishes with table spinning
62RedBush_3840x2160_25fps_10bit_420RedBush_3840x2160_25fps_10bit_420Red bush
63RiverAndTrees_3840x2160_25fps_10bit_420RiverAndTrees_3840x2160_25fps_10bit_420Static river and trees
64BuildingTouristAttraction1_3840x2160_25fps_10bit_420BuildingTouristAttraction1_3840x2160_25fps_10bit_420Buildings in the tourist attractions
65BuildingTouristAttraction2_3840x2160_25fps_10bit_420BuildingTouristAttraction2_3840x2160_25fps_10bit_420Buildings in the tourist attractions
66BuildingTouristAttraction3_3840x2160_25fps_10bit_420BuildingTouristAttraction3_3840x2160_25fps_10bit_420Buildings in the tourist attractions
67DryRedPepper_3840x2160_25fps_10bit_420DryRedPepper_3840x2160_25fps_10bit_420Dehydrated red pepper
68RoomTouristAttraction1_3840x2160_25fps_10bit_420RoomTouristAttraction1_3840x2160_25fps_10bit_420Furniture in the room
69RoomTouristAttraction2_3840x2160_25fps_10bit_420RoomTouristAttraction2_3840x2160_25fps_10bit_420Paintings hanging on the wall
70RoomTouristAttraction3_3840x2160_25fps_10bit_420RoomTouristAttraction3_3840x2160_25fps_10bit_420Green leaves near the windows
71RoomTouristAttraction4_3840x2160_25fps_10bit_420RoomTouristAttraction4_3840x2160_25fps_10bit_420Glass on the table
72RoomTouristAttraction5_3840x2160_25fps_10bit_420RoomTouristAttraction5_3840x2160_25fps_10bit_420Posters hanging on the walls
73RoomTouristAttraction6_3840x2160_25fps_10bit_420RoomTouristAttraction6_3840x2160_25fps_10bit_420Furniture in the room
74RoomTouristAttraction7_3840x2160_25fps_10bit_420RoomTouristAttraction7_3840x2160_25fps_10bit_420Furniture in the room
75Plaque_3840x2160_25fps_10bit_420Plaque_3840x2160_25fps_10bit_420Plaque hanging on the wall
76BlackBird_3840x2160_25fps_10bit_420BlackBird_3840x2160_25fps_10bit_420Black bird in the cage
77StampCarving1_3840x2160_25fps_10bit_420StampCarving1_3840x2160_25fps_10bit_420Man carving the stamp
78StampCarving2_3840x2160_25fps_10bit_420StampCarving2_3840x2160_25fps_10bit_420Man carving the stamp
79Weave_3840x2160_25fps_10bit_420Weave_3840x2160_25fps_10bit_420Man weaving
80ManWithFilmMachine_3840x2160_25fps_10bit_420ManWithFilmMachine_3840x2160_25fps_10bit_420Man operating the film machine
81FilmMachine_3840x2160_25fps_10bit_420FilmMachine_3840x2160_25fps_10bit_420Internal structure of the film machine
82PressureCooker_3840x2160_25fps_10bit_420PressureCooker_3840x2160_25fps_10bit_420Pressure cooker working
83Bamboo_3840x2160_25fps_10bit_420Bamboo_3840x2160_25fps_10bit_420Bamboo forest
84LyingDog_3840x2160_25fps_10bit_420LyingDog_3840x2160_25fps_10bit_420Gog lying on the ground
85OilPainting1_3840x2160_25fps_10bit_420OilPainting1_3840x2160_25fps_10bit_420Old woman with her oil painting
86OilPainting2_3840x2160_25fps_10bit_420OilPainting2_3840x2160_25fps_10bit_420Old woman with her oil painting

Tencent Video Dataset Terms and Conditions

Thank you for your interest in the Tencent Video Dataset.

PLEASE READ THE FOLLOWING TERMS CAREFULLY:

BY CLICKING "[I Accept]", OR BY DOWNLOADING OR OTHERWISE ACCESSING OR USING THE TENCENT VIDEO DATASET (THE "TVD"), YOU AGREE THAT YOU HAVE READ AND UNDERSTOOD, AND, AS A CONDITION TO YOUR USE OF THE TVD, YOU AGREE TO BE BOUND BY, THE FOLLOWING TERMS AND CONDITIONS, INCLUDING TENCENT'S MEDIA LAB PRIVACY POLICY AND THE TENCENT SERVICE AGREEMENT  (TOGETHER, THESE "TERMS"). THE MEDIA LAB PRIVACY POLICY AND THE SERVICE AGREEMENT ARE INCORPORATED BY THIS REFERENCE INTO, AND MADE A PART OF, THESE TERMS. IF YOU ARE NOT ELIGIBLE, OR DO NOT AGREE TO THE TERMS, THEN YOU DO NOT HAVE OUR PERMISSION TO USE THE TVD. YOUR USE OF THE TVD, AND TENCENT'S PROVISION OF THE TVD TO YOU, CONSTITUTES AN AGREEMENT BY TENCENT AND BY YOU TO BE BOUND BY THESE TERMS.

  1. TVD Contents. The TVD consists of short video clips (each, a "Sequence"). All references to the TVD also refer to each or subset of the Sequences, as well as screenshots and individual frames of the Sequences and any annotations and captions to the Sequences.
  2. Ownership. The Sequences were captured and produced by Tencent International Service Pte. Ltd. ("Tencent") and Shenzhen Boyan Technology Ltd ("Shenzhen Boyan"). The TVD is the property of Tencent and Shenzhen Boyan and is protected by intellectual property and other laws. Tencent and Shenzhen Boyan reserve all rights to the TVD not granted expressly in these Terms.
  3. Non-Commercial License Grant. Subject to your complete and ongoing compliance with these Terms, Tencent grants you, solely for your personal, non-commercial use, a limited, non-exclusive, non-transferable, non-sublicensable, revocable license to download, reproduce, and make derivative works of the TVD, solely for the following permitted uses:
    1. Scientific research, development, and testing;
    2. Publication in academic papers and display at technology research and development events; and
    3. Use by standards committees or standardization activities, such as standards developed by JVET and MPEG standard committees.
  4. License Restrictions. Except as expressly permitted in these Terms, you may not:
    1. Reproduce, distribute, publicly display, or publicly perform, or otherwise use any portion of the TVD or any derivative work of the TVD;
    2. Download the TVD or make the TVD or any portion of the TVD available from any source other than Tencent;
    3. Resell or distribute any portion of the TVD or any derivative work of the TVD;
    4. Use any portion of the TVD or any derivative work of the TVD in any publication, product brochure, or for other advertising or marketing purpose;
    5. Use any portion of the TVD or any derivative work of the TVD in any other content (including television shows, commercials, or movies);
    6. Use any portion of the TVD if you are prohibited under applicable law from doing so, or use any portion of the TVD in violation of applicable law; or
    7. Attempt to do any of the acts described above in (a) through (f) or assist or permit any person in engaging in any of the acts described above in (a) through (f).
  5. Disclaimers. The TVD is provided free of charge, Accordingly, Tencent and its licensors provide the TVD AS-IS, without warranty of any kind, express or implied.
Tencent Media Lab
/
Tencent Media Lab
© 2024 Tencent Media Lab. All Rights Reserved

Cookie Preferences

A cookie is a small text file that is stored in a dedicated location on your computer, tablet, smartphone or other device when you use your browser to visit an online service. A cookie allows its sender to identify the device on which it is stored during the period of validity of consent. You may accept or reject the cookies listed below using the check box provided.

  • Performance / Analaytics cookies

    We use performance / analytics cookies to analyse how the Website is accessed, used or performing in order to provide you with a better user experience and to maintain, operate and continually improve the Website. For example, these cookies allow us to analyse user habits, ascertain the number of page views and unique visitors and conduct research and diagnostics to improve product offerings and functions.

We would like to use performance and analytics cookies (“Cookies”) to help us recognize whether you are a returning visitor and to track the number of website views and visits. For more information about the Cookies we use and your options (including how to change your preferences) see our Cookies Policy.