腾讯视频数据集 (TVD)

基于学习的可视化数据压缩和分析引起了学术界和工业界的极大兴趣。更多的训练和测试数据集,尤其是高质量的视频数据集,对于相关的研究和标准化活动来说是非常需要的。JPEG AI、基于 JVET 神经网络的视频编码 (NNVC) 和 MPEG 机器视频编码 (VCM) 只是几个例子。该数据集 (TVD) 旨在为各种目的服务,例如训练基于神经网络的编码工具和测试机器视觉任务,包括对象检测和跟踪。

TVD 数据集包含 86 个视频序列,内容覆盖范围广泛。每个视频序列包含 65 帧,空间分辨率为 3840x2160。该视频数据集已被用作 JVET NNVC 探索活动的训练集。如下所述,可提供用于各种勘探活动的附加数据集。

对于对象检测探索,从 TVD 中以 1920x1080 空间分辨率以 RGB24 png 格式采样了 166 张图像。提供了这些图像的边界框注释。

对于分割探索,多媒体实验室为来自对象检测集的图像创建了一个带有分割掩码注释的专用集。这个包含 166 个图像、边界框和分割掩码注释的集合是 MPEG VCM 的通用测试条件 (CTC) 的测试集。

对于对象跟踪探索,多媒体实验室提供了一个专门的集合,其中包含三个视频序列的较长版本以及对象跟踪注释。这个带有视频序列和注释的集合也是 MPEG VCM 的通用测试条件(CTC)的测试集。

关键词
  • Video Compression
  • Machine Learning
  • Video Coding for Machines
  • Object Detection
  • Instance Segmentation
  • Object Tracking
参考文献
  • X. Xu, S. Liu and Z. Li, "A Video Dataset for Learning-based Visual Data Compression and Analysis", 2021 International Conference on Visual Communications and Image Processing (VCIP) (link)
  • W. Gao, X. Xu, M. Qin, S. Liu, "An Open Dataset for Video Coding for Machines Standardization", 2022 IEEE International Conference on Image Processing (ICIP) (link)
  • Haiqiang Wang, Xin Zhao, Ding Ding, Xiang Pan, Zizheng Liu, Xiaozhong Xu, and Shan Liu, "Improvements of the BD-rate model using monotonic curve-fitting method", arXiv, 2023

下载

预览

序号略缩图文件名内容描述
1GrassLand_3840x2160_50fps_8bit_420GrassLand_3840x2160_50fps_8bit_420Grass swinging
2MovingBikes_3840x2160_50fps_8bit_420MovingBikes_3840x2160_50fps_8bit_420Bikes passing by
3FallingLeaves_3840x2160_50fps_8bit_420FallingLeaves_3840x2160_50fps_8bit_420Leaves falling down
4FallenLeaves_3840x2160_50fps_8bit_420FallenLeaves_3840x2160_50fps_8bit_420Fallen leaves on the ground
5GirlThrowingLeaves_3840x2160_50fps_8bit_420GirlThrowingLeaves_3840x2160_50fps_8bit_420Girl collecting the leaves on the ground
6TreeTrunkMoving_3840x2160_50fps_8bit_420TreeTrunkMoving_3840x2160_50fps_8bit_420Tree trunk(moving camera)
7LeavesOnTree_3840x2160_50fps_8bit_420LeavesOnTree_3840x2160_50fps_8bit_420Leaves swinging on the tree
8FruitOnTree_3840x2160_50fps_8bit_420FruitOnTree_3840x2160_50fps_8bit_420Fruit hanging on the tree
9WaterOnGrass1_3840x2160_50fps_8bit_420WaterOnGrass1_3840x2160_50fps_8bit_420Water squirting out(distant view)
10WaterOnGrass2_3840x2160_50fps_8bit_420WaterOnGrass2_3840x2160_50fps_8bit_420Water squirting out(close view)
11GirlWalkingOnStreet_3840x2160_50fps_8bit_420GirlWalkingOnStreet_3840x2160_50fps_8bit_420Girl walking on the street at night
12GirlWatchingPhone_3840x2160_50fps_8bit_420GirlWatchingPhone_3840x2160_50fps_8bit_420Girl watching her cell phone in the dark
13StaticWaterAndBikes2_3840x2160_50fps_10bit_420StaticWaterAndBikes2_3840x2160_50fps_10bit_420Static water with bikes passing by
14FlowingWater_3840x2160_50fps_10bit_420FlowingWater_3840x2160_50fps_10bit_420Water flowing
15Fountain_3840x2160_50fps_10bit_420Fountain_3840x2160_50fps_10bit_420Fountain squirting
16TreesAndLeaves_3840x2160_50fps_10bit_420TreesAndLeaves_3840x2160_50fps_10bit_420Trees and leaves
17GirlRunningOnGrass_3840x2160_50fps_10bit_420GirlRunningOnGrass_3840x2160_50fps_10bit_420Girl running on the grass
18GirlsOnGrass1_3840x2160_50fps_10bit_420GirlsOnGrass1_3840x2160_50fps_10bit_420Two girls running on the grass
19GirlsOnGrass2_3840x2160_50fps_10bit_420GirlsOnGrass2_3840x2160_50fps_10bit_420One girl taking photo of the other on the grass
20PeopleOnGrass_3840x2160_50fps_10bit_420PeopleOnGrass_3840x2160_50fps_10bit_420People walking on the grass
21StaticRocks_3840x2160_50fps_10bit_420StaticRocks_3840x2160_50fps_10bit_420Static rocks
22MovingBikesAndPedestrian4_3840x2160_50fps_10bit_420MovingBikesAndPedestrian4_3840x2160_50fps_10bit_420Bikes and pedestrians passing by
23BoyMakingUp1_3840x2160_50fps_10bit_420BoyMakingUp1_3840x2160_50fps_10bit_420Boy making up on the Great Wall
24BoyMakingUp2_3840x2160_50fps_10bit_420BoyMakingUp2_3840x2160_50fps_10bit_420Boy making up on the Great Wall
25BoyDressing1_3840x2160_50fps_10bit_420BoyDressing1_3840x2160_50fps_10bit_420Boy dressing on the Great Wall
26BoyDressing2_3840x2160_50fps_10bit_420BoyDressing2_3840x2160_50fps_10bit_420Boy dressing on the Great Wall
27BoyWithCostume_3840x2160_50fps_10bit_420BoyWithCostume_3840x2160_50fps_10bit_420Boy wearing opera costume standing on the Great Wall
28SunriseMountainHuang_3840x2160_25fps_10bit_420SunriseMountainHuang_3840x2160_25fps_10bit_420Sunrise at Mountain Huang
29MountainsView1_3840x2160_25fps_10bit_420MountainsView1_3840x2160_25fps_10bit_420The view of Mountain Huang
30MountainsView2_3840x2160_25fps_10bit_420MountainsView2_3840x2160_25fps_10bit_420The view of Mountain Huang
31MountainsView3_3840x2160_25fps_10bit_420MountainsView3_3840x2160_25fps_10bit_420The view of Mountain Huang
32MountainsView4_3840x2160_25fps_10bit_420MountainsView4_3840x2160_25fps_10bit_420The view of Mountain Huang
33MountainsAndStairs1_3840x2160_24fps_10bit_420MountainsAndStairs1_3840x2160_24fps_10bit_420Mountains and stairs
34MountainsAndStairs2_3840x2160_25fps_10bit_420MountainsAndStairs2_3840x2160_25fps_10bit_420Mountains and stairs
35MountainsAndStairs3_3840x2160_25fps_10bit_420MountainsAndStairs3_3840x2160_25fps_10bit_420Mountains and stairs
36MountainsAndStairs4_3840x2160_25fps_10bit_420MountainsAndStairs4_3840x2160_25fps_10bit_420Mountains and stairs
37TreesOnMountains1_3840x2160_25fps_10bit_420TreesOnMountains1_3840x2160_25fps_10bit_420Trees on Mountain Huang
38TreesOnMountains2_3840x2160_25fps_10bit_420TreesOnMountains2_3840x2160_25fps_10bit_420Trees on Mountain Huang
39TreesOnMountains3_3840x2160_25fps_10bit_420TreesOnMountains3_3840x2160_25fps_10bit_420Trees on Mountain Huang
40SunAndTrees_3840x2160_25fps_10bit_420SunAndTrees_3840x2160_25fps_10bit_420Sunlight
41GirlWithTeaSet1_3840x2160_25fps_10bit_420GirlWithTeaSet1_3840x2160_25fps_10bit_420Girl pouring the tea into the cups
42GirlWithTeaSet2_3840x2160_25fps_10bit_420GirlWithTeaSet2_3840x2160_25fps_10bit_420Girl making tea
43GirlWithTeaSet3_3840x2160_25fps_10bit_420GirlWithTeaSet3_3840x2160_25fps_10bit_420Girl take out the tea from the bottle
44RedRibbonsWithLocks_3840x2160_25fps_10bit_420RedRibbonsWithLocks_3840x2160_25fps_10bit_420Red ribbons with locks on them
45SunsetMountainHuang1_3840x2160_25fps_10bit_420SunsetMountainHuang1_3840x2160_25fps_10bit_420Sunset at Mountain Huang
46SunsetMountainHuang2_3840x2160_25fps_10bit_420SunsetMountainHuang2_3840x2160_25fps_10bit_420Sunset at Mountain Huang
47CableCar_3840x2160_25fps_10bit_420CableCar_3840x2160_25fps_10bit_420Cable car running
48HotelClerks_3840x2160_25fps_10bit_420HotelClerks_3840x2160_25fps_10bit_420Hotel clerks at the reception desk
49RestaurantWaitress1_3840x2160_25fps_10bit_420RestaurantWaitress1_3840x2160_25fps_10bit_420Restaurant waitress cleaning tables and chairs
50RestaurantWaitress2_3840x2160_25fps_10bit_420RestaurantWaitress2_3840x2160_25fps_10bit_420Restaurant waitress serving the dishes
51ChefCuttingUp1_3840x2160_25fps_10bit_420ChefCuttingUp1_3840x2160_25fps_10bit_420Chef cutting up the scallion
52ChefCuttingUp2_3840x2160_25fps_10bit_420ChefCuttingUp2_3840x2160_25fps_10bit_420Chef cutting up the potatoes
53RoastedDuck_3840x2160_25fps_10bit_420RoastedDuck_3840x2160_25fps_10bit_420Roasted duck
54ChefCooking1_3840x2160_25fps_10bit_420ChefCooking1_3840x2160_25fps_10bit_420Chef cooking in the kitchen
55ChefCooking2_3840x2160_25fps_10bit_420ChefCooking2_3840x2160_25fps_10bit_420Chef cooking in the kitchen
56ChefCooking3_3840x2160_25fps_10bit_420ChefCooking3_3840x2160_25fps_10bit_420Chef cooking in the kitchen
57ChefCooking4_3840x2160_25fps_10bit_420ChefCooking4_3840x2160_25fps_10bit_420Chef cooking in the kitchen
58ChefCooking5_3840x2160_25fps_10bit_420ChefCooking5_3840x2160_25fps_10bit_420Chef cooking in the kitchen
59RawDucks_3840x2160_25fps_10bit_420RawDucks_3840x2160_25fps_10bit_420Raw ducks hanging on the hooks
60PeopleNearDesk_3840x2160_25fps_10bit_420PeopleNearDesk_3840x2160_25fps_10bit_420People standing near the table
61HotPot_3840x2160_25fps_10bit_420HotPot_3840x2160_25fps_10bit_420Hot dishes with table spinning
62RedBush_3840x2160_25fps_10bit_420RedBush_3840x2160_25fps_10bit_420Red bush
63RiverAndTrees_3840x2160_25fps_10bit_420RiverAndTrees_3840x2160_25fps_10bit_420Static river and trees
64BuildingTouristAttraction1_3840x2160_25fps_10bit_420BuildingTouristAttraction1_3840x2160_25fps_10bit_420Buildings in the tourist attractions
65BuildingTouristAttraction2_3840x2160_25fps_10bit_420BuildingTouristAttraction2_3840x2160_25fps_10bit_420Buildings in the tourist attractions
66BuildingTouristAttraction3_3840x2160_25fps_10bit_420BuildingTouristAttraction3_3840x2160_25fps_10bit_420Buildings in the tourist attractions
67DryRedPepper_3840x2160_25fps_10bit_420DryRedPepper_3840x2160_25fps_10bit_420Dehydrated red pepper
68RoomTouristAttraction1_3840x2160_25fps_10bit_420RoomTouristAttraction1_3840x2160_25fps_10bit_420Furniture in the room
69RoomTouristAttraction2_3840x2160_25fps_10bit_420RoomTouristAttraction2_3840x2160_25fps_10bit_420Paintings hanging on the wall
70RoomTouristAttraction3_3840x2160_25fps_10bit_420RoomTouristAttraction3_3840x2160_25fps_10bit_420Green leaves near the windows
71RoomTouristAttraction4_3840x2160_25fps_10bit_420RoomTouristAttraction4_3840x2160_25fps_10bit_420Glass on the table
72RoomTouristAttraction5_3840x2160_25fps_10bit_420RoomTouristAttraction5_3840x2160_25fps_10bit_420Posters hanging on the walls
73RoomTouristAttraction6_3840x2160_25fps_10bit_420RoomTouristAttraction6_3840x2160_25fps_10bit_420Furniture in the room
74RoomTouristAttraction7_3840x2160_25fps_10bit_420RoomTouristAttraction7_3840x2160_25fps_10bit_420Furniture in the room
75Plaque_3840x2160_25fps_10bit_420Plaque_3840x2160_25fps_10bit_420Plaque hanging on the wall
76BlackBird_3840x2160_25fps_10bit_420BlackBird_3840x2160_25fps_10bit_420Black bird in the cage
77StampCarving1_3840x2160_25fps_10bit_420StampCarving1_3840x2160_25fps_10bit_420Man carving the stamp
78StampCarving2_3840x2160_25fps_10bit_420StampCarving2_3840x2160_25fps_10bit_420Man carving the stamp
79Weave_3840x2160_25fps_10bit_420Weave_3840x2160_25fps_10bit_420Man weaving
80ManWithFilmMachine_3840x2160_25fps_10bit_420ManWithFilmMachine_3840x2160_25fps_10bit_420Man operating the film machine
81FilmMachine_3840x2160_25fps_10bit_420FilmMachine_3840x2160_25fps_10bit_420Internal structure of the film machine
82PressureCooker_3840x2160_25fps_10bit_420PressureCooker_3840x2160_25fps_10bit_420Pressure cooker working
83Bamboo_3840x2160_25fps_10bit_420Bamboo_3840x2160_25fps_10bit_420Bamboo forest
84LyingDog_3840x2160_25fps_10bit_420LyingDog_3840x2160_25fps_10bit_420Gog lying on the ground
85OilPainting1_3840x2160_25fps_10bit_420OilPainting1_3840x2160_25fps_10bit_420Old woman with her oil painting
86OilPainting2_3840x2160_25fps_10bit_420OilPainting2_3840x2160_25fps_10bit_420Old woman with her oil painting

Tencent Video Dataset Terms and Conditions

Thank you for your interest in the Tencent Video Dataset.

PLEASE READ THE FOLLOWING TERMS CAREFULLY:

BY CLICKING "[I Accept]", OR BY DOWNLOADING OR OTHERWISE ACCESSING OR USING THE TENCENT VIDEO DATASET (THE "TVD"), YOU AGREE THAT YOU HAVE READ AND UNDERSTOOD, AND, AS A CONDITION TO YOUR USE OF THE TVD, YOU AGREE TO BE BOUND BY, THE FOLLOWING TERMS AND CONDITIONS, INCLUDING TENCENT'S MEDIA LAB PRIVACY POLICY AND THE TENCENT SERVICE AGREEMENT  (TOGETHER, THESE "TERMS"). THE MEDIA LAB PRIVACY POLICY AND THE SERVICE AGREEMENT ARE INCORPORATED BY THIS REFERENCE INTO, AND MADE A PART OF, THESE TERMS. IF YOU ARE NOT ELIGIBLE, OR DO NOT AGREE TO THE TERMS, THEN YOU DO NOT HAVE OUR PERMISSION TO USE THE TVD. YOUR USE OF THE TVD, AND TENCENT'S PROVISION OF THE TVD TO YOU, CONSTITUTES AN AGREEMENT BY TENCENT AND BY YOU TO BE BOUND BY THESE TERMS.

  1. TVD Contents. The TVD consists of short video clips (each, a "Sequence"). All references to the TVD also refer to each or subset of the Sequences, as well as screenshots and individual frames of the Sequences and any annotations and captions to the Sequences.
  2. Ownership. The Sequences were captured and produced by Tencent International Service Pte. Ltd. ("Tencent") and Shenzhen Boyan Technology Ltd ("Shenzhen Boyan"). The TVD is the property of Tencent and Shenzhen Boyan and is protected by intellectual property and other laws. Tencent and Shenzhen Boyan reserve all rights to the TVD not granted expressly in these Terms.
  3. Non-Commercial License Grant. Subject to your complete and ongoing compliance with these Terms, Tencent grants you, solely for your personal, non-commercial use, a limited, non-exclusive, non-transferable, non-sublicensable, revocable license to download, reproduce, and make derivative works of the TVD, solely for the following permitted uses:
    1. Scientific research, development, and testing;
    2. Publication in academic papers and display at technology research and development events; and
    3. Use by standards committees or standardization activities, such as standards developed by JVET and MPEG standard committees.
  4. License Restrictions. Except as expressly permitted in these Terms, you may not:
    1. Reproduce, distribute, publicly display, or publicly perform, or otherwise use any portion of the TVD or any derivative work of the TVD;
    2. Download the TVD or make the TVD or any portion of the TVD available from any source other than Tencent;
    3. Resell or distribute any portion of the TVD or any derivative work of the TVD;
    4. Use any portion of the TVD or any derivative work of the TVD in any publication, product brochure, or for other advertising or marketing purpose;
    5. Use any portion of the TVD or any derivative work of the TVD in any other content (including television shows, commercials, or movies);
    6. Use any portion of the TVD if you are prohibited under applicable law from doing so, or use any portion of the TVD in violation of applicable law; or
    7. Attempt to do any of the acts described above in (a) through (f) or assist or permit any person in engaging in any of the acts described above in (a) through (f).
  5. Disclaimers. The TVD is provided free of charge, Accordingly, Tencent and its licensors provide the TVD AS-IS, without warranty of any kind, express or implied.
腾讯多媒体实验室
/
我们希望使用性能和分析 cookies(“Cookie”)来帮助我们识别您是否是回访者并跟踪网站浏览次数和访问次数。有关我们使用的 Cookie 和您的选项(包括如何更改您的偏好)的更多信息,请参阅我们的 Cookies 策略.