SIAT Video Team headed by Dr. Zhang Yun has long been engaged in video coding related research, including 3D/Multi-view video coding and standardization, 3D video pre/post-processing, 3D video quality assessment, Visual attention, stereoscopic vision, motion and depth perception, QoE.

Research Directions

We are interesting in R&D in HD/UHD video, 3D/Multi-view video and immersive virtual reality applications. Based on the requirements of the video sysmtem, our major research objectives are 1) improving the video compression efficiency so as to reduce the storage capacities and transmission bandwidth; 2) low compleixty video signal processing to reduce the computational compelxity and power comsumption; 3) analyze the visual perception properties in HVS and feed it back to optimize the visual signal processing, so as to improve the QoE of video system.

Selected Projects

HD /UHD Video Communication

The main target of video coding is to minimize bit rate while ensuring high visual quality. However, in existing coding theory, most image/video quality assessments were based on PSNR or MAD, which can hardly reflect the human perceptual quality. On the other hand, most existing video coding methods were designed to eliminate the redundancy of video signal, frequency, but little of the visual redundancy. It is reasonable to consider the quality of experience (QoE) of users, human visual characteristics and video content features in the process of designing video coding methods so as to further improve the coding efficiency.

3D Video System and Applications

Immersive Multi-view/3D video, recorded video sequences using multiple cameras, has attracted much attention recently since it is capable of representing high quality 3D world scene, and provides new visual enjoyments beyond 2D, such as 3D depth impression and interactive selection of arbitrary viewpoint/direction within a certain range of distances. With these features and the technological advancements in display technology, it would allow many new visual media applications, such as photorealistic rendering of 3D scenes, free-viewpoint television (FTV), 3D television (3DTV) broadcasting, and 3D games, to provide exciting visual functions for users.

Immersive Virtual Reality

Immersive virtual reality (VR) can provide a high definition, more vivid and interactive visual experience, which has a large number of potential market demands. However, it still faces many challenges, including: 1) video content generation, high quality video capturing and video stitching technology; 2) high efficiency and low complexity video codec; 3) low complexity and high quality video rendering technology, user interaction; 4) visual perception models to improve user's visual experience.

Research Grants

  • ▪ Shenzhen-International Collaborative Innovation Programs, “Perception Driven High Performance Video Encoding,” July.2017-Jun.2019, On-Going
  • ▪ R&D Project from Shenzhen Municipal Science and Technology, “R&D for High Definition Virtual Reality Video-on-Demand and Live Broadcasting System,” Jun. 2016-May. 2018, On-Going
  • ▪ NSF for Distinguished Young Scholar of Guangdong Province, “Highly Effective Coding Theories and Technologies for Video Big Data,” Jan. 2016-Dec. 2019, On-Going
  • ▪ Co-PI, Hong Kong RGC/ GRF, “Multiclass Classification for Effective Mode Decision in High Efficiency Video Coding and Beyond,” Aug. 2016-July 2018, On-Going
  • ▪ Guangdong Special Support Program for Youth Science and Technology Innovation Talents, Apr. 2015 -Mar. 2018. On-Going
  • ▪ NSFC-General, “Theories and Methodologies on Quality of Experience (QoE) Based High Efficiency 3D Video Coding”, Jan.2015-Dec.2018, On-Going
  • ▪ Shenzhen “Peacock Plan” Research Funding for Overseas High-Caliber, ”Decision Making and Perceptual Optimization based High Efficiency 3D Video Coding,” Jan.2015-Dec.2016, On-Going
  • ▪ NSFC-Youth , “Mulitiview Video Coding Research Exploiting Regional Selective Visual Redundancies,” Jan.2012-Dec. 2014, Completed
  • ▪ Guangdong Provincial NSF, “Video Compression and Reconstruction Technology for Mobile 3D Communication System,” Oct. 2012-Sept. 2014, Completed
  • ▪ Shenzhen Emerging Industries of Strategic Basic Research Project, “3D video compression and reconstruction technology for mobile 3D communication system,” Jan. 2013-Dec. 2014, Completed
  • ▪ Co-PI, Nanshan Research & Develop Project, Media Security in Video Streaming Technology, Jun. 2013- May 2015, Completed

Research Achievement

Papers

Over 90 SCI / EI papers
Over 20 papers published on TOP journals including IEEE T-IP, IEEE T-IE, IEEE T-CSVT, IEEE T-MM, IEEE T-Broadcast
Two TOP 1% ESI highly cited papers

Scientific Awards

▪ 2016 Third Prize Zhejiang Provincial Science and Technology Award, Government of Zhejiang Province, China
▪ 2016 Nanshan Linghang High Level Professional Talent (Level B), Nanshan District, Shenzhen, China
▪ 2016 Guangdong Natural Science Funds for Distinguished Young Scholar (51 in Guangdong Province in 2016)
▪ 2015 First Prize Ningbo Municipal Science and Technology Award, Government of Ningbo Municipality, China
▪ 2015 High Level Professional Talent (Reserve Level), Government of Shenzhen Municipality, China
▪ 2015 Guangdong Special Support Program for Youth Science and Technology Innovation Talents, Government of Guangdong Province, China (98 in Guangdong Province in 2015)
▪ 2014 Overseas High-Caliber Personnel Award (Level B), Government of Shenzhen Municipality, China 2014
▪ 2009 Second Prize Scientific and Technological Advancement Award, Ministry of Education (MOE), China
▪ 2009 First Prize Zhejiang Provincial Science and Technology Award, Government of Zhejiang Province, China
▪ 2009 First Prize Ningbo Municipal Science and Technology Award, Government of Ningbo Municipality, China

Patents

▪ 13 CN patents, 8 granted
▪ 2 U.S. patents, 1 granted
▪ 3 Software Copyrights