Wireshark Tool as mpegts files Parser
Wireshark tool supports very informative parsing of mpegts files. Load ts-file and start analysis: Slava23+ years’ programming and theoretical experience in the computer science fields such as video compression, media streaming and artificial intelligence (co-author of several papers and patents). the author is looking for new job, my resume Donate videonerd.website
SRT Brief Introduction
Secure Reliable Transport protocol (SRT) is a royalty-free (under MPL-2.0 license) protocol tailored for transmission media in low latency applications (e.g., Cloud Gaming, remote control of autonomous vehicles), i wrote a brief introduction to SRT: pdf-document ffmpeg supports SRT protocol. To set a receiver you can use the following command: ffplay -v panic […]
Frame Rate Conversion
Use Case: Frame rate conversion from 60 fps to 59 fps A black-boxed encoder produces video with the fixed frame rate 60 fps. However a decoder at client’s side can not cope with the frame rate 60 fps, but it can keep real-time decoding of video streams with the frame rate 59 fps or lower. […]
Server-Client Clock Alignment in Cloud Gaming
Content How to Align Cloud Server’s timeline to Client’s? Clock Drift (Skew) Estimation and Compensation What’s Cloud Gaming? The game is not executed locally on your computer, but on a distant server with dedicated hardware in a large data center. In other words Cloud Gaming is the ability to run games in the cloud […]
NIQE Non-Reference Video Quality Metric
NIQE is an abbreviation of “Natural Image Quality Evaluator”. This non-reference (blind) method was described in the paper “Making a ‘Completely Blind’ Image Quality Analyzer“, by Anish Mittal, Rajiv Soundararajan and Alan C. Bovik. The original python code of NIQE method is located here . I modified an interface of the code to get video […]
Enhancement of Error Resilience by Non-reference P Frames
Content Idea How much non-Reference P-framing impacts on the video quality? Nvidia Rate Control has a flaw Idea For low-latency applications like Cloud Gaming, in case of packet losses a retransmission is not feasible. Consequently visual distortions are observed for a while, due to temporal prediction, if the previous frame is corrupted then […]
Non-Reference Video Quality Metric – RECO Index (Polar Edge Coherence Score)
The idea of RECO non-reference metric is based on the fact that on the retinal surface natural images are characterized by perfect sharp edges under ideal focusing and in absence of noise, and any edge impairment is perceived as an annoying disturbance, apart some exceptions known as natural factors impairing edge patterns. Natural factors impairing […]
Which codecs does YouTube use (based on Jan Ozer’s analysis)?
This paper is based on Jan Ozer‘s analysis. 1) For less 1080p resolutions, YouTube selects the codec according to view count: AV1 for videos with view counts above half-million VP9 for videos with view counts from several thousands to half-million H264 for low view counts (less several thousands) Notice that hevc is not used by […]
Bento4 Tool – Free Programs to Process Video/Audio Streams
Content Conversion regular mp4-file into the fragmented Parsing mp4-file metadata with mp4dump Extract single box from mp4-file with mp4extract Removal atoms from mp4-file with mp4edit Encryption: mp4encrypt and mp4decrypt Representation mp4 metadata tables in more compact form (squeeze) How Create and Build Bento4 Visual Studio Solution Download binaries (for all platforms): https://www.bento4.com/downloads/ Documentation: […]
Why at the start of low-latency media session (e.g. Cloud Gaming session) audio tends to be ahead of video?
Let’s assume the first audio and video frames are rendered (or created) simultaneously. Then an audio encoder would take less time than an video encoder (video encoding is much more complex than audio one). Consequently, audio encoded frame is expected to be ready for transmission earlier than corresponding video frame. Moreover, audio frame size is […]