ABR test strategies from RF through content delivery

As the trend toward over-the-top (OTT) services continues to grow among video service providers and cable operators, so does the demand for a high quality of experience (QoE) on any device and at any time. But delivering the quality viewers expect involves the mastery of very complex adaptive bit rate (ABR) technology and implementation of a comprehensive set of monitoring capabilities and tools.

With ABR going mainstream, you now need to not only ensure that the transcoders are creating the appropriate profiles, but that the video is being monitored from acquisition (e.g., satellite, fiber, file) all the way to the origin server and content delivery network (CDN) servers. If you want the ability to proactively detect and repair errors quickly, you’ll need taps or test points at each of three critical points in your ABR system as shown in the illustration below.

Figure 1. The three critical test points in a typical ABR system.
Figure 1. The three critical test points in a typical ABR system.

Test Point 1: RF Demodulator

One reason to test here is that transmission errors are easy to detect and quantify. These errors will become hidden or much harder to trace back to their origin once the video and audio elements have been unwrapped or de-encapsulated from their previous transmission chain.

For a sense of what can happen during the transmission, look at the results in the screen capture below taken from a satellite signal over a one-hour period. As you can see, it shows a variety of Digital Video Broadcasting (DVB) section errors as well as program clock reference (PCR) interval and continuity counter errors. The continuity count (CC) errors are considered extremely bad since they denote a missing packet, and the decoder will struggle or fail during the decode process. PCR errors are not good either, but treated at a lower priority due to the filtering functions built into each set-top box or TV receiver.

Figure 2. Typical errors that can occur in a satellite signal.
Figure 2. Typical errors that can occur in a satellite signal.

Another aspect to ingest or content acquisition is file-based. This is where the entire program, event, or movie has been software encoded in non-real-time and delivered as a large file. At Test Point 1, these source files are usually encoded at very high rates and are not for subscriber viewing. A popular format for these files is interoperable master format (IMF). This format will include a composition play list (CPL) that includes reference to its video, audio languages, captioning, and ancillary tracks.

Each ingested file will be used as a reference for the transcoder to create multiple profiles that can be easily transmitted (lower bit rates, higher compression). Before each reference file goes to the transcoder, each file should be tested for compliance to ensure that it is interoperable with any downstream decoding device. It is also prudent to check for blockiness, for frozen frames, and that the audio loudness levels are within specification and therefore don’t violate regulations. Once tested, files can be moved to another folder or drive for transcoding, or off to a quarantine folder for files that fail the compliance or quality tests.

Test Point 2: After the Transcoder

The next step in an ABR system is to transcode the program from its incoming format to a newer codec format such as H.264 at a higher compression rate. For both live events and file-based content, each input stream or file will result in an array of many outputs or profiles for different bit rates. Each of the new streams (profiles) should be verified for its rate, format, syntax and semantics, blockiness, and loudness, as well as making sure the new reference frames are time-aligned across each of the profiles. These new reference frames (instantaneous decoding refresh [IDR] and encoder boundary points [EBP]) should occur at predetermined intervals. These intervals or boundaries are the points at which the ABR profiles can be switched while continuing to provide a seamless viewing experience.

One of the biggest problems with video compression is blockiness. This issue is due to the encoder not having enough bandwidth to maintain quality. A key problem here is that every encoder will react differently to the same content. The same set of encoders with different levels of firmware will react differently too.

A common issue is that the video frames look clean at any rate without any blockiness if the content does not include fast action scenes. In the zoomed-in example below, the image on the left is from a 50-Mbps/MPEG-2 source file, while the right image shows the blockiness in the hand and arm area that can occur when there isn’t enough bandwidth to support all the movement in the video.

Figure 3. Blockiness from insufficient bandwidth to support the action in the video seen in the image on the right.
Figure 3. Blockiness from insufficient bandwidth to support the action in the video seen in the image on the right.

With all video, there will be scenes with little movement that are easy to compress, while other scenes will include fast action scenes that are harder to compress. Finding the correct balance with all of the different codec settings is the challenge. To be sure you’re mapping as close to the original as possible, it’s best practice to check for blockiness each time a video is encoded or transcoded.

At the heart of any ABR system is the packager. The packager performs three main functions. It transcodes the input content into multiple bitrates (on many systems there can be eight different bitrate profiles produced). Next, the packager fragments the profiles into 2- to 10-second blocks. Finally, it encrypts the fragmented profiles for delivery to the origin or CDN servers. In some cases, the transcoded output is accessible for testing, and in other cases it is only accessible after fragmenting and encryption.

In the case of a server using digital rights management (DRM) software, it is now possible to test the manifest, profiles, and the video/audio quality using DRM within the monitoring equipment. This capability enables the test equipment to view the same content that a subscriber will see.

Test Point 3: Origin and CDN Servers

Once the TV and video programs have been placed onto the servers for playout, you can now monitor the manifest files that describe the multiple profiles for each program. You can also check the latency and bandwidth of the requests, and then analyze the viewer’s experience by decrypting the content. In most cases, it would not be wise to use a single server (i.e., origin server) for all subscribers.

For large systems, it is important to push the content as close to the subscriber as possible. This means making multiple copies of the most popular programs and storing them at caching sites around the region. Testing all of the content at all of the sites throughout every region would be great, but most service providers tend to focus on the content at the origin server.

The first test at this point should be to verify that the manifest and associated profiles agree with each other. It is critical that the monitoring system sends an alert when it detects requested fragments taking longer to arrive than their allocated runtime. For example, it should never take more than 10 seconds to download content that only plays for 10 seconds.

When testing at the origin or caching servers, you may want to test everything, but you do not want to create a scenario where the monitoring equipment requests more content than the network will allow. Also, you do not want to consume so much bandwidth that subscribers can’t download and watch their requested programs. Therefore, the monitoring equipment should be configured with maximum thresholds that limit the amount of content being pulled from each server.

To complete the end-to-end quality of experience for ABR content, the monitoring equipment should decrypt and decode the live pictures and audio from the origin or caching servers. In most, but not all cases, the content is encrypted. With DRM support, monitoring equipment can decrypt each program and then look at the same video and audio available to subscribers. The bandwidth for each representation should be very stable and consistent over time. The quality of the decoded video and audio should be good as well.

The snapshot below of a manifest file shows a video thumbnail and its program quality rating. These features are useful for troubleshooting and diagnostics, as well as long-term monitoring with triggered alerts.

Figure 4. This representation of a manifest file shows measurements for quality of experience and blockiness.
Figure 4. This representation of a manifest file shows measurements for quality of experience and blockiness.

Get monitoring

With ABR streaming services, it is important to monitor content from ingest through transcode, fragmentation, and encryption for all available profiles. It is critical to establish and test content at the beginning of the chain to ensure what is going into the system is a known good entity and follow it through the transcode process. On the delivery side, providers need to test that the content will be available at various bit levels when requested and that it will play successfully. Ultimately, it is about ensuring that what goes in is great and what comes out leads to the best possible experience for your viewers.

Dennis Kucera is an application engineer at Tektronix, where he has held technical positions for over 30 years. Kucera is the inventor of the oscilloscope Color Graded Display and Automated Mask Testing, and is credited with the U.S. patent for Automatic Eye-Diagram Testing. In 2007, he received (on behalf of Tektronix) a Technical Emmy from NATAS for Monitoring MPEG Broadcast Signals. He has published multiple industry articles on video design and testing. He holds degrees in Computer Science and Mathematics from the University of Oregon.

Related Articles

Cable ONE Goes Gigabit in 2 More AZ Markets

Cable ONE Goes Gigabit in 2 More AZ Markets

June 26, 2017

Cable ONE (NYSE:CABO) has launched its GigaONE gigabit Internet service in two more Arizona marke...

AT&T Expands Rural Fixed Wireless Internet

AT&T Expands Rural Fixed Wireless Internet

June 26, 2017

AT&T (NYSE:T) is expanding its fixed wireless Internet service for rural and underserved loca...

Videos

Transitioning to IP Video: A BTR Panel Discussion

June 16, 2017

BTR gathered four experts at NAB Show 2017 to discuss IP video drivers, strategies, and concerns....

DOCSIS 3.1 in Focus for June 2017

June 13, 2017

Last month it was DOCSIS 3.1 versus next-gen xDSL. This time BTR Editorial Director Stephen Hardy...

Special Reports

Improving the WiFi Experience

Improving the WiFi Experience

May 23, 2017

Service provision at rates that approach a gigabit is worthless if the WiFi system used to distribute that ...

The Evolving Challenges of OTT

The Evolving Challenges of OTT

April 27, 2017

The cable industry is well aware of the growing importance of over-the-top (OTT) content services to their ...

Diamond Reviews Products

5 Diamonds/Innovation Award

5 Diamonds/Innovation Award

September 10, 2016

Two companies - Ciena and Fluke Networks - grabbed the brass ring this year, so to speak, and were awarded 5.0 Diamonds for ...

4.5 Diamonds

ADTRAN MOSAIC Cloud Platform

September 10, 2016

The ADTRAN Modular Open System Architecture for Intelligent Cloud is a software-defined open access approach for SD-Access that empowers ...

4.5 Diamonds

Casa Systems Distributed Access Architecture Solutions

September 10, 2016

Casa Systems' family of Distributed Access Architecture solutions is designed to help service providers push capacity to the edge as they ..

4.5 Diamonds

Ciena Waveserver

September 10, 2016

Ciena's Waveserver integrates high-performance optical networking with an open, web-scale IT toolset to tackle scalability and operational ...

4.5 Diamonds

Evolution Digital eBox IP Hybrid Set-Top Box

September 10, 2016

The Evolution eBox, powered by TiVO, integrates traditional linear channels with OTT video solutions and provides universal search across ...

4.5 Diamonds

Metaswitch Perimeta Virtualized Session Border Controller

September 10, 2016

Perimeta is a virtualized network function (VNF)-capable, software-based, carrier-class session border controller (SBC) designed to secure ...

4.5 Diamonds

Vecima Networks Entra DOCSIS 3.1 Distributed Access Platform

September 10, 2016

Vecima's Entra is a next-generation access solution consisting of virtual controller software and Ethernet-centric remote access nodes. It ...

4 Diamonds

Alpha Technologies AlphaGateway SMG

September 10, 2016

The Alpha Strand Mount Gateway (SMG) is an outdoor hardened DOCSIS 3.0 gateway, which powers itself from HFC coax power. It provides ...

4 Diamonds

Amdocs Service Design and Create

September 10, 2016

The Amdocs Service Design and Create (SDC) solution automates and integrates the design, test and launch process for multi-vendor ...

4 Diamonds

ARRIS ECO Self Service

September 10, 2016

ARRIS ECO Self Service will empower subscribers to manage their home wireless network with self-help tools. It is not a downloadable app ...

4 Diamonds

CommScope Fiber Indexing

September 10, 2016

Fiber Indexing uses connectorized cables and terminals, which allow installers to use a cookie-cutter approach ...

4 Diamonds

ComSonics Mobile Problem Locator

September 10, 2016

The Mobile Problem Locator (MPL) is a smartphone application designed to provide cable technicians with a simple tool to help maintain the ...

4 Diamonds

Concurrent Aquari Open-Scale Storage

September 10, 2016

Aquari Open-Scale Storage System is a self-healing storage system capable of scaling to exabytes of usable capacity. Concurrent says that ...

4 Diamonds

Crystal Citrine

September 10, 2016

Crystal Citrine v7.5 is the latest update to Crystal's network management system, which centralizes, tracks and visualizes signal flow through ...

4 Diamonds

Deviser Instruments AE2200 FTTx Multi-Function Meter

September 10, 2016

Diamonds judges applauded AE2200's all-in-one functions for CATV, its size and its portability. Specifically, the AE2200 FTTx Multi-Function ...

4 Diamonds

Effigis Geo-Solutions DSG1 Lite/DRV3 Lite Cable Pressure Test Kit

September 10, 2016

Effigis says that the goal of developing this product suite was to answer the question, "How do we make sure there is no cable leakage?" The ...

4 Diamonds

Guavus Care Reflex

September 10, 2016

Customer care agents have access to an abundance of data, but without the ability to connect the dots, they are left to make snap judgments ...

4 Diamonds

Harmonic VOS 360 Cloud Media Processing Service

September 10, 2016

Harmonic's VOS 360 Cloud Media Processing Service is a software-as-a-service solution hosted in the public cloud, but monitored and ...

4 Diamonds

Harmonic ViBE 4K Encoder

September 10, 2016

The Harmonic ViBE 4K Encoder is built on the company's ViBE EM4000 premium encoder chassis. The product enables media enterprises to ...

4 Diamonds

Harmonic VOS Cloud Media Processing Platform

September 10, 2016

VOS Cloud is an extension of Harmonic's VOS software-based media processing technology. It manages the entire video production and ...

4 Diamonds

Net Insight Sye

September 10, 2016

Net Insight's Sye is a live OTT streaming solution, which the company says offers frame-accurate synchronization across any type of screen ...

4 Diamonds

Qwilt Video Fabric

September 10, 2016

Qwilt Video Fabric supports the rapid increase of traffic operators are experiencing due to the increase in next-gen streaming video. The ...

4 Diamonds

Tektronix Sentry ABR Video Quality Monitoring Platform

September 10, 2016

Sentry is part of the Tektronix video quality and service assurance solution for monitoring TV Everywhere and multiscreen services. This year ...

4 Diamonds

Viavi OneExpert CATV ONX-630

September 10, 2016

<!-- /* Font Definitions */ @font-face {font-family:"MS 明朝"; mso-font-charset:78; mso-generic-font-family:auto; mso-font-pitch:variable; mso-font-signature:1 134676480 16 0 131072 0;} @font-face {font-family:"...

4 Diamonds

Viavi FiberChek

September 10, 2016

The days of the "dedicated fiber technician" are over, Viavi says. Every technician works with fiber, and every technician is expected to inspect ...

4 Diamonds

ZCorum Remote Spectrum

September 10, 2016

ZCorum Remote Spectrum lets a cable operator view the downstream spectrum passing through a cable modem or set-top remotely without ...

4 Diamonds

ZCorum TruVizion

September 10, 2016

TruVizion is a web-based diagnostics application that provides current and historical data on the health of the CMTS, DOCSIS network and CPE ...

3.5 Diamonds

Amdocs Sales Quote Order Experience Solution

September 10, 2016

The Amdocs Sales Quote Order Experience Solution is designed to help operators streamline their B2B sales lead-to-order process and increase ...

3.5 Diamonds

ARRIS ServAssure Alarm Central

September 10, 2016

ServAssure Alarm Central automates the identification and prioritization of existing and potential service impairments by monitoring cable ...

3.5 Diamonds

Deluxe OnDemand OneSource

September 10, 2016

Deluxe OnDemand OneSource is actually a suite of management services designed to automate, centralize and simplify content and ...

3.5 Diamonds

Hitron CMS-02

September 10, 2016

The CMS-02 was developed in conjunction with a major U.S.-based cable operator to help solve the challenge of identifying the source of ...

3.5 Diamonds

Huawei Cloud DVR Solution

September 10, 2016

 

Huawei Cloud DVR (cDVR) stores, caches, transcodes, packages, encrypts and restreams content to any device, any location, any time. It is ...

3.5 Diamonds

Radiant Communications QRF5000MFX Series

September 10, 2016

The QRF5000MFX Series RFoG/PON encoder allows the MSOs to deploy all-digital lineups to low-cost set-tops. It can be used in conjunction ...

3.5 Diamonds

Universal Electronics Ecolink Wireless Security and Home Automation Sensors

September 10, 2016

Universal Electronics' portfolio of wireless security and home automation sensors include flood and freeze sensors, adjustable window and door ...

3.5 Diamonds

Verimatrix Verspective Operator Analytics

September 10, 2016

Verspective Operator Analytics is a suite of offerings designed to emphasize data security and integrity as a foundation for actionable ...

3.5 Diamonds

Viavi WiFi Advisor with Smart Channel Wizard

September 10, 2016

The Smart Channel Wizard dashboard is a new addition to the WiFi Advisor. It helps technicians optimize customer WiFi by guiding them ...

3.5 Diamonds

Viavi PathTrak PNM HomeTrak Application

September 10, 2016

PathTrak PNM locates plant issues and prioritizes severity based on the number of customers impacted. To make home impairments visible, the ...

Ciena 8700

Ciena 8700 Packetwave Platform

September 10, 2014

Ciena was not only awarded 5 Diamonds for its 8700 Packetwave Platform, but it also was named this year's Diamond Technology Reviews ...

Aurora UniPHY

Aurora Networks UniPHY Converged Services Platform

September 10, 2014

The UniPHY converged services platform from Aurora Networks - a Pace Company - addresses operators' needs to unify ongoing bandwidth ...

Aurora DR3450N

Aurora Networks Universal Digital Return Receiver, DR3450N

September 10, 2014

The DR3450N is the newest addition by Aurora Networks - a Pace Company - to its Universal Digital Return family. It can support up to 100 ...

Harmonic Electra XVM

Harmonic Electra XVM

September 10, 2014

The software-based Electra XVM is a fully converged, broadcast-ready, virtualized media processor that integrates real-time encoding ...

Harmonic VOS

Harmonic VOS

September 10, 2014

Harmonic VOS provides cable operators with a common media processing platform and architecture. It operates virtually in IT data center ...

This Technology

This Technology VEX Manifest Manipulator

September 10, 2014

VEX uses manifest manipulator software to support multiscreen ad delivery by dynamically altering adaptive bitrate video streams. It enhances ...

This Technology

This Technology Trajectory Dynamic Ad Insertion 2.1

September 10, 2014

Trajectory is an open, standards-based dynamic ad insertion solution that drives ad routing for linear, on-demand and network DVR, with ...

Transmode 100G units

Transmode Metro 100G Solution

September 10, 2014

Transmode's new product range is a CFP-based, all-pluggable 100G solution for metro networks with support for current optics. It supports ...

AFL FOCIS WiFi

AFL FOCIS WiFi Fiber Optic Connector Inspection System

September 10, 2014

Called a "good, worthwhile product," and "user friendly," with lots of extras like storage and low loss, by one Diamonds Judge, the FOCIS WiFi ...

Alticast HDMI Stick

Alticast HDMI Media Express

September 10, 2014

Alticast's HDMI Media Express is a set-top box on a stick that works with a home gateway to securely deliver programming to any TV and also ...

ARRIS ServAssure WiFi

ARRIS ServAssure WiFi Solutions

September 10, 2014

ARRIS ServAssure WiFi Solutions offers operators the visibility they need to assist customers with WiFi installation and troubleshooting and, as ...

ClickSoftware 8.2 CS

ClickSoftware ServiceOptimization Suite, Release 8.2

September 10, 2014

While one Diamonds judge said the ServiceOptimization Suite 8.2 is a feature rich workforce management solution, another said it offers ...

ComSonics QAM Shadow

ComSonics QAM Shadow

September 10, 2014

ComSonics says its new QAM Shadow completes the DDF leakage detection arsenal to give cable operators the complete set of tools they need ...

Deviser DS2800

Deviser DS2800 Network Analyzer (Marketed by Electroline)

September 10, 2014

The DS2800 Network Analyzer is manufactured by Deviser and marketed by Electroline. It is an all-in-one tool for performing the installation ...

Envivio Muse 4K

Envivio Muse 4K Ultra HD

September 10, 2014

Called a "solid" 4K/HEVC encoder by one Diamonds judge, the Muse 4K Ultra HD was singled out by another judge because it automates and ...

Espial Youtube Sports

Espial G4 STB Client: RDK Application Framework

September 10, 2014

The goal of the G4 STB client is to help operators design and build a user experience that exceeds subscriber expectations, Espial says. Based ...

Fabrix VIDFX

Fabrix Systems VIDFX

September 10, 2014

The Fabrix VIDFX is a scale-out, cloud-based storage and computing platform built using the converged cloud architecture resources principle ...

Harmonic ProView 8100

Harmonic ProView 8100

September 10, 2014

The ProView 8100 is a single-channel commercial decoder and descrambler designed to optimize primary distribution of video content over ...

Hitron CGNM

Hitron Technologies CGNM (DOCSIS 3.0 24X8 Gateway w/802.11 ac & MoCA 2.0)

September 10, 2014

The CGNM addresses the home networking technology challenge of WiFi reach range, throughput performance and the ability to remotely ...

IneoQuest AMP

IneoQuest AMP for Adaptive Streaming

September 10, 2014

Dubbed "groundbreaking" by one Diamonds judge, the Audience Measurement Platform for Adaptive Streaming (AMP ASM) is a viewership ...

IneoQuest Expedus DVA IP

IneoQuest Expedus DVA IP

September 10, 2014

The Expedus DVA IP is a scalable QoS and QoE monitoring probe that simultaneously decides and captures thumbnail images every second for ...

JDSU QAM egress

JDSU QAM Egress Option for the JDSU DSAM (Digital Services Activation Meter)

September 10, 2014

One Diamonds judge said he cannot wait to test the QAM Egress Option at Expo. The solution, which is an upgrade option for JDSU's DSAM ...

Net Insight Nimbra VA 220

Net Insight AB Nimbra VA 220 Video Appliance

September 10, 2014

With the Nimbra VA 220, Net Insight builds on the error-protected transport mechanism from the Nimbra VA 210 by adding MPEG encoding ...

Pico Digital PD1600

Pico Digital PD1600

September 10, 2014

The PD1600 is an ultra-compact "headend in a box" for the secure delivery of cable, satellite, and IPTV content to multiple dwelling units ...

RGB CloudXtream

RGB Networks CloudXtream

September 10, 2014

CloudXtream combines RGB's software-based transcoding and packaging solutions with cloud architectures to deploy network digital video ...

Tektronix QCloud AWS

Tektronix QCloud

September 10, 2014

QCloud is a cloud-based QC software subscription platform designed to meet the needs of the production, post production, broadcast and ...

TelVue B1000 4K

TelVue HyperCaster 4K

September 10, 2014

With 4K TVs now on the market, operators looking to offer some content specific to these devices can leverage TelVue's Hypercaster 4K, one ...

This Technology

This Technology SwitchStream Alternate Content 2.0

September 10, 2014

Managing blackouts, such as for sports content, is difficult in an IP video environment because video providers have lacked the visibility into ...

Triveni GuideBuilder Combo

Triveni Digital GuideBuilder 5

September 10, 2014

GuideBuilder 5 is the latest generation of Triveni Digital's metadata generation platform. It uses an electronic program guide (EPG) generator ...

VeEx RXT

VeEX RXT

September 10, 2014

The RXT is a modular field and headend/CO test platform that can be configured to perform tasks like service testing or SLA compliance at ...

VeEx CX350s

VeEX VePAL CX350s

September 10, 2014

The CX350s is an all-in-one installer meter designed for MSO business services. It combines multiple test sets for RF, Ethernet and T-1 and ...

AFL LG1642XL

AFL LG-1642XL-FTTx Aerial Closure

September 10, 2014

One Diamonds judge liked the fact that the LG-1642XL-FTTx provides standard SC/APC connectors in a convenient package, saying this could ...

Amdocs Small Cell Solution

Amdocs Small Cell Solution (Metro Cells and WiFi Access Points)

September 10, 2014

The Amdocs Small Cell Solution is designed to automate the process of planning, designing, and rolling out small cells and WiFi access points ...

ARRIS MS4000

ARRIS MS4000

September 10, 2014

The ARRIS Media Streamer 4000 (MS4000) is a multiscreen media streaming device that empowers service providers to offer live and recorded ...

Envivio Guru

Envivio Guru

September 10, 2014

The Guru monitors video quality for all resolutions and all bitrates in real time without the need for additional equipment. It can control and ...

Harmonic NSG Exo

Harmonic NSG Exo

September 10, 2014

NSG Exo is a cable edge device designed to enable a distributed access architecture. This CCAP-ready system allows service providers to move ...

Inca 4430, 5430

Inca Networks Modular Series 4400

September 10, 2014

The Modular Series 4400 is an intelligent video delivery platform that offers 20% higher MPEG-4-HD transcoding density than other solutions ...

Megger CFL535G

Megger CFL535G Time Domain Reflectometer

September 10, 2014

The Megger CFL535G is a dual-channel, high resolution, compact Time Domain Reflectometer with a minimum resolution of 0.3 ft/0.1 m and a ...