Multimedia
2016-2017
Dr. Sameh Zarif
Lecture #6
General Rules
Multimedia 2
Media Representation and Formats
Text
Digital Images
Digital Video
Graphics
Digital Audio
Different Types of Media
Text Video
Graphics
Images
Audio
How are these media types represented?
Video Concept
Video is an excellent tool for delivering multimedia.
Video places the highest performance demand on computer
and its memory and storage.
Digital video has replaced analog video as the method of
choice for making and delivering video for multimedia.
Video Concept
Digital video device produces excellent finished products at
a fraction of the cost of analog.
Digital video eliminates the image-degrading analog-to-
digital conversion.
Many digital video sources exist, but getting the rights can
be difficult, time-consuming, and expensive.
Analogue Video
Video information is stored using television video signals,
film, videotape or other non-computer media
Each frame is represented by a fluctuating voltage signal
known as an analogue wave form or composite video.
Digitizing Video
Digital video is often used to capture content from movies
and television to be used in multimedia.
A video source (video camera ,VCR, TV or videodisc) is
connected to a video capture card in a computer.
As the video source is played, the analog signal is sent to
the video card and converted into a digital file (including
sound from the video).
VCR
Video Overlay Board / PC
Video Capture Card
Digitizing Video
Analogue signal from VCR
Converted to DIGITAL
by VIDEO CAPTURE CARD
The converted
signal is
entered inside a
computer
Video is edited
Signal is processed using video editing
software software
Digital Video
Look carefully to this video, how you can produce it?
Digital Video
Video is represented as a sequence discrete images
(frames) shown in quick succession
The Video Image
The Video Image
Representation of Digital Video
Two important properties govern video representation
1. Frame rate: rate at which the images are shown or the number of
frames shown per second.
2. Scanning format: converting the video to a 1D signal
Video Broadcasting (in analog form)
Video Broadcasting (in analog form)
Conversion to YUV
Decouple the intensity information (Y or luminance) from the color
information (UV or chrominance)
RGB
U,V (Chrominance)
Y (Luminance)
Conversion to YUV
The separation was intended to reduce the transmission
bandwidth and is based on experiments with the human
visual system, which suggests that humans are more
tolerant to color distortions.
In other words, reducing the color resolution does not
affect our perception.
YUV color space
If We have R, G, B Channels, Y,U and V are calculated as:
YUV color space
If We have Y, U, V, R,G and B are calculated as:
Analog Video Scanning
Interlaced Scanning
Require lower bandwidth; however it may produce flicker and artifacts
Analog Video Scanning
Progressive Scanning
Require more bandwidth; however it does not produce flicker or
artifacts
Types of Video Signals
YUV Subsampling Schemes
Video signals captured by digital cameras are represented
in the RGB color space.
However, for transmission and other intermediary
processing, the YUV space is commonly used.
Experiments with the human visual system have shown
that this reduction in bandwidth still maintains an
acceptable quality of video for broadcast
Depending on the way subsampling is done, a variety of
subsampling ratios can be achieved.
YUV Subsampling
Keeping the luminance untouched and subsampling the
Chrominance
YUV Subsampling
The conventional representation of this is in the form:
j:a:b
j: the number of horizontal samples in the reference block.
a: the number of pixels in the first row that have Chroma samples.
b: the number of pixels in the second row that have Chroma samples.
a
b
YUV Subsampling
YUV Subsampling Example
Digital Video Representation
Sampling produces a digital representation of video signal. This
compressed and then formed into data stream for transmission. Two
common forms of digital video; DV and MPEG.
DV: applies 4:1:1 chrominance subsampling and constant data rate of 25
Mbits/s.
Alternative higher quality DV version likes
DVPRO: applies 4:2:2 subsampling and higher bit rate (50 Mbits/s).
HDDV (DVPRO HD): applies 4:2:2 subsampling and a bit rate ranging
from 40 Mbits/s~ 100 Mbits/s according to the frame rate.
Introduction of video compression
There are two main types of video compression
Spatial compression (intra-frame): Each frame is compresses
individually using image compression techniques.
Temporal compression (inter-frame): a group of frames is
compressed by only storing the differences between them.
Chrominance subsampling is nearly always applied before any
compression.
Introduction of video compression
Spatial compression : usually based on the discrete cosine transform
(DCT) like JPEG.
Temporal compression : in which, a certain frames are selected as a
key frame. Often, key frames are specified to occur at regular intervals.
These key frames are left without compression. Each frame between the
key frames is replaced by a difference frame.
