Scribd
Upload
57 views

ADC - Lecture 5 Digital Source Coding - 1

Digital source coding involves encoding data to more efficiently represent information for transmission. There are four main types of coding: encryption for security, data compression to reduce data size, data translation to change representation, and error control to detect and correct errors. Source coding specifically refers to encoding data before transmission, either by converting analog signals to binary format or reducing the size of digital data. This is done through techniques like Huffman coding, which assigns variable length codewords to symbols based on frequency to allow for more efficient representation of information.

Uploaded by

nabeel hasan
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
57 views

ADC - Lecture 5 Digital Source Coding - 1

Digital source coding involves encoding data to more efficiently represent information for transmission. There are four main types of coding: encryption for security, data compression to reduce data size, data translation to change representation, and error control to detect and correct errors. Source coding specifically refers to encoding data before transmission, either by converting analog signals to binary format or reducing the size of digital data. This is done through techniques like Huffman coding, which assigns variable length codewords to symbols based on frequency to allow for more efficient representation of information.

Uploaded by

nabeel hasan
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 10

Digital Source Coding

Coding in communication system


In the engineering sense, coding can be classified into four areas:
•Encryption: to encrypt information for security purpose.
•Data compression: to reduce space for the data stream.

  • Data translation: to change the form of representation of the


information so
                                                          

that it can be transmitted over a communication channel.


•Error control: to encode a signal so that error occurred can be detected
and
possibly corrected.
Source Coding
Source Coding - Code data to more efficiently represent
the information
– Reduces “size” of data

 
– Analog - Encode analog source data into a binary format
– Digital - Reduce the “size” of digital source data
                                                          

• Channel Coding - Code data for transmission over a noisy


communication channel
– Increases “size” of data
– Digital - add redundancy to identify and correct errors
– Analog - represent digital values by analog signals
Source Coding
A (binary) source code C for a random variable X is a mapping from X to a
(finite) binary string.

                                                            
Source Coding
Encoding: Given a code (corresponding to some
alphabet S) and a message, replace the characters
by the codewords.
Decoding: Given an encoded message, decoding is
  the process of turning it back into the original
message.
                                                          
Huffman Coding

                                                            
Huffman Coding Example
An example of scalar Coding

                                                            

Efficiency=99.16%
Huffman Vector Coding

Multiple symbols are encoded at a time.


If symbols are independent, entropy for n-symbols vector coding is n times
that of scalar coding.

  In most cases, symbols are not independent e.g. English alphabets


                                                          

Example from Sklar, Page 864-865


Huffman Coding Example
An example of Vector Coding: dependent symbols

                                                            

Efficiency=98.93%
Assignment/Practice Questions # 2

Do following problems from Sklar’s book:


◦ 2.7, 2.8, 2.9, 2.10, 2.15, 2.16, 13.2, 13.6, 13.7,
13.12, 13.13
                                                            

13

You might also like