Careers360 Logo
Interested in this College?
Get updates on Eligibility, Admission, Placements Fees Structure
Compare

Quick Facts

Medium Of InstructionsMode Of LearningMode Of Delivery
EnglishSelf StudyVideo and Text Based

Course Overview

An Introduction to Information Theory training encompasses dealing with certain key concepts of information theory which will further address the fundamental questions of the fundamental limit of data compression and the maximum data rate for transmission over a communication link. Taught by experienced IIT Kanpur faculty, this course will also enlighten learners about practicing source compression algorithms and determining the computed channel capacity of simple channels.

An Introduction to Information Theory certification syllabus will be covered in eight weeks when candidates can learn at their own pace within the comfort of their homes. The course is being offered by NPTEL to bridge the digital divide between the privileged and the lesser privileged. Since SWAYAM is an indigenous IT platform initiated by the Government of India, pursuing the course would be instrumental for self-actualization, in turn providing opportunities to candidates for life-long learning.

Moreover, its coherent pace will even help amateurs understand basic concepts surrounding the topic. Candidates can check their learning through self-assessed tests and participate in discussion forums for clearing their doubts.

The Highlights

  • Taught by faculty from IIT Kanpur
  • The syllabus spread over eight weeks
  • A course designed for both undergraduate and postgraduate students
  • The course provider is Swayam 

Important dates

Course Commencement Date

Start Date : 20 Jan, 2025

End Date : 14 Mar, 2025

Enrollment Date

End Date : 27 Jan, 2025

Other

End Date : 14 Feb, 2025

Certificate Exam Date

Start Date : 23 Mar, 2025

Programme Offerings

  • Assessment modules
  • Instructional videos
  • Animation
  • Live experiments
  • references
  • Books
  • video lectures
  • audio lectures.

Courses and Certificate Fees

Fees InformationsCertificate AvailabilityCertificate Providing Authority
INR 1000yesIIT Kanpur
  • Candidates can enroll for free in this program 
  • Candidates need to pay Rs. 1000 as An Introduction to Information Theory fee to appear for the exam and get a certification of completion.

An Introduction to Information Theory Fees details 

Fee

Amount in Rs.

Course Fee

Free learning

Exam Fee

Rs. 1000


Eligibility Criteria

Education

An Introduction to Information Theory program prescribes that candidates must possess the basic knowledge of digital communications and probability theory before taking up the course.

Certification Qualifying Details

To qualify for An Introduction to Information Theory Certification, learners will have to submit the examination fees and take the qualifying examination at their chosen center on the decided date and slot. Candidates will receive An Introduction to Information Theory Certification only if they score at least 10/25 in the average assignment score (calculated from the average of the best 6 assignments out of 8 assignments) and 30/75 marks in the proctored certification exam to be given in person at the designated center. It must be noted that failure to meet the above criteria will debar them from receiving the certificate even though the total score is 40/100.

What you will learn

Knowledge of engineering

Electronics and electrical engineers who may want to brush up their knowledge or know everything about information theory will be satiated with knowledge upon the completion of An Introduction to Information Theory Certification Course. This online training offers relevant education on the following concepts-

  • Determining the maximum data rate for transmission over a communication link
  • Learning more about information theory
  • Determining the fundamental limit of data compression
  • Studying practice source compression algorithms
  • Studying methods of computing channel capacity of simple channels
  • Learning about Gaussian channel and parallel Gaussian channel
  • Learning about a block to variable-length coding in three parts
  • Discovering information inequalities

Who it is for

An Introduction to Information Theory program precisely falls under the categories of communication and signal processing and electrical, electronics and communication engineering. Taking up this course will especially aid the given people-

  • Undergraduates in their third year pursuing electronics and communications engineering
  • Postgraduates in their first year pursuing a specialization in communications and signal processing
  • Undergraduate students in their fourth year pursuing electronics and communication engineering

Admission Details

Students who are willing to apply for admission in An Introduction to Information Theory online course must follow the steps that are given below:

Step 1: Visit the course URL- https://onlinecourses.nptel.ac.in/noc25_ee03/preview

Please note: The admissions are closed at the moment. Participants can apply to this program after it reopens. 

The Syllabus

  • Introduction
    • Entropy
    • Relative Entropy
    • Mutual Information
  • Information Inequalities

  • Block to variable length coding-I: Prefix-free code
  • Block to variable length coding-II: Bounds on optimal codelength
  • Block to variable length coding-III: Huffman coding

  • Variable to block length coding
  • The asymptotic equipartition property
  • Block to block coding of DMS

  • Universal Source Coding-I: Lempel-Ziv Algorithm-LZ77
  • Universal source coding-II: Lempel-Ziv Welch Algorithm (LZW)

  • Coding for sources with memory
  • Channel capacity of discrete memoryless channels

  • Joint typical sequences
  • Noisy channel coding theorem
  • Differential entropy

  • Gaussian Channel
  • Parallel Gaussian Channel

  • Rate Distortion Theory
  • Blahut-Arimoto Algorithm for computation of channel capacity and rate- distortion function

Instructors

IIT Kanpur Frequently Asked Questions (FAQ's)

1: Is there any age limit prescribed for pursuing An Introduction to Information Theory training?

There is no criterion for the age limit. However, the applicants must meet the eligibility provided on the course page.

2: What will be the mode and medium of lectures in An Introduction to Information Theory certification course?

The course will be delivered in English, including the assessments and reading material. The video lectures may be subtitled in other local languages as well.

3: Can the videos be browsed offline?

The videos cannot be browsed offline. Learners can download the transcript of the video if they face connectivity issues.

4: Can a student change the start date of his course?

Yes, they need to follow the given steps-

1) login via the Swayam portal with their registered id. 

2) Click on the course settings icon on the right side of the course page.

3) Select the "Change Start Date" option and it is done.

5: Is there a deadline for completing the course?

The end date of the course has to be checked on the course page. Learners interested in receiving certification will have to take the proctored exam after that.

6: What are the technical requirements of this course?

The system requirements are as follows-

1) Laptop/desktop with a stable internet connection.

2) Latest flash player installed on the device. 

3) Operating system of either Microsoft Windows, Mac iOS, Linux, or Android

4) Any browser including Internet Explorer, Safari, Chrome, Firefox, or Opera 

5) Port 80 or Port 1935 RTMP should be open.

7: How will a student know that performing a certain exercise is compulsory for course completion?

Students will be able to spot an ‘encircled I’ icon displayed beside every mandatory content in the course schedule. Hovering over the icon will display a message if the content is compulsory.

8: When will the certificate for An Introduction to Information Theory online course become available?

Once the results are evaluated, students can check their dashboard. It will be displayed there in due course.

Articles

Back to top