Introduction to Information Theory and Data Science

Miguel R.D. Rodrigues; Stark C. Draper; Waheed U. Bajwa; Yonina C. Eldar

doi:10.1017/9781108616799.002

Introduction to Information Theory and Data Science

Miguel R.D. Rodrigues, Stark C. Draper, Waheed U. Bajwa, Yonina C. Eldar

Department of Computer Science and Applied Mathematics

Weizmann Institute of Science

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

Abstract

The purpose of this chapter is to set the stage for the book and for the upcoming chapters. We first overview classical information-theoretic problems and solutions. We then discuss emerging applications of information-theoretic methods in various data-science problems and, where applicable, refer the reader to related chapters in the book. Throughout this chapter, we highlight the perspectives, tools, and methods that play important roles in classic information-theoretic paradigms and in emerging areas of data science. Table 1.1 provides a summary of the different topics covered in this chapter and highlights the different chapters that can be read as a follow-up to these topics.

Original language	English
Title of host publication	Information-Theoretic Methods in Data Science
Editors	Miguel R.D. Rodrigues, Yonina C Eldar
Publisher	Cambridge University Press
Chapter	1
Pages	1-43
Number of pages	43
ISBN (Electronic)	9781108616799
ISBN (Print)	9781108427135
DOIs	https://doi.org/10.1017/9781108616799.002
State	Published - 1 Jan 2021

Keywords

Information theory
channel coding
communication
compression
data acquisition
data analysis
data processing
data representation
machine learning
source coding
statistics

All Science Journal Classification (ASJC) codes

General Engineering
General Computer Science
General Social Sciences
General Mathematics

Access to Document

10.1017/9781108616799.002

Cite this

@inbook{2bc4a0ae0b3c4a998b5da2763ce92626,

title = "Introduction to Information Theory and Data Science",

abstract = "The purpose of this chapter is to set the stage for the book and for the upcoming chapters. We first overview classical information-theoretic problems and solutions. We then discuss emerging applications of information-theoretic methods in various data-science problems and, where applicable, refer the reader to related chapters in the book. Throughout this chapter, we highlight the perspectives, tools, and methods that play important roles in classic information-theoretic paradigms and in emerging areas of data science. Table 1.1 provides a summary of the different topics covered in this chapter and highlights the different chapters that can be read as a follow-up to these topics.",

keywords = "Information theory, channel coding, communication, compression, data acquisition, data analysis, data processing, data representation, machine learning, source coding, statistics",

author = "Rodrigues, {Miguel R.D.} and Draper, {Stark C.} and Bajwa, {Waheed U.} and Eldar, {Yonina C.}",

note = "Publisher Copyright: {\textcopyright} 2021 Cambridge University Press.",

year = "2021",

month = jan,

day = "1",

doi = "10.1017/9781108616799.002",

language = "الإنجليزيّة",

isbn = "9781108427135",

pages = "1--43",

editor = "Rodrigues, {Miguel R.D.} and Eldar, {Yonina C}",

booktitle = "Information-Theoretic Methods in Data Science",

publisher = "Cambridge University Press",

address = "بريطانيا",

}

TY - CHAP

T1 - Introduction to Information Theory and Data Science

AU - Rodrigues, Miguel R.D.

AU - Draper, Stark C.

AU - Bajwa, Waheed U.

AU - Eldar, Yonina C.

PY - 2021/1/1

Y1 - 2021/1/1

N2 - The purpose of this chapter is to set the stage for the book and for the upcoming chapters. We first overview classical information-theoretic problems and solutions. We then discuss emerging applications of information-theoretic methods in various data-science problems and, where applicable, refer the reader to related chapters in the book. Throughout this chapter, we highlight the perspectives, tools, and methods that play important roles in classic information-theoretic paradigms and in emerging areas of data science. Table 1.1 provides a summary of the different topics covered in this chapter and highlights the different chapters that can be read as a follow-up to these topics.

AB - The purpose of this chapter is to set the stage for the book and for the upcoming chapters. We first overview classical information-theoretic problems and solutions. We then discuss emerging applications of information-theoretic methods in various data-science problems and, where applicable, refer the reader to related chapters in the book. Throughout this chapter, we highlight the perspectives, tools, and methods that play important roles in classic information-theoretic paradigms and in emerging areas of data science. Table 1.1 provides a summary of the different topics covered in this chapter and highlights the different chapters that can be read as a follow-up to these topics.

KW - Information theory

KW - channel coding

KW - communication

KW - compression

KW - data acquisition

KW - data analysis

KW - data processing

KW - data representation

KW - machine learning

KW - source coding

KW - statistics

UR - http://www.scopus.com/inward/record.url?scp=85190829361&partnerID=8YFLogxK

U2 - 10.1017/9781108616799.002

DO - 10.1017/9781108616799.002

M3 - فصل

SN - 9781108427135

SP - 1

EP - 43

BT - Information-Theoretic Methods in Data Science

A2 - Rodrigues, Miguel R.D.

A2 - Eldar, Yonina C

PB - Cambridge University Press

ER -

Introduction to Information Theory and Data Science

Abstract

Keywords

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this