F-Divergence inequalities via functional domination

Igal Sason; Sergio Verdú

doi:10.1109/ICSEE.2016.7806028

F-Divergence inequalities via functional domination

Igal Sason, Sergio Verdú

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

This paper considers derivation of f-divergence inequalities via the approach of functional domination. Bounds on an f-divergence based on one or several other f-divergences are introduced, dealing with pairs of probability measures defined on arbitrary alphabets. In addition, a variety of bounds are shown to hold under boundedness assumptions on the relative information.¹

Original language	English (US)
Title of host publication	2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781509021529
DOIs	https://doi.org/10.1109/ICSEE.2016.7806028
State	Published - Jan 4 2017
Event	2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016 - Eilat, Israel Duration: Nov 16 2016 → Nov 18 2016

Publication series

Name	2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016

Other

Other	2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016
Country/Territory	Israel
City	Eilat
Period	11/16/16 → 11/18/16

All Science Journal Classification (ASJC) codes

Computer Science Applications
Hardware and Architecture
Artificial Intelligence
Computer Networks and Communications
Electrical and Electronic Engineering

Keywords

X divergence
f-divergence
relative entropy
relative information
reverse Pinsker inequalities
reverse Samson's inequality
total variation distance

Access to Document

10.1109/ICSEE.2016.7806028

Cite this

Sason, I., & Verdú, S. (2017). F-Divergence inequalities via functional domination. In 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016 [7806028] (2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICSEE.2016.7806028

@inproceedings{f80beed7d8da49dba529e44d352bda54,

title = "F-Divergence inequalities via functional domination",

abstract = "This paper considers derivation of f-divergence inequalities via the approach of functional domination. Bounds on an f-divergence based on one or several other f-divergences are introduced, dealing with pairs of probability measures defined on arbitrary alphabets. In addition, a variety of bounds are shown to hold under boundedness assumptions on the relative information.1",

keywords = "X divergence, f-divergence, relative entropy, relative information, reverse Pinsker inequalities, reverse Samson's inequality, total variation distance",

author = "Igal Sason and Sergio Verd{\'u}",

note = "Funding Information: This work has been supported by the Israeli Science Foundation (ISF) under Grant 12/12, by NSF Grant CCF-1016625, by the Center for Science of Information, an NSF Science and Technology Center under Grant CCF-0939370, and by ARO under MURI Grant W911NF-15-1-0479. Publisher Copyright: {\textcopyright} 2016 IEEE.; 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016 ; Conference date: 16-11-2016 Through 18-11-2016",

year = "2017",

month = jan,

day = "4",

doi = "10.1109/ICSEE.2016.7806028",

language = "English (US)",

series = "2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016",

address = "United States",

}

Sason, I & Verdú, S 2017, F-Divergence inequalities via functional domination. in 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016., 7806028, 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016, Institute of Electrical and Electronics Engineers Inc., 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016, Eilat, Israel, 11/16/16. https://doi.org/10.1109/ICSEE.2016.7806028

F-Divergence inequalities via functional domination. / Sason, Igal; Verdú, Sergio.

2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016. Institute of Electrical and Electronics Engineers Inc., 2017. 7806028 (2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - F-Divergence inequalities via functional domination

AU - Sason, Igal

AU - Verdú, Sergio

N1 - Funding Information: This work has been supported by the Israeli Science Foundation (ISF) under Grant 12/12, by NSF Grant CCF-1016625, by the Center for Science of Information, an NSF Science and Technology Center under Grant CCF-0939370, and by ARO under MURI Grant W911NF-15-1-0479. Publisher Copyright: © 2016 IEEE.

PY - 2017/1/4

Y1 - 2017/1/4

N2 - This paper considers derivation of f-divergence inequalities via the approach of functional domination. Bounds on an f-divergence based on one or several other f-divergences are introduced, dealing with pairs of probability measures defined on arbitrary alphabets. In addition, a variety of bounds are shown to hold under boundedness assumptions on the relative information.1

AB - This paper considers derivation of f-divergence inequalities via the approach of functional domination. Bounds on an f-divergence based on one or several other f-divergences are introduced, dealing with pairs of probability measures defined on arbitrary alphabets. In addition, a variety of bounds are shown to hold under boundedness assumptions on the relative information.1

KW - X divergence

KW - f-divergence

KW - relative entropy

KW - relative information

KW - reverse Pinsker inequalities

KW - reverse Samson's inequality

KW - total variation distance

UR - http://www.scopus.com/inward/record.url?scp=85014228754&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85014228754&partnerID=8YFLogxK

U2 - 10.1109/ICSEE.2016.7806028

DO - 10.1109/ICSEE.2016.7806028

M3 - Conference contribution

AN - SCOPUS:85014228754

T3 - 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016

BT - 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016

Y2 - 16 November 2016 through 18 November 2016

ER -

F-Divergence inequalities via functional domination

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Keywords

Access to Document

Other files and links

Cite this