Understanding Deep Learning with Information Theory

Last updated 26th Jun 2018 1 follower
Follow pinboard

CURATOR

A pinboard by Bernhard Geiger

Senior Researcher, Know-Center GmbH

PINBOARD SUMMARY

Deep learning is fascinating, successful, and little understood. Information theory may help!

To understand neural networks better, researchers have recently made extensive use of information theory.

One popular approach is to train a neural network conventionally, and then evaluate neuro...

11 ITEMS PINNED

#1
Understanding Individual Neuron Importance Using Information Theory
Research published 18th Apr 2018 in arXiv - Com...
Pinned 18th Jun 2018
#2
Information Dropout: Learning Optimal Representations Through Noisy Computation
Pinned 6th Apr 2018
#3
On the importance of single directions for generalization
Research published 19th Mar 2018 in arXiv - Sta...
Pinned 6th Apr 2018
#4
On the Information Bottleneck Theory of Deep Learning
Pinned 6th Apr 2018
Follower (1)
Share
Pinboard URL (click to copy)
Embed on website (click to copy)