Dictionary of Electrical Engineering

Commonly used terms in the Electrical industry.

entropy estimation
noiseless source coding theorem states that the bit rate can be made arbitrarily close to the entropy of the source that generated the image. Entropy estimation is the process of characterizing the source using a certain model and then finding the entropy with respect to that model. The major challenge here is to approximate the source structure as close as possible while keeping the complexity of the model and the number of parameters to a minimum.