IEEE Transactions on Information Theory · 1963 · 64 citations · 12 references
Natural SciencesCommunicationElectrical EngineeringDigital CommunicationOptimizationProbability TheoryDigital Signal ProcessingSignal Detection TheorySignal ProcessingChannel Selection CriteriaCommunication Signal ProcessingDivergenceDivergence MinimizationSelectionSignals
A criterion for selecting a finite set of transmitter signals for a continuous communication channel is proposed. The "optimum" signal sets using this criterion are selected to maximize the minimum divergence between hypothesis pairs being tested at the receiver. The resulting signal sets have the property that the error probability using these signals is less than the error probability for any other choice of signals for some {\em a priori} message statistics. The signal selection procedure may be applied without a knowledge of the {\em a priori} message statistics and does not require an evaluation of error probabilities. Four examples of signal selection are included to illustrate the procedure.
12
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text
Equivalent Comparisons of Experiments
David Blackwell · The Annals of Mathematical Statistics · 1953 · 1.5K citations · Full text
Finite-Dimensional Vector Spaces.
Albert Wilansky, P. R. Halmos · American Mathematical Monthly · 1959 · 706 citations