The Capacity of a Channel with an Image as the Information Source ()

Lev B. Levitin, Tommaso Toffoli

Department of Electrical & Computer Engineering, Boston University, Boston, USA.

**DOI: **10.4236/jqis.2014.42012
PDF
HTML
3,020
Downloads
4,087
Views
Citations

Department of Electrical & Computer Engineering, Boston University, Boston, USA.

We consider the physical limitations imposed on the information content
of an image by the wave and quantum nature of light, when the image is obtained
by illuminating a reflecting or transmitting planar object by natural (*i.e.*, fully thermalized) light, or by
observation of an object emitting incoherent (thermal) radiation. The
discreteness of the degrees of freedom and the statistical properties of
thermal radiation are taken into account. We derive the maximum amount of information
that can be retrieved from the object. This amount is always finite and is
proportional to the area of the object, the solid angle under which the
entrance pupil of the receiver is seen from the object, and the time of
observation. An explicit expression for the information in the case where the
information recorded by the receiver obeys Planck’s spectral distribution is
obtained. The amount of information per photon of recorded radiation is a
universal numerical constant, independent of the parameters of observation.

Keywords

Quantum Communication, Quantum Limits on Information Retrieval, Information Transmission by Thermal Radiation, Information Content of an Image, Optical Information Channels

Share and Cite:

Levitin, L. and Toffoli, T. (2014) The Capacity of a Channel with an Image as the Information Source. *Journal of Quantum Information Science*, **4**, 111-116. doi: 10.4236/jqis.2014.42012.

1. Introduction

A very general and most common way to store information is to encode it in the optical properties of an object. One can then retrieve information by viewing the object by reflected or transmitted light—or even by light emitted by the object itself—for a specified time interval. Such methods, using natural (i.e., thermalized) light, are universally used in photography, television, printing, etc. In the present paper, we discuss the question of what are the fundamental limitations imposed on these methods by the wave and quantum nature of light and by the statistical properties of thermal radiation, and we determine the maximum amount of information that can be retrieved from the object by illuminating it in this way and observing its optical image during a read-out window of a prescribed time width. We exclude from consideration cases, like holography, which make use of coherent rather than thermal radiation.

The problem under consideration can be reduced to the evaluation of the capacity of a specific classicalquantum information channel (a channel where classical signals are encoded within quantum states).

Though the bulk of work in this direction was done throughout the last few decades (e.g., [1] -[8] ), the special case of thermal radiation deserves a detailed analysis. Note that thermal radiation has maximum entropy for a given average occupation number (the average number of photons per field oscillator); therefore, it is the most “noisy” information carrier.

2. General Assumptions

For simplicity, but without loss of generality, let the external surface of the object be a plane of area. The optical properties of this surface as far as reflected light is concerned may be specified by a reflectivity—a function of a point of the surface and of the frequency of the radiation. (Here and below we take this to be the reflectivity in the direction to the observer; it is inessential for us whether the reflection is diffuse or specular.) As far as we are only interested in limitations owed to the physical nature of light, we can disregard the material structure of the surface. Even though, for any material, reflectivity is well-defined only for areas that are large with respect to interatomic distances, the idealization of reflectivity as a point function is reasonable when the wavelengths that most significantly contribute to the spectrum of natural light sources are large with respect to interatomic distances.

Similarly, for transmitted light, the function should express a transmittance. Finally, in the case of self-luminous surface, will be the ratio of the spectral intensity of the radiation at a given point of the surface to the maximum available spectral intensity.

We also assume that a function can be assigned independently for the two polarization states of radiation.

3. Degrees of Freedom of Radiation

The set of possible functions is restricted only by the inequality. Obviously, an arbitrarily large amount of information could be encoded in the object by associating with it a function of this kind. However, the use of electromagnetic radiation for reading off information changes the situation in principle, and this is what this paper is about.

Indeed, suppose the area is viewed by an optical radiation detector whose entrance pupil is seen under a solid angle from any point of that area. Then, as is well known (see [9] ), the number of “spatial” degrees of freedom, or, in other words, the number of field oscillators (or photon quantum states) differing by the direction of their wave vector (or, for another choice of set of oscillators, by the spatial localization of photons) is equal to

(1)

where is the frequency of a field oscillator and the speed of light.

If the object is observed for a time interval, then the frequency uncertainty of the photon quantum states is, and the number of states of different frequency in a frequency interval is equal to

(2)

Taking into account the two possible polarization states, we obtain, for the total number of radiation degrees of freedom,

(3)

(under the assumption that, i.e., that the geometric optics approximation is valid); thus, we have a finite number of degrees of freedom.

It makes sense to associate a reflectivity only to object details which do not exceed the space and frequency resolution of the viewer, and thus to areas and frequency intervals. Thus, with the present recording/readout method, the retrievable information is specified by the values of a set of random variables, namely, the reflectivities for each of the field oscillators. This amount of information will be maximum when all those random variables are independent; in that case, it will equal the sum of the amounts of information over all the variables.

4. Statistics of Radiation and Information

Even for a single degree of freedom, the amount of information would be infinite if the reflectivity could take on an infinite number of well-distinguishable values. But such a dream becomes untenable as soon as the quantum nature of light and the statistical properties of thermal radiation come into play.

As is well known (see [10] ), in the radiation of thermal sources the states of field oscillators are statistically independent, and described by a Gibbs distribution

(4)

where is the occupation number—or the number of photons in a given quantum state—and the mean occupation number.

Thus, if a source of thermal radiation is used as an information transmitter, the expected value (rather than the exact number of photons) is the input signal. In other words, the signal is the value of the effective temperature for a given degree of freedom of the electromagnetic field.

A remarkable property of distribution (4) of thermal radiation is its stability with respect to scattering, aperture constraints, losses due to small quantum efficiency of the photodetectors, etc. In particular, if the surface is illuminated by thermal radiation, and thus obeying Gibbs’s distribution, the reflected light also has a Gibbs distribution, with the states of field oscillators being independent provided that the illuminating beam is rather wide and has sufficiently large bandwidth. This follows from the transformational properties of the states of the electromagnetic field with respect to a change from a complete set of field oscillators to another complete set (see, e.g., [7] ).

Since the density matrix of thermal radiation is diagonal in energy (or occupation number) representation, the optimal strategy to extract maximum information is measuring the energy, or, in other words, counting the number of photons reaching the receiver. This follows from the fact that the radiation quantum state is completely described by distribution (4) (cf. [4] ).

Let be the average energy of a field oscillator of the radiation source of frequency, and let be the fraction of the energy which is recorded by the detector in the calibration case of reflectivity equal to unity. Then, assigning a specific value of means specifying the mean number of recorded photons for each field oscillator, where.

The maximum mean number of recorded photons will of course be.

As shown in Appendix, when the mean number of photons distributed according to (4) is limited by a maximum value (in the optical range, this corresponds to temperatures), optimal encoding is achieved by using as signal levels just two mean-photon-number values, namely, and (corresponding to reflectivity values and). In this case, the maximum amount of information per field oscillator is, in nats,

(5)

When a spectral band from to, assuming, with (5) and (7) taken into account, we obtain that the maximin amount of information that can be obtained by observation of an object illuminated by incoherent light is

(6)

Thus, the amount of information increases proportionally to the area of the object and the time of observation.

Then, the capacity of such a channel (the maximum information per unit time) is

(7)

It will be interesting to derive an explicit expression for the amount of information in the case when the radiation recorded by the detector obeys Planck’s spectral distribution (for instance, when the illumination source is a black body of temperature and), i.e., when

(8)

where is Boltzmann’s constant and Planck’s constant. Let the frequency band be infinite^{1}. Then

(9)

where is a numerical constant, given by

(10)

The total number of photons recorded by the receiver is in this case

(11)

where is another constant, namely,. Thus, the amount of information per photon is

(12)

his is a universal constant, as it does not depend on the parameters, , of observation.

Now let the solid angle take on the maximum possible value. Then the maximum amount of information per unit time per unit area is

, (13)

where (14)

is the energy flux of reflected radiation at maximum signal level per unit area.

Thus, the maximum amount of retrieved information grows with the 3/4 power of radiation energy.

Appendix

Let us calculate the maximum information per degree of freedom of radiation. Denote, for convenience,

(15)

For a given, the distribution of the number of recorded photons is

(16)

Let the probability density function of the variable. Then the information in the number of recorded photons about the signal value is

(17)

Variational analysis of the functional (see [11]) brings up a remarkable result. That is, if (or), the maximun information is achieved for a distribution of the form

(18)

where

(19)

Thus, if the average occupation numbers are not too large, it is optimal to use only two signal levels, 0 and. The reason for that effect is the breadth of distribution (19) , which makes intermediate values of the signal poorly distinguishable.

From (17)-(19), we obtain that the maximum information per degree of freedom (one field oscillator) is

(20)

corresponding to (5) .

NOTES

^{1}At low frequencies, geometrical optics is not valid, and one cannot use (3); furthermore, for, (5) is not correct. But the contribution of low frequencies is small due to the factor in the integrand, and this allows one to extend the range of integration to zero.

Conflicts of Interest

The authors declare no conflicts of interest.

[1] | Davies, E. (1977) Quantum Communication Systems. IEEE Transactions on Information Theory, 23, 530-534. |

[2] | Gordon, J. (1962) Quantum Effects in Communications Systems. Proceedings of IRE, 50, 1898-1908. |

[3] |
Lebedev, D.S. and Levitin, L.B. (1966) Information Transmission by Electromagnetic Field. Information and Control, 9, 1-22. http://dx.doi.org/10.1016/S0019-9958(66)90074-X |

[4] | Levitin, L.B. (1969) On the Quantum Measure of Information. Proceedings of the 4th Conference on Information Theory, Tashkent, 111-116. English Translation in Annales de la Fondation Louis de Broglie, 21, 1996, 345-358. |

[5] |
Levitin, L.B. (1987) Information Theory for Quantum Systems. In: Blaquière, A., Diner, S. and Lochak, G., Eds., Information, Complexity and Control in Quantum Physics, Springer, Berlin, 15-47. http://dx.doi.org/10.1007/978-3-7091-2971-5_2 |

[6] |
Levitin, L.B. (1994) Entropy Defect and Information for Two Quantum States. Open Systems and Information Dynamics, 2, 319-329. http://dx.doi.org/10.1007/BF02228857 |

[7] | Mitiugov, V. (1976) Physical Principles of Information Transmission Theory. Sovietskoe Radio, Moscow City (in Russian). |

[8] |
Schumacher, B. and Westmoreland, M. (1997) Sending Classical Information via a Noisy Quantum Channel. Physical Review A, 56, 131-138. http://dx.doi.org/10.1103/PhysRevA.56.131 |

[9] | Gabor, D. (1961) Light and Information. Progress in Optics, 1, 111-152. |

[10] | Landau, L. and Lifshits, E. (1980) Statistical Physics. 3rd Edition, Butterworth, Heinemann. |

[11] | Levitin, L.B. (1965) Information Transmission by Thermal Radiation. Proceedings of 2nd National Conferences on Coding Theory and Its Applications, Nauka, Sect. 5, 49-55 (in Russian). |

Journals Menu

Contact us

+1 323-425-8868 | |

customer@scirp.org | |

+86 18163351462(WhatsApp) | |

1655362766 | |

Paper Publishing WeChat |

Copyright © 2024 by authors and Scientific Research Publishing Inc.

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.