A method of quasi-continuous image formation in observation devices with discrete receivers

Keywords: quasi-continuous image, intraframe scanning, photosensitive matrix, matrix elements

Abstract

The article proposes a new method of quasi-continuous image formation in observation devices with discrete receivers. The increase in the number of spatial sampling points in the object image is provided by intraframe scanning. Scanning is carried out by a photosensitive matrix with a regularly changed (controlled) density of the elementary receivers (CDR-matrix). The CDR-matrix contains identical elementary receivers. They are regularly distributed over the matrix surface. The vertical and horizontal distance between adjacent receivers is a multiple of the size of the elementary receiver. The CDR-matrix becomes equivalent in pixel dimensions to a larger photosensitive matrix. The magnitude of the multiplicity placement of the receivers is chosen by the developer when designing the light-sensitive matrix. The image of the object by the CDR-matrix (a separate frame) is composed of a series of snapshots. Each snapshot is formed by signals coming from all elementary receivers of the CDR-matrix. The number of snapshots in the frame is set by the multiplicity of the size of the elementary receivers vertically and horizontally. While using intraframe scanning, the CDR-matrix with a pixel size of the video format can operate in the mode of a photosensitive matrix with a pixel size of 2.5 MP. A CDR-matrix with a pixel size of 6 MP can operate as a 48 MP matrix of a conventional design. A mechanism for storing a frame with observation results when using a CDR-matrix is proposed. It assumes the use of the matrix addition operation. The signal matrix of the observed frame is considered as the sum of the signal matrices of all the snapshots in the frame. Application of the developed method will make it possible to multiply the pixel size of the image relative to the pixel size of the controllable photosensitive matrix. The advantages of the proposed method also include the absence of a mandatory decrease in the effective area of an elementary receiver with an increase in their number in the photosensitive matrix; simplification of hardware measures to reduce the effect of image shift on its quality; absence of information losses in the intervals between adjacent elementary receivers.

References

Ferraris, V., Dobigeon, N., Wei, Q., Chabert, M. (2018). Detecting changes between optical images of different spatial and spectral resolutions: a fusion-based approach. IEEE transactions on geoscience and remote sensing, 56, 1566–1578. https://doi.org/10.1109/tgrs.2017.276534

Korobchynskyi, M., Slonov, M., Rudenko, M., Maryliv, O. (2020). Assessment of the effect of image shift on the results of photo-video recording. Proceedings of the IEEE 40th International Conference on Electronics and Nanotechnology, 641–645. https://doi.org/10.1109/elnano50318.2020.9088766

Korobchynskyi, M., Slonov, M., Rudenko, M., Maryliv, O., Pylypchuk, V. (2021). Critical modes of photography: light sensitivity and resolution. Communications in Computer and Information Science, 1158, 264–274. https://doi.org/10.1007/978-3-030-61656-4 https://link.springer.com/book/10.1007%2F978-3-030-61656-4

Krasilnikov, N. N. (2011). Digital Processing of 2D and 3D Images. BHV. (in Russian).

Krasilnikov, N. N., Krasilnikova, O. I. (2002). Study of the efficiency of the human visual system in recognizing static images. Journal of Optical Technology, 69, 397– 403.

Kwan, C. (2018). Image resolution enhancement for remote sensing applications. ICVISP 2018: Proceedings of the 2nd International Conference on Vision, Image and Signal Processing, 1–5. https://doi.org/10.1145/3271553.3271590 https://dl.acm.org/doi/10.1145/3271553.3271590

Mitchell, E. N. (1984). Photographic Science. John Wiley & Sons.

OWC Unleashes 2nd Gen ThunderBlade SSD Drives With a Top Speed of 5000 MBps. (2021). Retrieved from: https://www.dpreview.com/news/2707357090

Pat. 81195 UA, IPC G06K 9/00, G06K 9/46, G06K 9/62, G06K 9/80, Method for enhancing spectral variability of lagospectral aerospace images, Popov, M. O., Stankevich, S. A., Kozlova, A. O., Publ. 10.12.2007 (in Ukrainian).

Popov, M. A. (2018). On the technology of creating new technologies in remote sensing. Ukrainian Journal of Remote Sensing of the Earth, 17, 4–9. (in Russian).

Popov, M. A., Stankevich, S. A., Shklyar, S. V. (2015). Algorithm for enhancing the distributional efficiency of images displaced by subpixels. Mathematical Machines and Systems, 1, 29–36. (in Russian).

Rehm, L. (2021). Samsung Launches 1/3.4" 20 MP Sensors for Use in Smartphone Front Cameras and Telemodules. Retrieved from: https://www.dpreview.com/news/5407916317.

Stankevich, S. A., Maslenko, O. V., Andronov, V. V. (2020). Neural network technology adaptation to the small-size objects identification in satellite images of insufficient resolution within the graphic reference images database. Scientific Centre for Aerospace Research of the Earth, National Academy of Sciences of Ukraine, 27, 13–17. (in Ukrainian).

The largest digital camera in the world has a resolution of 3.2 gigapixels. (2021). Retrieved from: https://tehnobzor.ru/stati/samaja-bolshaja-kamera (in Russian).

Section
Techniques for Earth observation data acquisition, processing and interpretation