
- Acta Photonica Sinica
- Vol. 50, Issue 3, 22 (2021)
Abstract
0 Introduction
Single-pixel Imaging (SPI), which is different from traditional imaging, has its advantages. For example, in infrared and terahertz imaging, traditional array-based imaging sensors and systems are relatively bulky, complicated, and usually demand additional auxiliary modules which make them expensive. In contrast, SPI provides a better solution in which only a single point detector is needed, and the setup of the system is simple, which significantly reduces the costs. It is developed with the advent of the Compressed Sensing (CS) theory. In 2006, DONOHO D L [
However, with the increase of the imaging resolution, the measurements of SPI increase greatly, thus the imaging speed is limited. To solve this problem, current solutions are mainly to improve the sampling speed of the equipment or optimize the algorithm. At present, the generation of spatially structured light mainly depends on the SLM, but as its performance increases, its costs will increase. Therefore, XU Zihao et al.[
Here, based on the collected Hadamard spectrum, it is found that the distribution of the Hadamard spectrum has sparse characteristics, and the average value of the absolute value of the Hadamard coefficients in the oblique line shows a decreasing trend from the upper left to the lower right of the Hadamard spectrum. When it drops to a certain value, its implication on SPI is relatively weak. Taking this fact into consideration, an adaptive oblique zigzag sampling method is proposed and demonstrated to achieve a balance between the expected imaging fidelity and speed. It averages each oblique line of the absolute value of Hadamard coefficients along the oblique zigzag direction from the upper left corner to the lower right corner of the spectrum and compares the results with a threshold set by the user to automatically discard high-frequency signals and noises according to the expected imaging fidelity. Because only when the average values are larger than the set threshold, the Hadamard coefficients are collected, the sampling rate will be adaptively reduced to achieve a balance between imaging speed and the expected imaging fidelity.
1 Principle
1.1 SPI based on HT
Assuming that a digital image is represented as and its resolution is , then its sparse representation in Hadamard domain can be expressed as
inverse Hadamard transformation of the Hadamard coefficients matrix can be expressed as
where are the coordinates in Hadamard domain. is the HT calculation. are the coordinates in spatial domain. is the kth bit of the binary representation of .
Based on the above-mentioned HT, the orthogonal Hadamard basis patterns can be generated using the inverse HT calculation, which can be set and expressed as
The generated Hadamard basis patterns are normalized, and can be expressed as
where is the inverse HT calculation, , and each pattern corresponds to a unique 'Hadamard-frequency' component.
To further improve the imaging fidelity, we adopt a differential algorithm[
therefore, the object can be reconstructed by calculating the inverse HT of it.
1.2 Adaptive oblique zigzag sampling
The proposed method makes full use of the fact that the low frequencies of Hadamard single-pixel imaging are concentrated on the upper left corner as shown in Fig. 1(b) and (c). Fig. 1(a) is the target image to be restored. Fig. 1(b) is the sequential sampling. After carefully investigating the Hadamard spectrum in Fig. 1(c), we found that the average value of the absolute value of the Hadamard coefficients for each oblique line has the characteristic that it decreases rapidly as shown in Fig. 1(d), which inspired us to propose the adaptive oblique zigzag sampling method to achieve a balance between the imaging fidelity and speed.

Most information on a natural object normally concentrates on the low-frequency components, and the subtle details and noise concentrate on the high-frequency components [
As shown in Fig. 1(c), the low-frequency components are concentrated on the upper left corner of the Hadamard spectrum. We found that in the oblique zigzag direction from the upper left to the lower right of the spectrum, the average value of the absolute value of the Hadamard coefficients for each oblique line can be calculated as
in which the oblique line , is the absolute value of the Hadamard coefficients. The evolution curve is plotted in Fig. 1(d), which shows that the rapidly decreases with the increase of the oblique line . Therefore, sampling is performed in an oblique zigzag direction from the upper left corner to the lower right corner of the spectrum. A threshold can be set to perform the adaptively sampling according to the desired imaging fidelity. Only when the average values are larger than the set threshold, the Hadamard coefficients are collected, the sampling rate will be adaptively reduced to achieve a balance between imaging speed and the expected imaging fidelity.
2 Experimental setup
As shown in Fig. 2, light emitted from an ultra-high-pressure mercury lamp incidents on the DMD coded by the basis of Hadamard patterns, which projects the coded illuminations onto the object. The light reflected from the illuminated object is detected by a photodetector (PD KG-PR-200K-A-FS), which converts the optical signal into an electrical signal. The electrical signal is collected by a digital acquisition card (NI USB-6216) to convert it to be a digital signal for computer processing. Finally, the image of the object can be reconstructed computationally.

3 Results and discussion
We adopt the differential algorithm to improve the performance of Hadamard SPI and enhance the anti-interference ability to the system noise. Fig. 3(a) shows the object to be reconstructed. Fig. 3(b) is the image reconstructed without the differential algorithm. Due to the influence of the noise, the edge of the image is blurry. Fig. 3(c) is the reconstructed image after noise reduction by the difference algorithm, thus the contrast of it is better as compared to the reconstruction shown in Fig. 3(b). Besides, the reconstructed image has a better fidelity, which shows that the differential algorithm has a strong anti-interference ability. In the experiments, we adopted the differential algorithm.

To verify the effectiveness of the proposed oblique zigzag adaptive sampling method, the same object as shown in Fig. 3(a) was reconstructed by using the method in which the threshold was set to be 0, 200, 300, and 400. The corresponding experimental results are given in Fig. 4, in which the horizontal coordinate is the oblique line, and the vertical coordinate calculated by Eq.(6), is the average value of the absolute value of the Hadamard coefficients for each oblique line. Besides, there are two inserts, the left one is a zoom-in of the part indicated by the dashed ellipse and the right one is the reconstructed image of the object with a resolution of 128×128 pixels. As can be seen in Fig.4, the evolution curves decrease with the increase of the oblique line , and there is a sharp decrease within which suggests that the low-frequency components are concentrated within a small area () at the upper left corner of the Hadamard spectrum matrix as predicted and shown in Fig. 1(c). It can be seen from the comparison of the evolution curves shown in Fig. 4(a)~(d) that, for the chosen threshold equals to 0, 200, 300 and 400, the sampling rates are respectively 100%, 46.17%, 36.92% and 22.04%, and the object can be successfully reconstructed, which suggests that, by setting different thresholds according to the expected imaging fidelity, the proposed method can adaptively sample along the oblique zigzag path in Hadamard spectrum domain. Therefore, without the need for CS algorithms, it can efficiently collect the low-frequency components in the upper left corner and ignore a few high-frequency components to adaptively reduce the sampling rate for improving the imaging speed of the single-pixel camera.

Fig. 5 gives the results reconstructed using the proposed method and the sequential sampling method with the same sampling rates which are respectively 100%, 46.17%, 36.92%,and 22.04%. SSIM and PSNR [


To further investigate the influence of the dark noise of the PD on SPI using the proposed method. We measured the dark noise signals of two different PDs as shown in Fig. 7(a). The tortoise image with the resolution of 128×128 is reconstructed using the two PDs. The results are shown in Fig. 7(b). The smaller the dark noise of the PD, the better the quality of the reconstructed image, which suggests that the much of dark noise of the detection system can not be suppressed using the differential algorithm [


A Hadamard SPI using the proposed adaptive oblique zigzag sampling method has been proposed and demonstrated. Hadamard transform is one of the orthogonal transforms, therefore, the proposed method not only can apply to other orthogonal transform based SPIs, but also inherits the advantages of orthogonal transform based SPIs.
As indicated in Ref.[21], compared with the traditional compressed sensing method, orthogonal transform based SPIs’ advantages are as follows: First, it can reconstruct the object image without distortion. Second, it can also make better use of the sparsity of natural images in the transform domain to reconstruct high-quality object images by only obtaining larger coefficients in the transform domain, while the compressed sensing method reconstructs object images by dealing with coefficients corresponding to the random patterns without distinction. Third, it is only a simple two-dimensional inverse transformation, so the operation time can be ignored. By contrast, a compressed sensing algorithm takes more time to reconstruct the image.
Besides, our method has the following advantages: First, a threshold can be adaptively set according to the expected imaging fidelity. The method can achieve a balance between imaging speed and the expected imaging fidelity. Second, it can adaptively reduce the sampling rate, thus it can adaptively improve the imaging speed of the SPI significantly. Third, we can further investigate the influence of the dark noise of the PD on SPI. Experimental results show that the proposed adaptive zigzag sampling is capable of automatically reducing the influence of the high-frequency dark noise on the reconstruction quality by setting an appropriate threshold to get better reconstructions.
4 Conclusion
We proposed and demonstrated the Hadamard SPI using the proposed adaptive oblique zigzag sampling method. Experimental results show that it can adaptively reduce the sampling rate while meeting the fidelity required by users by setting a threshold. In other words, it can adaptively achieve a balance between imaging quality and speed. When the dark noise of the PD is high, the advantage of the proposed method is highlighted. Since when the dark noise of the imaging system is high and the high-frequencies of the object to be reconstructed are drowned in the noise, SPI using the fully sequential or zigzag sampling will not give a satisfactory result. However, SPI using the proposed method can automatically discard the high-frequency noise by setting an appropriate threshold to get a better reconstruction, at the same time a balance between imaging quality and speed can be achieved.
References
[1] D L DONOHO. Compressed sensing. IEEE Transactions on Information Theory, 52, 1289-1306(2006).
[2] E J CANDÈS, J ROMBERG, T TAO. Robust uncertainty principles : exact signal frequency information. IEEE Transactions on Information Theory, 52, 489-509(2006).
[3] M F DUARTE, M A DAVENPORT, D TAKHAR. Single-pixel imaging via compressive sampling. IEEE Signal Processing Magazine, 25, 83-91(2008).
[4] W L CHAN, K CHARAN, D TAKHAR. A single-pixel terahertz imaging system based on compressed sensing. Applied Physics Letters, 93(2008).
[5] H RYOICHI, M HIROAKI. Single-pixel compressive diffractive imaging. Applied Optics, 56, 4085-4089(2017).
[6] Shan JIANG, Xianye LI, Zexin ZHANG. Scan efficiency of structured illumination in iterative single pixel imaging. Optics Express, 27, 22499(2019).
[7] Haiyu MA, Aijun SANG, Cheng ZHOU. A zigzag scanning ordering of four-dimensional Walsh basis for single-pixel imaging. Optics Communications, 443, 69-75(2019).
[8] W K PRATT, J KANE, H C ANDREWS. Hadamard transform image coding. Proceedings of the IEEE, 57, 58-68(1969).
[9] J J A DECKER. Hadamard-transform image scanning. Applied Optics, 9, 1392-1395(1970).
[10] M P EDGAR, G M GIBSON, R W BOWMAN. Simultaneous real-time visible and infrared video with single-pixel detectors. Scientific Reports, 5, 745-755(2015).
[11] Mingjie SUN, M P EDGAR, D B PHILLIPS. Improving the signal-to-noise ratio of single-pixel imaging using digital microscanning. Optics Express, 24, 10476-10485(2016).
[12] Zibang ZHANG, Shuming JIAO, Manhong YAO. Secured single-pixel broadcast imaging. Optics Express, 26, 14578(2018).
[13] B LOCHOCKI, A GAMBÍN, S MANZANERA. Single pixel camera ophthalmoscope. Optica, 3, 1056-1059(2016).
[14] Zibang ZHANG, Xueying WANG, Guoan ZHENG. Hadamard single-pixel imaging versus Fourier single-pixel imaging. Optics Express, 25, 19619-19639(2017).
[15] G GIBSON, S JOHNSON, M PADGETT. Single-pixel imaging 12 years on:a review. Optics Express, 28, 28190-28207(2020).
[16] Zibang ZHANG, Shijie LIU, Junzheng PENG. Simultaneous spatial, spectral, and 3D compressive imaging via efficient Fourier single-pixel measurements. Optica, 5, 315-319(2018).
[17] Zibang ZHANG, Xiao MA, Jingang ZHONG. Single-pixel imaging by means of Fourier spectrum acquisition. Nature Communications, 6, 6225(2014).
[18] Zibang ZHANG, Jingang ZHONG. Three-dimensional single-pixel imaging with far fewer measurements than effective image pixels. Optics Letters, 41, 2497(2016).
[19] Hongzhi JIANG, Shuguang ZHU, Huijie ZHAO. Adaptive regional single-pixel imaging based on the Fourier slice theorem. Optics Express, 25, 15118-15130(2017).
[20] Zibang ZHANG, Xueying WANG, Guoan ZHENG. Fast Fourier single-pixel imaging via binary illumination. Scientific Reports, 7, 12029(2017).
[21] Zibang ZHANG, Tianao LU, Junzheng PENG. Fourier single-pixel imaging techniques and applications. Infrared and Laser Engineering, 48, 0603002(2019).
[22] M ALEMOHAMMAD, J R STROUD, B T BOSWORTH. High-speed all-optical Haar wavelet transform for real-time image compression. Optics Express, 25, 9802(2017).
[23] Zihao XU, Wen CHEN, P JOSÉ. 1000 fps computational ghost imaging using LED-based structured illumination. Optics Express, 26, 2427-2434(2018).

Set citation alerts for the article
Please enter your email address