
- Photonics Research
- Vol. 12, Issue 9, 1962 (2024)
Abstract
1. INTRODUCTION
Mechanical waves, especially sound waves, play vital roles in our everyday communications and have facilitated many advanced technologies such as sonar [1,2], seismic detection [3,4], and feature recognition[5]. And the sensitive detection of sound waves is often a fundamental and crucial part in these fields. There are currently many emerging technologies used for sensitive acoustic displacement detection, including AFM nanocantilevers [6], micro-electromechanical systems (MEMS) [7], nano-electromechanical systems (NEMS) [8], optical tweezers [9], and other technologies [10,11]. For example, by combining an AFM and an interferometer, a high displacement sensitivity of
In addition, voice signal, as one of the most common acoustic vibrations, is an important carrier for humans to obtain information. Therefore, the acquisition and analysis of voice signals are also of great significance in public security [14,15], audio surveillance [16], and many other fields [17–20]. In most above scenes where voice acquisition is required, the large range effective working distance and concealment of the voice acquisition systems are extremely critical. However, conventional voice detection means usually using traditional voice sensors. Dinh Le
Since the above methods have limitations in long-distance detection, it is undoubtedly necessary to develop a concealed and sensitive long-distance vibration signal acquisition technology. A laser is usually used for long-distance detection because of its good directivity, and the use of lasers to obtain vibration information has also received extensive attention. Sami
Sign up for Photonics Research TOC. Get the latest issue of Photonics Research delivered right to you!Sign up now
Here, we propose a polarization-modulated laser feedback vibrometer (PLFV) for remote vibration information acquisition. Different from the traditional Mach-Zehnder LDV, in PLFV, the cavity emitting laser irradiates the measuring target; the optical signal backscattered by the target returns to the laser cavity and interferes with the intracavity light field, which modulates the light field in the cavity and makes the re-output laser loaded with external vibration information [27]. Since the feedback process occurs in the laser cavity, the external return optical signal is affected by the laser intracavity dynamic behavior while interfering with the intracavity light field. During this process, the weak return signal can be magnified up to
The parasitic noise can be understood as the light reflected from the surface of various components in the system into the laser cavity. When the signal itself is extremely weak, this part of the noise is a key factor restricting the signal-to-noise ratio of the system. In this paper, we add different polarization modulations to the parasitic noise and the optical signal of interest to make them convert into the feedback insensitive state and the sensitive state, respectively, which further improves the actual response ability of the system to weak optical signals. The vibration detection of non-cooperative targets (cartons, plastics, etc.) at 300 m is achieved, and the effective response energy of each feedback cycle is as low as 2.3 photons’ energy. The vibration amplitude detection sensitivity at 300 m reaches
2. PRINCIPLE AND SETUP
The structural diagram of the proposed method for remote non-contact measurement of the vibration information is shown in Fig. 1.
Figure 1.Schematic diagram of the proposed PLFV. BS, 7:3 (transmittance:reflectance) beam splitter; L1, convex lens; FR, Faraday rotator; HWP, half-wave plate; AOM1, AOM2: acoustic-optic modulators; AP, aperture; L2, concave lens; L3, convex lens; QWP, quarter-wave plate; T, target; PD, photodiode.
The laser source is a 1064 nm
The light field in the laser cavity is modulated by the light returned from the outside to reach a new stable state. The re-output laser is loaded with the vibration information of the external target, and after being reflected by the BS, it is received by the PD and converted into an electrical signal for subsequent analysis of the vibration information. Below is an explanation of how the system suppresses parasitic noise and obtains vibration information.
The Jones matrices of the Faraday rotator, half-wave plate, and quarter-wave plate placed in the proposed PLFV as shown in Fig. 1 are
In the proposed PLFV, the parasitic light passes through the Faraday rotator and the half-wave plate twice during its round trip, while the signal light passes through the Faraday rotator, the half-wave plate, and the quarter-wave plate twice during the round trip. Since the laser source we use is horizontally polarized output (the polarization state is
Here,
According to Eq. (3) it can be known that the nearer the frequency shift
At the same time, the demodulation result of the parasitic light in the system is
Through Eqs. (2) and (5) it can be found that the parasitic light is transformed into a feedback-insensitive state after polarization modulation, enabling the suppression of parasitic noise output to zero, while the signal light remains in a feedback-sensitive state, which can be amplified by the feedback effect and then output. Therefore, after eliminating the influence of the parasitic noise, even if the returned optical signal is extremely weak, the system can still have enough signal-to-noise ratio to demodulate the vibration information. Next, we conduct a series of experiments to test the ability of the proposed PLFV to acquire and demodulate remote vibration signals.
3. PERFORMANCE TEST AND RESULTS
A. Prototype System
In order to verify the feasibility and effectiveness of the proposed system, the PLFV is placed in a corridor with a length of 80 m. The light emitted by the PLFV is folded three times by the reflective mirror, and finally irradiates on the carton about 300 m away from the PLFV, as shown in Fig. 2.
Figure 2.Physical device for the remote vibration measurement experiment. (a) Diagram of the PLFV, the mirrors used to turn the light path, and the target (a common carton) in the corridor, and inside the red frame is the overall schematic diagram of this long-distance vibration measurement experiment. (b), (c) Diagram of mirrors 1–3 used to turn the light path, which makes distance from the target to the PLFV reach 300 m. (d) Diagram of the target.
When the PLFV is ready, a Bluetooth speaker is placed about 30 cm away from the carton. The speaker plays sound to vibrate the surface of the carton. The vibration changes the phase of the laser. After backscattering, the light returns to the PLFV, and is amplified by the feedback process.
First, we obtain the signal-to-noise ratio of the target at 300 m by observing the frequency spectral information output by the laser. The result is shown in Fig. 3 where the signal-to-noise ratio can reach about 28 dB, ensuring effective acquisition and demodulation of vibration information for the next steps.
Figure 3.Result of the signal spectrum for the target (a carton).
When the distance between the target and the PLFV is about 300 m, we can obtain the light energy
Here,
Transmittance of Each Element of the PLFV
Parameter | Value |
---|---|
Transmittance of the BS | 0.7 |
Transmittance of the two AOMs | 0.49 |
Transmittance of one lens | 0.995 |
Transmittance of one wave-plate | 0.995 |
Transmittance of the Faraday rotator | 0.97 |
One-way laser transmittance of the PLFV | 0.37 |
Substituting all the parameters, we can obtain
B. Vibration Frequency Detection Accuracy
The vibration frequency detection accuracy describes the accuracy of the PLFV to restore the frequency of the target’s vibration. We use the speaker to play the standard scale from 250 Hz to 3000 Hz with an interval of 250 Hz, and the vibration duration of each frequency is 1 s to make the carton vibrate; meanwhile, the PLFV captures these vibration frequencies and restores them. In addition, since the sound played through the speaker slightly deviates from the set value, we use a commercial sensor (GRAS 46AZ) near the speaker to directly collect and restore the sound, and use it as the corresponding standard frequency to be compared with the frequency obtained by the PLFV. The restoration result is shown in Fig. 4.
Figure 4.Frequency accuracy test result. (a) Recovered spectrogram of the frequencies at 300 m. (b) Comparison between the measured frequency and the standard frequency. (c) Physical image of the target.
Figure 4(a) shows the spectrogram obtained by short-time Fourier transformation of the frequency information collected by the PLFV. The frequency changing with time (each frequency lasts for 1 s) can be seen from the figure. Figure 4(b) shows the results of the comparison between the frequency measured by the PLFV and the standard frequency. For all tested frequencies, the deviation between the measurement results and the standard frequency is at most 0.05%, which appears at 2 kHz.
C. Vibration Amplitude Response Sensitivity
The vibration amplitude response sensitivity describes the system’s ability to detect the smallest vibration amplitudes. A carton is placed at 300 m away from the PLFV and keeps still for detecting the displacement noise spectral density (NSD). The NSD is a widely used method in precision metrology to evaluate system sensitivity (such as in gravitational wave detection [31,32]). It can intuitively reflect the noise limit of the system at different frequencies, which is quite suitable for evaluating the minimum vibration amplitude that the PLFV can detect at different frequencies. In terms of specific calculation method, we first measure the displacement obtained by the PLFV when the target is stationary (because vibration is essentially a periodic displacement change). At this time, the target does not vibrate, and the obtained displacement can be regarded as the noise synthesis of the PLFV. Then we perform autocorrelation on the measured displacement, making Fourier transform and square root operations to the result obtain the NSD calculation result, which is the commonly used NSD calculation method [33]. The NSD result based on 120 s displacement drift is given in Fig. 5 to find the PLFV vibration amplitude sensitivity limit. The results show that at a working distance of 300 m, the spectrum density of vibration amplitude can reach up to
Figure 5.Result of vibration amplitude response sensitivity. The
D. Supporting Range for Detection Angle
When acquiring remote acoustic vibration information through a non-cooperative target, it is impossible to ensure that the light beam can vertically irradiate on the target surface every time, and the signal quality will decrease to a certain extent during oblique incidence. Therefore, it is necessary to study the ability of the PLFV to accurately recover the vibration frequency under different light incident angles. The standard frequencies from 250 to 3000 Hz at an interval of 250 Hz are used to excite the carton 300 m away from the PLFV to vibrate at different incident angles; then, the PLFV obtains the corresponding frequency information. The detection schematic diagram and results are shown in Fig. 6.
Figure 6.Test diagram and results at different incident angles. (a) Schematic diagram of testing at different incident angles at 300 m. (b) Recovered spectrogram of the frequencies under 30 deg incidence condition. (c) Comparison between the measured frequency and the standard frequency under 30 deg incidence condition. (d) Recovered spectrogram of the frequencies under 45 deg incidence condition. (e) Comparison between the measured frequency and the standard frequency under 45 deg incidence condition.
Figure 6(a) shows the test schematic diagram under different incident angles. It should be pointed out that in actual testing, we rotate the target by 30 deg and 45 deg, instead of rotating the beam direction. Figures 6(b) and 6(d) show the spectrograms of frequencies recovered by PLFV at 30 deg and 45 deg incidence angles, respectively. It can be seen that each frequency appears at the correct time. Figures 6(c) and 6(e) show the results of the comparison between the frequencies measured by PLFV and the standard frequencies at 30 deg and 45 deg incidence angles. And the corresponding maximum frequency deviation ratios are 0.0761% and 0.0896% under the conditions of incident angles of 30 deg and 45 deg, respectively. The test results show that the PLFV has an accurate response to the vibration of the carton at 300 m within the range of 45 deg incident angle.
E. Anti-interference Test
In the actual long-distance vibration measurement applications, due to the very long distance from the target to the PLFV, there may be various complex disturbances, such as wind interference on the optical propagation path, so, we test the PLFV’s ability to detect the standard vibration frequencies in the presence of wind. The test schematic diagram and test results are shown in Fig. 7.
Figure 7.Schematic diagram of anti-wind interference test and test result of the PLFV. (a) Schematic diagram of test principle. (b) The recovered spectrogram of the frequencies in the presence of wind disturbances.
Figure 7(a) shows the testing method. An ordinary electric fan is placed perpendicular to the direction of beam propagation and used to generate wind interference. In this case, the PLFV detects a series of standard vibration frequencies of a carton 300 m away. The restored spectrogram result is shown in Fig. 7(b). It can be seen that in the presence of wind interference, a wide range of noise points appears mainly below 1 kHz, which corresponds to wind disturbance. However, at this time, the tested frequencies below 1 kHz can still be distinguished, and their signal-to-noise ratio in the spectrogram can reach 25 dB. This indicates that even with the introduction of wind interference, the long-distance vibration frequency can still be detected for the PLFV. In the future, by introducing wind speed sensors or reference light to record real-time wind interference and subtracting it from the final result, we can obtain a purer vibration signal, further improving the anti-interference ability of the PLFV.
F. Accuracy of Frequency Response to Different Non-cooperative Targets
The accuracy of the frequency response to different non-cooperative targets describes the effectiveness and response consistency of the PLFV for different target scenarios. Here, we use two common plastic materials, polycarbonate (PC) and polyethylene terephthalate (PET), as the test targets. We use the same standard excitation audio as above to stimulate these two types of targets, and obtain the corresponding demodulation spectrogram and the comparison result between the measured frequency and the standard frequency. The detection results are shown in Fig. 8.
Figure 8.Frequency accuracy test results of different targets and the targets’ physical images. (a) Recovered spectrogram of the frequencies of the PC plastic. (b) Comparison between the measured frequency and the standard frequency of the PC plastic. (c) Physical image of the PC plastic box. (d) Recovered spectrogram of the frequencies of the PET plastic. (e) Comparison between the measured frequency and the standard frequency of the PET plastic. (f) Physical image of the PET plastic bottle.
Both spectrograms in Figs. 8(a) and 8(d) show a series of clear frequency steps, and the comparison results between the measured frequency and the standard frequency are also shown in Figs. 8(b) and 8(e). According to the comparison results, we get that for the PC plastics and PET plastics, the maximum deviation ratios between the measured frequency and the standard frequency are 0.0669% and 0.1%, respectively. The above measurement results show that for the PC and PET two different targets, the PLFV can accurately respond to their vibration frequencies.
G. Reconstruction of Remote Complex Voice Signals
The voice signal is also generated by the vibration of the object. The sound wave as the excitation source can cause small vibration of the objects nearby. Meanwhile, the PLFV can accurately obtain this complex vibration information. Below we will show the complex voice reconstruction ability of the PLFV at remote working distances.
We place the carton away from the PLFV, and place a Bluetooth speaker about 30 cm near the carton. The voice content played by the speaker is “Is this your handbag?” When the carton vibrates, the PLFV captures these weak vibrations. After a series of voice recovery algorithms such as band-pass filtering, the content of the voice signal is finally restored and output. Figure 9 shows the corresponding voice reconstruction spectrograms when the carton is 80 m, 240 m, and 300 m away from the PLFV.
Figure 9.Corresponding spectrograms of the demodulated voice signals obtained from an ordinary carton at distances of (a) 80 m, (b) 240 m, and (c) 300 m.
We directly input all recovered audio files into a mature audio-text conversion website (NetEase Jianwai). If the audio information can be correctly recognized, it is considered that the obtained voice information is valid. It should be pointed out that we do not conduct any pre-training throughout the entire recognition process. The recognition results under three different distances are shown in Table 2.
Recognition Results under Three Different Distances
Distance | Recognition Results |
---|---|
80 m | Is this your handbag? |
240 m | Is this your handbag? |
300 m | Is this your handbag? |
From the results in the Table 2, it can be seen that the audio recovered by the PLFV can be effectively recognized. This indicates that the proposed system has the ability to capture and restore the remote vibration information (eavesdropping). We have compared the detection distances achievable by current eavesdropping technologies and the proposed method, and the result is shown in Table 3.
Comparison of the Current Methods for Eavesdropping
Eavesdropping Principle | Eavesdropping Distance |
---|---|
Video [ | 4 m |
Laser LiDAR [ | 2.5 m |
Laser Doppler vibrometer [ | 150 m |
Millimeter wave radar [ | 1.83 m |
Electro-optical sensor [ | 25 m |
Power indicator LED [ | 35 m |
It should be noted that the listed parameters are based on the experimental results of the proposed method and do not equal the performance limits of the listed sensors. Moreover, the eavesdropping distance refers to the distance between the eavesdropping device and the target being eavesdropped on. From the comparison results, it can be seen that the proposed method has advantages over other methods in terms of eavesdropping distance.
H. Results Analysis
In Sections 3.B–3.F, we conduct tests on the recovery of a target’s vibration frequency by the PLFV under different conditions, including different incident angles and materials. We provide the comparison results between the measured values and the standard values, by giving the corresponding measured vibration frequency value at each standard value, as shown in Fig. 4(b), Fig. 6(c), Fig. 6(e), Fig. 8(b), and Fig. 8(e). Next, by calculating deviation results for the corresponding measured value at each standard acoustic vibration frequency, we can obtain the vibration frequency measurement errors at different frequencies, which can be further used to evaluate the ability of the PLFV in acoustic vibration measurement. The results are shown in Figs. 10 and 11.
Figure 10.Errors between measured frequency values and standard acoustic vibration frequency values at different light incidence angles (target as a carton at a distance of 300 m). The
Figure 11.Errors between measured frequency values and standard acoustic vibration frequency values for targets with different materials (PC plastic and PET plastic). The
Figures 10 and 11 show the errors between the measured vibration frequency values of the PLFV and the standard acoustic vibration frequency values at different incident angles and materials, respectively. We can calculate the maximum deviation rates [(deviation/standard value)
In the above tests, the PLFVs all work in an ordinary corridor environment, where the temperature is close to the room temperature. And from the test results, it can be concluded that PLFV has the ability of remote vibration measurement and voice recovery. In the future, by optimizing the light source structure to obtain better frequency stability, or by adding a reference light to obtain the phase shift in long-distance transmission to compensate for the test results, we can further improve the response sensitivity of vibration displacement.
4. CONCLUSION
In conclusion, the PLFV displayed for non-contact detection of acoustic vibration is free from electromagnetic interference, and can work at room temperature, which can be applied in aerospace, industrial quality inspection, and many other engineering technologies and frontier exploration fields. The PLFV has a single photon level intensity sensitivity, its detection distance can reach 300 m, and the vibration response sensitivity of a non-cooperative target at 300 m can reach
References
[5] R. Ebert, P. Lutzmann, M. Hebel. Applications for remote laser vibration sensing. PhotonicsGlobal@Singapore, 1-5(2008).
[14] C. Zieger, A. Brutti, P. Svaizer. Acoustic based surveillance system for intrusion detection. 6th IEEE International Conference on Advanced Video and Signal Based Surveillance, 314-319(2009).
[15] M. Sammarco, M. Detyniecki. Car accident detection and reconstruction through sound analysis with Crashzam. Smart Cities, Green Technologies and Intelligent Transport Systems, 159-180(2018).
[16] Y. Zhang, G. Laput, C. Harrison. Vibrosight: long-range vibrometry for smart environment sensing. 31st Annual ACM Symposium on User Interface Software and Technology, 225-236(2018).
[19] R. Peng, B. Xu, G. Li. Long-range speech acquirement and enhancement with dual-point laser Doppler vibrometers. IEEE 23rd International Conference on Digital Signal Processing (DSP), 1-5(2018).
[22] S. Sami, Y. Dai, S. R. X. Tan. Spying with your robot vacuum cleaner: eavesdropping via lidar sensors. 18th Conference on Embedded Networked Sensor Systems, 354-367(2020).
[25] Z. Zhu, W. Li, G. Wolberg. Integrating LDV audio and IR video for remote multimodal surveillance. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05)—Workshops, 10(2005).
[26] Y. Avargel, I. Cohen. Speech measurements using a laser Doppler vibrometer sensor: application to speech enhancement. Joint Workshop on Hands-free Speech Communication and Microphone Arrays, 109-114(2011).
[34] S. Basak, M. Gowda. mmSpy: spying phone calls using mmWave radars. IEEE Symposium on Security and Privacy, 1211-1228(2022).
[36] B. Nassi, Y. Pirutin, T. Galor. Glowworm attack: optical TEMPEST sound recovery via a device’s power indicator LED. 2021 ACM SIGSAC Conference on Computer and Communications Security, 1900-1914(2021).

Set citation alerts for the article
Please enter your email address