• Photonics Research
  • Vol. 12, Issue 9, 1962 (2024)
Mingwang Tian1, Xin Xu1, Sihong Chen2, Zhipeng Feng3, and Yidong Tan1、*
Author Affiliations
  • 1State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
  • 2Guangdong Bright Dream Robotics Co., Ltd., Foshan 310018, China
  • 3Guangzhou Modern Information Engineering College, Guangzhou 510000, China
  • show less
    DOI: 10.1364/PRJ.523382 Cite this Article Set citation alerts
    Mingwang Tian, Xin Xu, Sihong Chen, Zhipeng Feng, Yidong Tan, "Ultrasensitive detection of remote acoustic vibrations at 300 m distance by optical feedback enhancement," Photonics Res. 12, 1962 (2024) Copy Citation Text show less

    Abstract

    Sensitive detection of remote vibrations at nanometer scale owns promising potential applications such as geological exploration, architecture, and public security. Nevertheless, how to detect remote vibration information with high sensitivity and anti-disturbance has become a major challenge. Reported current non-contact measurement methods are difficult to simultaneously possess characteristics of high light intensity sensitivity, long working distance, high vibration response sensitivity, and anti-disturbance of ambient light. Here, we propose a polarization-modulated laser frequency-shifted feedback interferometry method with the above characteristics, to obtain remote vibration information. The method can directly measure non-cooperative targets without the need for any cooperative markers. In each interference cycle, the energy as low as 2.3 photons can be effectively responded to, and the vibration amplitude sensitivity at 300 m can reach 0.72 nm/Hz1/2 at 1 kHz. This approach provides a strategy for the ultrasensitive detection of remote vibration that is immune to electromagnetic interference.

    1. INTRODUCTION

    Mechanical waves, especially sound waves, play vital roles in our everyday communications and have facilitated many advanced technologies such as sonar [1,2], seismic detection [3,4], and feature recognition[5]. And the sensitive detection of sound waves is often a fundamental and crucial part in these fields. There are currently many emerging technologies used for sensitive acoustic displacement detection, including AFM nanocantilevers [6], micro-electromechanical systems (MEMS) [7], nano-electromechanical systems (NEMS) [8], optical tweezers [9], and other technologies [10,11]. For example, by combining an AFM and an interferometer, a high displacement sensitivity of fm/Hz1/2 can be reached [12]. However, these technologies often have strict environmental requirements [10] and are difficult to detect information of remote weakly vibrating objects, which leads to some limitations in practical applications. At room temperature, Ohlinger et al. reported a technique for capturing individual gold nanoparticles with a displacement sensitivity of 3  nm/Hz1/2 by using optical tweezers [9], which can be improved to the level of fm/Hz1/2 by using a dual-beam optical tweezer in air [13]. Nevertheless, it is also difficult to use for long-distance vibration displacement detection and has relatively strict requirements for surrounding environmental conditions with complicated setups.

    In addition, voice signal, as one of the most common acoustic vibrations, is an important carrier for humans to obtain information. Therefore, the acquisition and analysis of voice signals are also of great significance in public security [14,15], audio surveillance [16], and many other fields [1720]. In most above scenes where voice acquisition is required, the large range effective working distance and concealment of the voice acquisition systems are extremely critical. However, conventional voice detection means usually using traditional voice sensors. Dinh Le et al. proposed a skin-attachable voice recognition system that can detect physiological mechanoacoustic signals directly based on the vibrations of vocal cords [21]. However, this method requires the sensor to be fitted to the human body in advance, which is not suitable for long-distance acoustic vibration monitoring. Davis et al. used only high-speed video of the target to extract the minute vibrations and recover the nearby sound [18]. Nevertheless, this method of using images to restore vibration will be greatly affected by ambient light. In addition, vibration analysis based on images requires complex algorithms, which is difficult to ensure real-time performance. Moreover, in order to obtain clear pictures, the working distance may also be limited.

    Since the above methods have limitations in long-distance detection, it is undoubtedly necessary to develop a concealed and sensitive long-distance vibration signal acquisition technology. A laser is usually used for long-distance detection because of its good directivity, and the use of lasers to obtain vibration information has also received extensive attention. Sami et al. used the lidar sensors equipped in popular commodity robot vacuum cleaners to realize the voice acquisition of the surrounding environment [22]. However, the working distance is limited to about the size of an ordinary room. In addition, the laser Doppler vibrometer (LDV) is proved to be used to detect the vibration information of non-cooperative targets at 150 m [23,24] or retroreflective tapes at 300 m [25], but there is still huge room for further improvement in the sensitivity of traditional LDVs to the weak light signals returned by long-distance non-cooperative targets. And one of the main challenges in using an LDV as a remote vibration sensor is the low signal-to-noise ratio of the reflected signals [26].

    Here, we propose a polarization-modulated laser feedback vibrometer (PLFV) for remote vibration information acquisition. Different from the traditional Mach-Zehnder LDV, in PLFV, the cavity emitting laser irradiates the measuring target; the optical signal backscattered by the target returns to the laser cavity and interferes with the intracavity light field, which modulates the light field in the cavity and makes the re-output laser loaded with external vibration information [27]. Since the feedback process occurs in the laser cavity, the external return optical signal is affected by the laser intracavity dynamic behavior while interfering with the intracavity light field. During this process, the weak return signal can be magnified up to 106 through the intracavity resonance before outputting again, which is not available in the traditional LDV. The laser cavity itself is equivalent to an amplifier of the weak light signal, and this can perfectly solve the problem of low signal-to-noise ratio in long-distance detection while retaining the advantages of coherent detection without interference from ambient light. Xu et al. successfully achieved voice signal acquisition at 200 m using a laser feedback system [28], but they did not consider the impact of the parasitic noise in the system, which results in the signal being further weakened below the intensity of the parasitic noise, making it difficult to achieve detection at longer distances.

    The parasitic noise can be understood as the light reflected from the surface of various components in the system into the laser cavity. When the signal itself is extremely weak, this part of the noise is a key factor restricting the signal-to-noise ratio of the system. In this paper, we add different polarization modulations to the parasitic noise and the optical signal of interest to make them convert into the feedback insensitive state and the sensitive state, respectively, which further improves the actual response ability of the system to weak optical signals. The vibration detection of non-cooperative targets (cartons, plastics, etc.) at 300 m is achieved, and the effective response energy of each feedback cycle is as low as 2.3 photons’ energy. The vibration amplitude detection sensitivity at 300 m reaches 0.72  nm/Hz1/2 at 1 kHz. The proposed system is prospect in remote sensitive acoustic vibration detection.

    2. PRINCIPLE AND SETUP

    The structural diagram of the proposed method for remote non-contact measurement of the vibration information is shown in Fig. 1.

    Schematic diagram of the proposed PLFV. BS, 7:3 (transmittance:reflectance) beam splitter; L1, convex lens; FR, Faraday rotator; HWP, half-wave plate; AOM1, AOM2: acoustic-optic modulators; AP, aperture; L2, concave lens; L3, convex lens; QWP, quarter-wave plate; T, target; PD, photodiode.

    Figure 1.Schematic diagram of the proposed PLFV. BS, 7:3 (transmittance:reflectance) beam splitter; L1, convex lens; FR, Faraday rotator; HWP, half-wave plate; AOM1, AOM2: acoustic-optic modulators; AP, aperture; L2, concave lens; L3, convex lens; QWP, quarter-wave plate; T, target; PD, photodiode.

    The laser source is a 1064 nm Nd:YVO4 microchip laser, whose resonator is formed by a 3mm×3mm×0.75mmNd:YVO4 crystal plate with the coating on both surfaces. The surface near the pump light is coated to be antireflective at the pump wavelength of 808 nm and highly reflective (R>99.8%) at the lasing wavelength of 1064 nm, and the output surface is coated with 5% transmittance at the wavelength of 1064 nm. The output beam is first collimated by a lens, and divided into two beams by a BS. The transmitted light passes through the Faraday rotator (FR1064-3-1.5W, LBTEK), whose polarization state is rotated by 45 deg. Next, it transmits through a half-wave plate, whose purpose is to rotate the polarization state of the laser beam to the same direction as the main axis of the acousto-optic crystal to avoid the additional influence of thermal effects on the light phase and amplitude. Then, the light passes through AOM1, AOM2 (CAFS-070/1-010-TEC-1064-AF-A17, Castech), and the lens group. Some part of the beam directly passes through the two AOMs, and is differentially frequency shifted by AOMs (the frequency shift is Ω). After being shaped by the lens group and passing through the quarter-wave plate for the second polarization state adjustment, it can further be used for long-distance transmission. The light beam is irradiated on the target to be measured at a long distance. And the backscattered light returns to the laser cavity through the original path, and is modulated again by various components on the path. It is worth pointing out that in the whole process, the total frequency shift of the light is 2Ω due to the beam going through the AOMs twice. However, there is still another part of the light returned to the laser cavity from the surface of the AOMs and the lens, which can be regarded as the parasitic noise of the system. They return to the laser cavity together with the weak light signal of interest, causing severe interference.

    The light field in the laser cavity is modulated by the light returned from the outside to reach a new stable state. The re-output laser is loaded with the vibration information of the external target, and after being reflected by the BS, it is received by the PD and converted into an electrical signal for subsequent analysis of the vibration information. Below is an explanation of how the system suppresses parasitic noise and obtains vibration information.

    The Jones matrices of the Faraday rotator, half-wave plate, and quarter-wave plate placed in the proposed PLFV as shown in Fig. 1 are T1, T2, and T3, respectively. The specific expressions are as follows: T1=12[1111],T2=12[1111],T3=12[1ii1].

    In the proposed PLFV, the parasitic light passes through the Faraday rotator and the half-wave plate twice during its round trip, while the signal light passes through the Faraday rotator, the half-wave plate, and the quarter-wave plate twice during the round trip. Since the laser source we use is horizontally polarized output (the polarization state is A=[10]), it can be regarded as a natural polarization filter matrix inside the laser cavity and the polarization filter matrix can be written as F=[1000], which means that only the return light with the same polarization state as the intracavity light can have the feedback interference and be amplified by the feedback enhancement effect. So, after considering the polarization modulation, we can get the output of the signal light carrying the vibration information of the external target as [29] ΔIsignalI=FT1T2T3T3T2T1AκG(2Ω)  cos(4πΩtφ0+Δφ)=[i0]κG(2Ω)  cos(4πΩtφ0+Δφ)κG(2Ω)  cos(4πΩtφ0+Δφπ2).

    Here, ΔIsignal represents the intensity modulation of the measurement signal, I is the steady laser output power without feedback, κ represents the effective reflection coefficient of the external cavity, and G(2Ω) is the gain caused by the laser frequency-shifted feedback effect, which traditional LDVs do not have. The gain factor G(2Ω) is jointly determined by various parameters of the laser and the frequency shift. It can be expressed as [30] G(2Ω)=2γc(η2γ2+4π2(2Ω)2)1/2(4η2γ2π2(2Ω)2+(4π2fRO24π2(2Ω)2)2)1/2,where γc is the decay rate of the photon inside the cavity, η is the relative pump level (the ratio of actual pump power to threshold pump power), γ is the decay rate of the population inversion, and fRO is the relaxation oscillation frequency of the laser.

    According to Eq. (3) it can be known that the nearer the frequency shift 2Ω is to the relaxation oscillation frequency fRO, the larger the gain factor G(2Ω) is, which can be understood as resonance enhancement between the two frequencies. However, when the two frequencies are too close, the laser will be in chaotic status, which cannot be applied for measurement. Therefore, the frequency shift 2Ω should be appropriately selected so that it can obtain sufficient gain, and the laser will not enter chaos due to excessive resonance, making it impossible to measure. In the experiment, we use a Nd:YVO4 laser, whose relaxation oscillation frequency fRO is 2.7 MHz. Based on the above principles, we choose a frequency shift of 4 MHz, which is moderate to the fRO. In addition, the other parameters of the Nd:YVO4 laser are γ1.11×104  s1, γc2.75×1010  s1, and η=3. By inputting all parameters into Eq. (3) we can obtain that the value of the gain factor G(2Ω) is 4020. φ0 in Eq. (2) is the initial fixed phase, and Δφ is the phase change in the external cavity. The relationship between Δφ and the change of the external cavity length ΔL can be obtained by Eq. (4): Δφ=4πλnΔL,where λ is the laser wavelength, and n is the air refractive index. By obtaining the phase change Δφ, we can get the external cavity length change ΔL caused by the vibration of the surface of the target, and then restore the vibration information. Furthermore, if the vibration of the target is caused by the sound pressure, we can also restore the voice information through appropriate reconstruction algorithms.

    At the same time, the demodulation result of the parasitic light in the system is ΔInoiseI=FT1T2T2T1AκG(2Ω)  cos(4πΩtφ0+Δφ)=[00]κG(2Ω)  cos(4πΩtφ0+Δφ)0.

    Through Eqs. (2) and (5) it can be found that the parasitic light is transformed into a feedback-insensitive state after polarization modulation, enabling the suppression of parasitic noise output to zero, while the signal light remains in a feedback-sensitive state, which can be amplified by the feedback effect and then output. Therefore, after eliminating the influence of the parasitic noise, even if the returned optical signal is extremely weak, the system can still have enough signal-to-noise ratio to demodulate the vibration information. Next, we conduct a series of experiments to test the ability of the proposed PLFV to acquire and demodulate remote vibration signals.

    3. PERFORMANCE TEST AND RESULTS

    A. Prototype System

    In order to verify the feasibility and effectiveness of the proposed system, the PLFV is placed in a corridor with a length of 80 m. The light emitted by the PLFV is folded three times by the reflective mirror, and finally irradiates on the carton about 300 m away from the PLFV, as shown in Fig. 2.

    Physical device for the remote vibration measurement experiment. (a) Diagram of the PLFV, the mirrors used to turn the light path, and the target (a common carton) in the corridor, and inside the red frame is the overall schematic diagram of this long-distance vibration measurement experiment. (b), (c) Diagram of mirrors 1–3 used to turn the light path, which makes distance from the target to the PLFV reach 300 m. (d) Diagram of the target.

    Figure 2.Physical device for the remote vibration measurement experiment. (a) Diagram of the PLFV, the mirrors used to turn the light path, and the target (a common carton) in the corridor, and inside the red frame is the overall schematic diagram of this long-distance vibration measurement experiment. (b), (c) Diagram of mirrors 1–3 used to turn the light path, which makes distance from the target to the PLFV reach 300 m. (d) Diagram of the target.

    When the PLFV is ready, a Bluetooth speaker is placed about 30 cm away from the carton. The speaker plays sound to vibrate the surface of the carton. The vibration changes the phase of the laser. After backscattering, the light returns to the PLFV, and is amplified by the feedback process.

    First, we obtain the signal-to-noise ratio of the target at 300 m by observing the frequency spectral information output by the laser. The result is shown in Fig. 3 where the signal-to-noise ratio can reach about 28 dB, ensuring effective acquisition and demodulation of vibration information for the next steps.

    Result of the signal spectrum for the target (a carton).

    Figure 3.Result of the signal spectrum for the target (a carton).

    When the distance between the target and the PLFV is about 300 m, we can obtain the light energy Er received by the PLFV returned from the target in each feedback modulation cycle by the following equation [28]: Er=P0η2ΩrT/Ω0.

    Here, P0=15  mW is the laser output power, η=ηBSηAOMsηlens3ηWP2ηFR is the one-way light transmittance of the PLFV, and each element’s transmittance is listed in Table 1. Since the laser beam passes through the system twice, the total transmittance is η2. Ωr=Ar/L2 is the system’s entrance pupil angle, and Ar=πr02 is the system’s receiving aperture area. r0=10  mm is the outputting spot radius of the PLFV. L=300  m is the distance between the target and the PLFV. T=1/f is the feedback modulation cycle, and f=4  MHz is the modulation frequency. Ω0=π is the backscattering angle of the target (assuming that it is scattered by full-angle).

    Transmittance of Each Element of the PLFV

    ParameterValue
    Transmittance of the BS ηBS0.7
    Transmittance of the two AOMs ηAOMs0.49
    Transmittance of one lens ηlens0.995
    Transmittance of one wave-plate ηWP0.995
    Transmittance of the Faraday rotator ηFR0.97
    One-way laser transmittance of the PLFV η0.37

    Substituting all the parameters, we can obtain Er=4.4×1019  J, which is equivalent to 2.3 photons’ energy per feedback modulation cycle. The ability to respond to such low returned light power is due to the effective suppression of the parasitic noise, so that the ultraweak signals of interest can be effectively amplified by the feedback enhancement effect, allowing remote vibration information to still be captured. The performance of the proposed PLFV is then fully tested via measuring its vibration frequency detection accuracy, vibration response sensitivity, support range for detection angle, anti-interference, and accuracy of frequency response to different non-cooperative targets at 300 m.

    B. Vibration Frequency Detection Accuracy

    The vibration frequency detection accuracy describes the accuracy of the PLFV to restore the frequency of the target’s vibration. We use the speaker to play the standard scale from 250 Hz to 3000 Hz with an interval of 250 Hz, and the vibration duration of each frequency is 1 s to make the carton vibrate; meanwhile, the PLFV captures these vibration frequencies and restores them. In addition, since the sound played through the speaker slightly deviates from the set value, we use a commercial sensor (GRAS 46AZ) near the speaker to directly collect and restore the sound, and use it as the corresponding standard frequency to be compared with the frequency obtained by the PLFV. The restoration result is shown in Fig. 4.

    Frequency accuracy test result. (a) Recovered spectrogram of the frequencies at 300 m. (b) Comparison between the measured frequency and the standard frequency. (c) Physical image of the target.

    Figure 4.Frequency accuracy test result. (a) Recovered spectrogram of the frequencies at 300 m. (b) Comparison between the measured frequency and the standard frequency. (c) Physical image of the target.

    Figure 4(a) shows the spectrogram obtained by short-time Fourier transformation of the frequency information collected by the PLFV. The frequency changing with time (each frequency lasts for 1 s) can be seen from the figure. Figure 4(b) shows the results of the comparison between the frequency measured by the PLFV and the standard frequency. For all tested frequencies, the deviation between the measurement results and the standard frequency is at most 0.05%, which appears at 2 kHz.

    C. Vibration Amplitude Response Sensitivity

    The vibration amplitude response sensitivity describes the system’s ability to detect the smallest vibration amplitudes. A carton is placed at 300 m away from the PLFV and keeps still for detecting the displacement noise spectral density (NSD). The NSD is a widely used method in precision metrology to evaluate system sensitivity (such as in gravitational wave detection [31,32]). It can intuitively reflect the noise limit of the system at different frequencies, which is quite suitable for evaluating the minimum vibration amplitude that the PLFV can detect at different frequencies. In terms of specific calculation method, we first measure the displacement obtained by the PLFV when the target is stationary (because vibration is essentially a periodic displacement change). At this time, the target does not vibrate, and the obtained displacement can be regarded as the noise synthesis of the PLFV. Then we perform autocorrelation on the measured displacement, making Fourier transform and square root operations to the result obtain the NSD calculation result, which is the commonly used NSD calculation method [33]. The NSD result based on 120 s displacement drift is given in Fig. 5 to find the PLFV vibration amplitude sensitivity limit. The results show that at a working distance of 300 m, the spectrum density of vibration amplitude can reach up to 0.72  nm/Hz1/2 at 1 kHz.

    Result of vibration amplitude response sensitivity. The y-axis and x-axis here represent the displacement noise spectral density and the detected frequency, respectively.

    Figure 5.Result of vibration amplitude response sensitivity. The y-axis and x-axis here represent the displacement noise spectral density and the detected frequency, respectively.

    D. Supporting Range for Detection Angle

    When acquiring remote acoustic vibration information through a non-cooperative target, it is impossible to ensure that the light beam can vertically irradiate on the target surface every time, and the signal quality will decrease to a certain extent during oblique incidence. Therefore, it is necessary to study the ability of the PLFV to accurately recover the vibration frequency under different light incident angles. The standard frequencies from 250 to 3000 Hz at an interval of 250 Hz are used to excite the carton 300 m away from the PLFV to vibrate at different incident angles; then, the PLFV obtains the corresponding frequency information. The detection schematic diagram and results are shown in Fig. 6.

    Test diagram and results at different incident angles. (a) Schematic diagram of testing at different incident angles at 300 m. (b) Recovered spectrogram of the frequencies under 30 deg incidence condition. (c) Comparison between the measured frequency and the standard frequency under 30 deg incidence condition. (d) Recovered spectrogram of the frequencies under 45 deg incidence condition. (e) Comparison between the measured frequency and the standard frequency under 45 deg incidence condition.

    Figure 6.Test diagram and results at different incident angles. (a) Schematic diagram of testing at different incident angles at 300 m. (b) Recovered spectrogram of the frequencies under 30 deg incidence condition. (c) Comparison between the measured frequency and the standard frequency under 30 deg incidence condition. (d) Recovered spectrogram of the frequencies under 45 deg incidence condition. (e) Comparison between the measured frequency and the standard frequency under 45 deg incidence condition.

    Figure 6(a) shows the test schematic diagram under different incident angles. It should be pointed out that in actual testing, we rotate the target by 30 deg and 45 deg, instead of rotating the beam direction. Figures 6(b) and 6(d) show the spectrograms of frequencies recovered by PLFV at 30 deg and 45 deg incidence angles, respectively. It can be seen that each frequency appears at the correct time. Figures 6(c) and 6(e) show the results of the comparison between the frequencies measured by PLFV and the standard frequencies at 30 deg and 45 deg incidence angles. And the corresponding maximum frequency deviation ratios are 0.0761% and 0.0896% under the conditions of incident angles of 30 deg and 45 deg, respectively. The test results show that the PLFV has an accurate response to the vibration of the carton at 300 m within the range of 45 deg incident angle.

    E. Anti-interference Test

    In the actual long-distance vibration measurement applications, due to the very long distance from the target to the PLFV, there may be various complex disturbances, such as wind interference on the optical propagation path, so, we test the PLFV’s ability to detect the standard vibration frequencies in the presence of wind. The test schematic diagram and test results are shown in Fig. 7.

    Schematic diagram of anti-wind interference test and test result of the PLFV. (a) Schematic diagram of test principle. (b) The recovered spectrogram of the frequencies in the presence of wind disturbances.

    Figure 7.Schematic diagram of anti-wind interference test and test result of the PLFV. (a) Schematic diagram of test principle. (b) The recovered spectrogram of the frequencies in the presence of wind disturbances.

    Figure 7(a) shows the testing method. An ordinary electric fan is placed perpendicular to the direction of beam propagation and used to generate wind interference. In this case, the PLFV detects a series of standard vibration frequencies of a carton 300 m away. The restored spectrogram result is shown in Fig. 7(b). It can be seen that in the presence of wind interference, a wide range of noise points appears mainly below 1 kHz, which corresponds to wind disturbance. However, at this time, the tested frequencies below 1 kHz can still be distinguished, and their signal-to-noise ratio in the spectrogram can reach 25 dB. This indicates that even with the introduction of wind interference, the long-distance vibration frequency can still be detected for the PLFV. In the future, by introducing wind speed sensors or reference light to record real-time wind interference and subtracting it from the final result, we can obtain a purer vibration signal, further improving the anti-interference ability of the PLFV.

    F. Accuracy of Frequency Response to Different Non-cooperative Targets

    The accuracy of the frequency response to different non-cooperative targets describes the effectiveness and response consistency of the PLFV for different target scenarios. Here, we use two common plastic materials, polycarbonate (PC) and polyethylene terephthalate (PET), as the test targets. We use the same standard excitation audio as above to stimulate these two types of targets, and obtain the corresponding demodulation spectrogram and the comparison result between the measured frequency and the standard frequency. The detection results are shown in Fig. 8.

    Frequency accuracy test results of different targets and the targets’ physical images. (a) Recovered spectrogram of the frequencies of the PC plastic. (b) Comparison between the measured frequency and the standard frequency of the PC plastic. (c) Physical image of the PC plastic box. (d) Recovered spectrogram of the frequencies of the PET plastic. (e) Comparison between the measured frequency and the standard frequency of the PET plastic. (f) Physical image of the PET plastic bottle.

    Figure 8.Frequency accuracy test results of different targets and the targets’ physical images. (a) Recovered spectrogram of the frequencies of the PC plastic. (b) Comparison between the measured frequency and the standard frequency of the PC plastic. (c) Physical image of the PC plastic box. (d) Recovered spectrogram of the frequencies of the PET plastic. (e) Comparison between the measured frequency and the standard frequency of the PET plastic. (f) Physical image of the PET plastic bottle.

    Both spectrograms in Figs. 8(a) and 8(d) show a series of clear frequency steps, and the comparison results between the measured frequency and the standard frequency are also shown in Figs. 8(b) and 8(e). According to the comparison results, we get that for the PC plastics and PET plastics, the maximum deviation ratios between the measured frequency and the standard frequency are 0.0669% and 0.1%, respectively. The above measurement results show that for the PC and PET two different targets, the PLFV can accurately respond to their vibration frequencies.

    G. Reconstruction of Remote Complex Voice Signals

    The voice signal is also generated by the vibration of the object. The sound wave as the excitation source can cause small vibration of the objects nearby. Meanwhile, the PLFV can accurately obtain this complex vibration information. Below we will show the complex voice reconstruction ability of the PLFV at remote working distances.

    We place the carton away from the PLFV, and place a Bluetooth speaker about 30 cm near the carton. The voice content played by the speaker is “Is this your handbag?” When the carton vibrates, the PLFV captures these weak vibrations. After a series of voice recovery algorithms such as band-pass filtering, the content of the voice signal is finally restored and output. Figure 9 shows the corresponding voice reconstruction spectrograms when the carton is 80 m, 240 m, and 300 m away from the PLFV.

    Corresponding spectrograms of the demodulated voice signals obtained from an ordinary carton at distances of (a) 80 m, (b) 240 m, and (c) 300 m.

    Figure 9.Corresponding spectrograms of the demodulated voice signals obtained from an ordinary carton at distances of (a) 80 m, (b) 240 m, and (c) 300 m.

    We directly input all recovered audio files into a mature audio-text conversion website (NetEase Jianwai). If the audio information can be correctly recognized, it is considered that the obtained voice information is valid. It should be pointed out that we do not conduct any pre-training throughout the entire recognition process. The recognition results under three different distances are shown in Table 2.

    Recognition Results under Three Different Distances

    DistanceRecognition Results
    80 mIs this your handbag?
    240 mIs this your handbag?
    300 mIs this your handbag?

    From the results in the Table 2, it can be seen that the audio recovered by the PLFV can be effectively recognized. This indicates that the proposed system has the ability to capture and restore the remote vibration information (eavesdropping). We have compared the detection distances achievable by current eavesdropping technologies and the proposed method, and the result is shown in Table 3.

    Comparison of the Current Methods for Eavesdropping

    Eavesdropping PrincipleEavesdropping Distance
    Video [18]4 m
    Laser LiDAR [22]2.5 m
    Laser Doppler vibrometer [24]150 m
    Millimeter wave radar [34]1.83 m
    Electro-optical sensor [35]25 m
    Power indicator LED [36]35 m
    This paper (PLFV)300 m

    It should be noted that the listed parameters are based on the experimental results of the proposed method and do not equal the performance limits of the listed sensors. Moreover, the eavesdropping distance refers to the distance between the eavesdropping device and the target being eavesdropped on. From the comparison results, it can be seen that the proposed method has advantages over other methods in terms of eavesdropping distance.

    H. Results Analysis

    In Sections 3.B3.F, we conduct tests on the recovery of a target’s vibration frequency by the PLFV under different conditions, including different incident angles and materials. We provide the comparison results between the measured values and the standard values, by giving the corresponding measured vibration frequency value at each standard value, as shown in Fig. 4(b), Fig. 6(c), Fig. 6(e), Fig. 8(b), and Fig. 8(e). Next, by calculating deviation results for the corresponding measured value at each standard acoustic vibration frequency, we can obtain the vibration frequency measurement errors at different frequencies, which can be further used to evaluate the ability of the PLFV in acoustic vibration measurement. The results are shown in Figs. 10 and 11.

    Errors between measured frequency values and standard acoustic vibration frequency values at different light incidence angles (target as a carton at a distance of 300 m). The y-axis and x-axis represent the deviation value and the standard frequency value, respectively. (a) 0 deg. (b) 30 deg. (c) 45 deg.

    Figure 10.Errors between measured frequency values and standard acoustic vibration frequency values at different light incidence angles (target as a carton at a distance of 300 m). The y-axis and x-axis represent the deviation value and the standard frequency value, respectively. (a) 0 deg. (b) 30 deg. (c) 45 deg.

    Errors between measured frequency values and standard acoustic vibration frequency values for targets with different materials (PC plastic and PET plastic). The y-axis and x-axis represent the deviation value and the standard frequency value, respectively. (a) PC plastic. (b) PET plastic.

    Figure 11.Errors between measured frequency values and standard acoustic vibration frequency values for targets with different materials (PC plastic and PET plastic). The y-axis and x-axis represent the deviation value and the standard frequency value, respectively. (a) PC plastic. (b) PET plastic.

    Figures 10 and 11 show the errors between the measured vibration frequency values of the PLFV and the standard acoustic vibration frequency values at different incident angles and materials, respectively. We can calculate the maximum deviation rates [(deviation/standard value) × 100%] of the measured values and standard values. For the same target (carton), the maximum deviation rates are 0.05%, 0.0761%, and 0.0896% at 0 deg, 30 deg, and 45 deg, respectively. For PC plastic and PET plastic, the maximum deviation rates are 0.0669% and 0.1%, respectively. Overall, compared to the values measured by the standard acoustic vibration sensor, the vibration frequency measured deviation of the PLFV does not exceed 0.1%.

    In the above tests, the PLFVs all work in an ordinary corridor environment, where the temperature is close to the room temperature. And from the test results, it can be concluded that PLFV has the ability of remote vibration measurement and voice recovery. In the future, by optimizing the light source structure to obtain better frequency stability, or by adding a reference light to obtain the phase shift in long-distance transmission to compensate for the test results, we can further improve the response sensitivity of vibration displacement.

    4. CONCLUSION

    In conclusion, the PLFV displayed for non-contact detection of acoustic vibration is free from electromagnetic interference, and can work at room temperature, which can be applied in aerospace, industrial quality inspection, and many other engineering technologies and frontier exploration fields. The PLFV has a single photon level intensity sensitivity, its detection distance can reach 300 m, and the vibration response sensitivity of a non-cooperative target at 300 m can reach 0.72  nm/Hz1/2 at 1 kHz. With the above characteristics, it provides a very promising method for long-distance and highly sensitive vibration detection.

    References

    [1] W. Chen, J. Xu, X. Zhao. Separated sonar localization system for indoor robot navigation. IEEE Trans. Ind. Electron., 68, 6042-6052(2021).

    [2] D. P. Williams. The Mondrian detection algorithm for sonar imagery. IEEE Trans. Geosci. Remote Sens., 56, 1091-1102(2018).

    [3] M. Zhao, Y. Qi, H. Wang. Optical interferometric MEMS accelerometers. Laser Photon. Rev., 18, 2300713(2023).

    [4] F. Walter, D. Gräff, F. Lindner. Distributed acoustic sensing of microseismic sources and wave propagation in glaciated terrain. Nat. Commun., 11, 2436(2020).

    [5] R. Ebert, P. Lutzmann, M. Hebel. Applications for remote laser vibration sensing. PhotonicsGlobal@Singapore, 1-5(2008).

    [6] V. Puller, B. Lounis, F. Pistolesi. Single molecule detection of nanomechanical motion. Phys. Rev. Lett., 110, 125501(2013).

    [7] J. D. Teufel, T. Donner, D. Li. Sideband cooling of micromechanical motion to the quantum ground state. Nature, 475, 359-363(2011).

    [8] X. M. Henry Huang, C. A. Zorman, M. Mehregany. Nanodevice motion at microwave frequencies. Nature, 421, 496-496(2003).

    [9] A. Ohlinger, A. Deak, A. A. Lutich. Optically trapped gold nanoparticle enables listening at the microscale. Phys. Rev. Lett., 108, 018101(2012).

    [10] M. Xie, H. Liu, S. Wan. Ultrasensitive detection of local acoustic vibrations at room temperature by plasmon-enhanced single-molecule fluorescence. Nat. Commun., 13, 3330(2022).

    [11] Y. Tian, P. Navarro, M. Orrit. Single molecule as a local acoustic detector for mechanical oscillators. Phys. Rev. Lett., 113, 135505(2014).

    [12] H. I. Rasool, P. R. Wilkinson, A. Z. Stieg. A low noise all-fiber interferometer for high resolution frequency modulated atomic force microscopy imaging in liquids. Rev. Sci. Instrum., 81, 023703(2010).

    [13] T. Li, S. Kheifets, D. Medellin. Measurement of the instantaneous velocity of a Brownian particle. Science, 328, 1673-1675(2010).

    [14] C. Zieger, A. Brutti, P. Svaizer. Acoustic based surveillance system for intrusion detection. 6th IEEE International Conference on Advanced Video and Signal Based Surveillance, 314-319(2009).

    [15] M. Sammarco, M. Detyniecki. Car accident detection and reconstruction through sound analysis with Crashzam. Smart Cities, Green Technologies and Intelligent Transport Systems, 159-180(2018).

    [16] Y. Zhang, G. Laput, C. Harrison. Vibrosight: long-range vibrometry for smart environment sensing. 31st Annual ACM Symposium on User Interface Software and Technology, 225-236(2018).

    [17] G. Wang, Z. Pang, B. Zhang. Time shifting deviation method enhanced laser interferometry: ultrahigh precision localizing of traffic vibration using an urban fiber link. Photon. Res., 10, 433-443(2022).

    [18] A. Davis, M. Rubinstein, N. Wadhwa. The visual microphone: passive recovery of sound from video. ACM Trans. Graph., 33, 79(2014).

    [19] R. Peng, B. Xu, G. Li. Long-range speech acquirement and enhancement with dual-point laser Doppler vibrometers. IEEE 23rd International Conference on Digital Signal Processing (DSP), 1-5(2018).

    [20] T. Wang, Z. Zhu, A. Divakaran. Long range audio and audio-visual event detection using a laser Doppler vibrometer. Proc. SPIE, 7704, 77040J(2010).

    [21] T.-S. Dinh Le, J. An, Y. Huang. Ultrasensitive anti-interference voice recognition by bio-inspired skin-attachable self-cleaning acoustic sensors. ACS Nano, 13, 13293-13303(2019).

    [22] S. Sami, Y. Dai, S. R. X. Tan. Spying with your robot vacuum cleaner: eavesdropping via lidar sensors. 18th Conference on Embedded Networked Sensor Systems, 354-367(2020).

    [23] T. Lü, J. Guo, H.-Y. Zhang. Acquirement and enhancement of remote speech signals. Optoelectron Lett., 13, 275-278(2017).

    [24] T. Lv, H.-Y. Zhang, C.-H. Yan. Double mode surveillance system based on remote audio/video signals acquisition. Appl. Acoust., 129, 316-321(2018).

    [25] Z. Zhu, W. Li, G. Wolberg. Integrating LDV audio and IR video for remote multimodal surveillance. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05)—Workshops, 10(2005).

    [26] Y. Avargel, I. Cohen. Speech measurements using a laser Doppler vibrometer sensor: application to speech enhancement. Joint Workshop on Hands-free Speech Communication and Microphone Arrays, 109-114(2011).

    [27] S. Donati. Developing self-mixing interferometry for instrumentation and measurements. Laser Photon. Rev., 6, 393-417(2012).

    [28] Z. Xu, J. Li, S. Zhang. Remote eavesdropping at 200 meters distance based on laser feedback interferometry with single-photon sensitivity. Opt. Lasers Eng., 141, 106562(2021).

    [29] E. Lacot, R. Day, F. Stoeckel. Coherent laser detection by frequency-shifted optical feedback. Phys. Rev. A, 64, 043815(2001).

    [30] K. Zhu, H. Chen, S. Zhang. Frequency-shifted optical feedback measurement technologies using a solid-state microchip laser. Appl. Sci., 9, 109(2019).

    [31] G. Wanner. Space-based gravitational wave detection and how LISA Pathfinder successfully paved the way. Nat. Phys., 15, 200-202(2019).

    [32] Y. Gong, J. Luo, B. Wang. Concepts and status of Chinese space gravitational wave detection projects. Nat. Astron., 5, 881-889(2021).

    [33] M. Dehne, M. Tröbs, G. Heinzel. Verification of polarising optics for the LISA optical bench. Opt. Express, 20, 27273-27287(2012).

    [34] S. Basak, M. Gowda. mmSpy: spying phone calls using mmWave radars. IEEE Symposium on Security and Privacy, 1211-1228(2022).

    [35] B. Nassi, Y. Pirutin, A. Shamir. Lamphone: real-time passive sound recovery from light bulb vibrations(2020).

    [36] B. Nassi, Y. Pirutin, T. Galor. Glowworm attack: optical TEMPEST sound recovery via a device’s power indicator LED. 2021 ACM SIGSAC Conference on Computer and Communications Security, 1900-1914(2021).

    Mingwang Tian, Xin Xu, Sihong Chen, Zhipeng Feng, Yidong Tan, "Ultrasensitive detection of remote acoustic vibrations at 300 m distance by optical feedback enhancement," Photonics Res. 12, 1962 (2024)
    Download Citation