• Infrared and Laser Engineering
  • Vol. 53, Issue 7, 20240176 (2024)
Xiaocui YUAN1,2, Yongtao WANG1, Baoling LIU1, Dibo HOU2, and Zonghui JIANG1
Author Affiliations
  • 1School of Electrical Engineering, Nanchang Institute of Technology, Nanchang 330099, China
  • 2College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China
  • show less
    DOI: 10.3788/IRLA20240176 Cite this Article
    Xiaocui YUAN, Yongtao WANG, Baoling LIU, Dibo HOU, Zonghui JIANG. Detection method for structural defects of railway clip fastener based on 3D line laser sensor[J]. Infrared and Laser Engineering, 2024, 53(7): 20240176 Copy Citation Text show less
    (a) Fastener structure of WJ-8; (b) Structure and gap of clip
    Fig. 1. (a) Fastener structure of WJ-8; (b) Structure and gap of clip
    (a) Diagram of railway fastener data acquisition system; (b) Physical image of railway fastener data acquisition system
    Fig. 2. (a) Diagram of railway fastener data acquisition system; (b) Physical image of railway fastener data acquisition system
    (a) Top view of loose fasteners; (b) Front view of loose fasteners; (c) Top view of fasteners that are too tight; (d) Front view of over tightened fasteners
    Fig. 3. (a) Top view of loose fasteners; (b) Front view of loose fasteners; (c) Top view of fasteners that are too tight; (d) Front view of over tightened fasteners
    Point cloud of railway and fastener areas
    Fig. 4. Point cloud of railway and fastener areas
    PointNet++ network architecture
    Fig. 5. PointNet++ network architecture
    (a) Fastener point cloud; (b) Labeled point cloud
    Fig. 6. (a) Fastener point cloud; (b) Labeled point cloud
    (a) Segmentation results of fastener; (b) View of clip point cloud
    Fig. 7. (a) Segmentation results of fastener; (b) View of clip point cloud
    (a) Point cloud of clip; (b) Clip image
    Fig. 8. (a) Point cloud of clip; (b) Clip image
    (a) The dilated result of clip image; (b) 2D skeleton of clip
    Fig. 9. (a) The dilated result of clip image; (b) 2D skeleton of clip
    (a) The center of the clip section; (b) The center of clip section after removing the error points
    Fig. 10. (a) The center of the clip section; (b) The center of clip section after removing the error points
    (a) Skeleton division diagram; (b) Clip gap
    Fig. 11. (a) Skeleton division diagram; (b) Clip gap
    (a)Schematic of standard step block; (b) Schematic of step block imaging; (c) Point cloud of step block; (d) Measurement error of block
    Fig. 12. (a)Schematic of standard step block; (b) Schematic of step block imaging; (c) Point cloud of step block; (d) Measurement error of block
    PointNet++ network segmentation accuracy metric graph
    Fig. 13. PointNet++ network segmentation accuracy metric graph
    (a) 0.5 mm gap gauge; (b) Clip gap equaling to 9 mm
    Fig. 14. (a) 0.5 mm gap gauge; (b) Clip gap equaling to 9 mm
    Measurement results of clip gaps under different buckle pressures
    Fig. 15. Measurement results of clip gaps under different buckle pressures
    (a) measured clip gaps with different dx; (b) 3D skeleton and gap of clip dy
    Fig. 16. (a) measured clip gaps with different dx; (b) 3D skeleton and gap of clip dy
    (a) dy=0.56 mm; (b) dy=0.84 mm; (c) dy=1.12 mm; (d) dy=1.68 mm; (e) dy=2.24 mm; (f) dy=2.8 mm
    Fig. 17. (a) dy=0.56 mm; (b) dy=0.84 mm; (c) dy=1.12 mm; (d) dy=1.68 mm; (e) dy=2.24 mm; (f) dy=2.8 mm
    (a) Rusted fastener; (b) Stained fastener; (c) Partial rusted fastener; (d) Clip gap of rusted fastener; (e) Clip gap of stained fastener; (f) Clip gap of partial rusted fastener
    Fig. 18. (a) Rusted fastener; (b) Stained fastener; (c) Partial rusted fastener; (d) Clip gap of rusted fastener; (e) Clip gap of stained fastener; (f) Clip gap of partial rusted fastener
    (a) Fasteners measured at night; (b) Clip point cloud; (c) Skeleton and gap of clip; (d) Fasteners measured at noon; (e) Clip point cloud; (f) Skeleton and gap of clip; (g) Measuring fasteners at dusk; (h) Clip point cloud; (i) Skeleton and gap of clip
    Fig. 19. (a) Fasteners measured at night; (b) Clip point cloud; (c) Skeleton and gap of clip; (d) Fasteners measured at noon; (e) Clip point cloud; (f) Skeleton and gap of clip; (g) Measuring fasteners at dusk; (h) Clip point cloud; (i) Skeleton and gap of clip
    (a) Over-tightening fastener scatter plot of clip gap value; (b) Histogram distribution of clip gap
    Fig. 20. (a) Over-tightening fastener scatter plot of clip gap value; (b) Histogram distribution of clip gap
    (a) Normal fastener scatter plot of clip gap value; (b) Histogram distribution of clip gap
    Fig. 21. (a) Normal fastener scatter plot of clip gap value; (b) Histogram distribution of clip gap
    (a) Looseness fastener scatter plot of clip gap value; (b) Histogram distribution of clip gap
    Fig. 22. (a) Looseness fastener scatter plot of clip gap value; (b) Histogram distribution of clip gap
    (a) Field measurement of WJ-8 fastener is 14.2 mm; (b) Field measurement of WJ-8 fastener is 15.2 mm; (c) Field measurement of WJ-2 fastener is 13.32 mm; (d) Field measurement of WJ-2 fastener is 15.67 mm
    Fig. 23. (a) Field measurement of WJ-8 fastener is 14.2 mm; (b) Field measurement of WJ-8 fastener is 15.2 mm; (c) Field measurement of WJ-2 fastener is 13.32 mm; (d) Field measurement of WJ-2 fastener is 15.67 mm
    ItemParameterValue
    Network trainingSample number84
    Batch size16
    Epoch251
    Learning rate0.001
    Step_size20
    Lr_decay0.5
    Number point(npoint)2 048
    Adam algorithmMomentum0.9
    Betas0.999
    Eps1e-08
    Table 1. Hyper-parameters for PointNet++ network training
    FastenerManual measurementThis paperError
    Fastener 1(WJ-2)33.12720.1272
    Fastener 2(WJ-2)33.14350.1435
    Fastener 3(WJ-8)32.9501−0.0499
    Fastener 4(WJ-7)6.96.9870.087
    Fastener 5(WJ-8)9.69.526−0.074
    Fastener 6(WJ-8)00.10.1
    Table 2. Measurement results and comparison for different fasteners
    $ \mathbf{\tau }$/mmClasses of fastenerTotalTPFNDR
    $ \tau =0 $Over-tight2001703085.0%
    $ \tau =0.1 $196498.0%
    $ \tau =0 $Normal100076223876.2%
    $ \tau =\pm 0.1 $9901099.0%
    $ \tau =0 $Looseness2302121892.2%
    $ \tau =-0.1 $2201095.7%
    Table 3. Accuracy of fastener detection under different allowable errors
    DefectAccuracyMethod
    Reference[15]Reference[18]This paper
    Over-tightenedPrecision61.4%85.8%90.8%
    Recall80.7%78.5%80.5%
    LoosenessPrecision67.2%70.5%95.2%
    Recall92.2%93.5%90.5%
    Table 4. Precision and recall of three method
    Xiaocui YUAN, Yongtao WANG, Baoling LIU, Dibo HOU, Zonghui JIANG. Detection method for structural defects of railway clip fastener based on 3D line laser sensor[J]. Infrared and Laser Engineering, 2024, 53(7): 20240176
    Download Citation