To reduce the impact of insect pests on soybeans, first use the corresponding hyperspectral instrument to collect samples. The samples are divided into 4 categories: those with tiny eggs, those with larvae, those with nibbling marks, and those with entirely normal soybeans. 20 Then, a hyperspectral detection method of soybean borer based on three-dimensional image retrieval (3D-RD, 3D Resnet18 DCH) was proposed. The application of video retrieval inspires this method. Considering the analogy relationship between different frames of the video and the different layers of the hyper spectrum, the classification model trained on the large-scale video retrieval data set is used as a predictive model. Train the 3D convolution model for training. Same as the known literature method, the public spectral data set is used for formal training and fine-tuning to obtain a 3D convolutional network that can perform feature extraction. Image retrieval is used to achieve indirect classification, and the feature distance between samples is used to achieve classification in new categories. In order to be able to adapt to the task, the final classification layer of the model is turned into a commonly used hash layer for image retrieval, thereby obtaining the binary code representing the feature. This method completes the detection of soybean types in different situations and solves the problem of insufficient samples during training. In order to explore a good similarity matching loss function, this article uses a variety of newer methods to explore and finally found that the Cauchy distribution is integrated into the loss function, which can be effectively applied in this experiment. Experiments have proved that the classification accuracy of the final model is 86%±1.00%. Compared with the latest small sample method in detecting soybean borer, the 3D-RD method improves the accuracy by about 3.5%, which shows that the method is effective. The method also provides a new way of thinking for hyperspectral research.