Interfacial water molecules are the most important participants in the hydrogen evolution reaction (HER). Hence, understanding the behavior and role that interfacial water plays will ultimately reveal the HER mechanism. Unfortunately, investigating interfacial water is extremely challenging owing to the interference caused by bulk water molecules and complexity of the interfacial environment. Here, the behaviors of interfacial water in different cationic electrolytes on Pd surfaces were investigated by the electrochemistry, in situ core–shell nanostructure enhanced Raman spectroscopy and theoretical simulation techniques. Direct spectral evidence reveals a red shift in the frequency and a decrease in the intensity of interfacial water as the potential is shifted in the positively direction. When comparing the different cation electrolyte systems at a given potential, the frequency of the interfacial water peak increases in the specified order: Li+ < Na+ < K+ < Ca2+ < Sr2+. The structure of interfacial water was optimized by adjusting the radius, valence, and concentration of cation to form the two-H down structure. This unique interfacial water structure will improve the charge transfer efficiency between the water and electrode further enhancing the HER performance. Therefore, local cation tuning strategies can be used to improve the HER performance by optimizing the interfacial water structure.