Aiming at the research requirements of multi-physical effects mechanism of devices in complex electromagnetic environment, a parallel computing program for semiconductor multi-physics effects, JEMS-CDS-Device, is developed. This paper introduces the architecture design and implementation technology of JEMS-CDS-Device. The program is based on the unstructured grid parallel framework—JAUMIN. It uses the finite volume method (FVM) to discretize and uses the Newton method to get fully coupled solution of the “electric-carrier transport-thermal” problem. The program which adopts the “kernel ＋ algorithm library” form architecture, supports 2D/3D unstructured mesh, and can solve problems of tens of millions of degrees of freedom parallelly. It supports extended development of physical effect equations, discrete algorithms, material physics models, etc.