A novel architecture for the colorless optical network unit (ONU) is proposed and experimentally demonstrated with direct-detection optical orthogonal frequency division multiplexing (DDO-OFDM). In this architecture, polarization- division multiplexing is used to reduce the cost at ONU. In optical line terminal (OLT), quadrature amplitude modulation (QAM) intensity-modulated OFDM signal with x-polarization at 10 Gbit/s is transmitted as downstream. At each ONU, the optical OFDM signal is demodulated with direct detection, and y-polarization signal is modulated for upstream on-off keying (OOK) data at 5 Gbit/s. Simulation results show that the power penalty is negligible for both optical OFDM downstream and the on-off keying upstream signals after over 50 km single-mode fiber (SMF) transmission.