A novel terahertz modulator based on graphene is proposed and designed. The device consists of a silicon ridge covered by a graphene sheet. The transmission properties of the proposed structure demonstrate that the introduction of graphene can improve the switching and filtering performance of modulators, and enhance its field confinement capability. In the case of the number of layers, a blue shift can be observed in the center wavelength with increase of graphene layers. Meanwhile, the relationship between the number of layers and the peak of reflection spectra is an inverse proportion function. In addition, we find that the center wavelength is almost unchanged with respect to the different chemical potential, thus the effective refractive indices of the cross section of light propagation direction can be well preserved. These findings will contribute to the research and development of graphene based THz waveguide modulators.