Numerical techniques have increasingly been used to model fluid–particle two-phase flows. Coupling the immersed boundary method (IBM) and discrete element method (DEM) is one promising approach for modeling particulate flows. In this study, IBM was coupled with DEM to improve the reliability and accuracy of IBM for determining the positions of particles during the sedimentation process within viscous fluids. The required ratio of the particle diameter to the grid size (D/dx) was determined by comparing the simulation results with the analytical solution and experimental data. A dynamic mesh refinement model was utilised in the IBM model to refine the computational fluid dynamics grid near the particles. In addition, an optimum coupling interval between the IBM and DEM models was determined based on the experimental results of a single particle sedimentation within silicon oil at a Reynolds number of 1.5. The experimental results and the analytical solution were then utilised to validate the IBM–DEM model at Reynolds numbers of 4.1, 11.6, and 31.9. Finally, the validated model was utilised to investigate the sedimentation process for more than one particle by modeling the drafting-kissing-tumbling process and the Boycott phenomenon. Benchmark tests showed that the IBM–DEM technique preserves the advantages of DEM for tracking a group of particles, while the IBM provides a reliable and accurate approach for modeling the particle–fluid interaction.