Accurate estimation of urban land surface temperature (ULST) is critical for studying urban heat islands, but complex three-dimensional (3D) structures and materials in urban areas introduce significant adjacency effects into remote sensing retrievals. To investigate the influence of different factors on the adjacency effects, this study employed the DART model to quantify brightness temperature differences (ΔTb) of urban pixels by comparing their simulated radiance in two scenarios: (1) an isolated state (no adjacent buildings) and (2) an adjacent state (with surrounding buildings). ΔTb, representing the adjacency effect, was systematically analyzed across spatial resolutions (1–120 m), building geometry (building height BH, roof area index (Formula presented.), adjacent obstruction degree SVF_Obs.), and material reflectance (reflectance R = 0.05, 0.1, 0.15) to determine key influencing factors. The results demonstrate that (1) adjacency effects intensify significantly with higher spatial resolution (mean ΔTb ≈ 5 K at 1 m vs. ≈2 K at 30 m), with 60–90 m identified as the critical resolution range where the adjacency-induced error is attenuated to a level (ΔTb < 1 K) that is commensurate with the intrinsic uncertainty of current mainstream ULST algorithms; (2) increased building height, reduced density ((Formula presented.)), and greater adjacent obstruction (SVF_Obs.) exacerbate adjacency effects; (3) material emissivity (ε = 1 − R) is the dominant factor, where low-ε materials (high R) exhibit markedly stronger adjacency effects than geometric influences (e.g., ΔTb at R = 0.15 is approximately three times higher than at R = 0.05); and (4) temperature differences among surface components exert minimal influence on adjacency effects (ΔTb < 0.5 K). This study clarifies key factors driving adjacency effects in high-resolution ULST retrieval and defines the critical spatial resolution for simplifying inversions, providing essential insights for accurate urban temperature estimation.