Intermediate filaments (IFs) are a key component of the cytoskeleton, essential for regulating cell mechanics, maintaining nuclear integrity, organelle positioning, and modulating cell signaling. Current insights into IF function primarily come from studies using long-term perturbations, such as protein depletion or mutation. Here, we present tools that allow rapid manipulation of vimentin IFs in the whole cytoplasm or within specific subcellular regions by inducibly coupling them to microtubule motors, either pharmacologically or using light. Rapid perinuclear clustering of vimentin had no major immediate effects on the actin or microtubule organization, cell spreading, or focal adhesion number, but it reduced cell stiffness. Mitochondria and endoplasmic reticulum (ER) sheets were reorganized due to vimentin clustering, whereas lysosomes were only briefly displaced and rapidly regained their normal distribution. Keratin moved along with vimentin in some cell lines but remained intact in others. Our tools help to study the immediate and local effects of vimentin perturbation and identify direct links of vimentin to other cellular structures.