There is a clear and unmet clinical need for biomarkers to predict responsiveness to chemotherapy for cancer. We developed an in vitro test based on patient-derived tumor organoids (PDOs) from metastatic lesions to identify nonresponders to standard-of-care chemotherapy in colorectal cancer (CRC). In a prospective clinical study, we show the feasibility of generating and testing PDOs for evaluation of sensitivity to chemotherapy. Our PDO test predicted response of the biopsied lesion in more than 80% of patients treated with irinotecan-based therapies without misclassifying patients who would have benefited from treatment. This correlation was specific to irinotecan-based chemotherapy, however, and the PDOs failed to predict outcome for treatment with 5-fluorouracil plus oxaliplatin. Our data suggest that PDOs could be used to prevent cancer patients from undergoing ineffective irinotecan-based chemotherapy.