Optimizing the layout of residential buildings based on daylight performance and view quality is crucial to visual comfort and well-being of building occupants. Machine Learning (ML) methods offer valuable support for performance-based decision-making process at the early-stage building design. In this study, a novel workflow is introduced to integrate ML models into the architectural design process. With the designer’s input floor layout designs, the presented multimodal ML model predicts daylight provision and view quality, which are then translated into practical visual representations by a post-processing step. This approach allows input designs to be evaluated by the ML model, leading to enhanced design decisions while preserving the designer’s autonomy. Results for the best-performing model, implementing ResNet50 and a fully connected network, led to a Mean Square Error (MSE) of 0.0440 and 0.0478, and an R2 score of 0.7411 and 0.7815 for the daylight and view metrics, respectively. The results of the daylight and view predictive models are further interpreted according to different apartment categories and at various resolutions. These results indicate that the method could be viable for predicting daylight provision and view quality in early design tools, providing designers with faster feedback that supports informed decision-making during design iterations. Ultimately, the challenges of the study and further improvements are discussed.