Digitalization of HVAC piping and instrumentation diagrams (P&IDs) is essential for advancing the intelligent transformation of building systems and the building services industry. This work explores Large Language Models (LLMs) for zero-shot P&ID digitization, focusing on symbol detection. Three LLM-assisted approaches are evaluated. The results show that directly applying LLMs to P&ID digitization is highly challenging. By segmenting P&IDs into local crops and pairing them with the full diagram annotated with bounding boxes to provide global context, the LLM achieves improved symbol recognition. The findings highlight both the promise of LLMs and the need for further refinement to enable reliable HVAC P&ID digitization.