In this work, the hydrogen fatigue of pipeline steel X60, its girth welds and weld defects were investigated through in situ fatigue testing. A novel in situ gaseous hydrogen charging fatigue set-up was developed, which involves a sample geometry that mimics a small-scale pipeline with high internal hydrogen gas pressure. The effect of hydrogen was investigated by measuring the crack initiation and growth, using a direct current potential drop (DCPD) set-up, which probes the outer surface of the specimen. The base and weld metal specimens both experienced a reduction in fatigue life in the presence of hydrogen. For the base metal, the reduction in fatigue life manifested solely in the crack growth phase; hydrogen accelerated the crack growth by a factor of 4. The crack growth rate for the weld metal accelerated by a factor of 8. However, in contrast to the base metal, the weld metal also experienced a reduction of 57% in resistance to crack initiation. Macropores (>500 µm in size) on the notch surface reduced the fatigue life by a factor of 11. Varying the pressure from 70 barg to 150 barg of hydrogen caused no difference in the hydrogen fatigue behavior of the weld metal. The fracture path of the base and weld metal transitioned from transgranular and ductile in nature to a mixed-mode transgranular and intergranular quasi-cleavage fracture. Hydrogen accelerated the crack growth by decreasing the roughness- and plasticity-induced crack closure. The worst case scenario for pipelines was found in the case of weld defects. This work therefore highlights the necessity to re-evaluate pipelines for existing defects before they can be reused for hydrogen transport.