Purpose The purpose of this paper is to present a methodology to estimate the carotid artery lumen centerlines in ultrasound (US) images obtained in a free-hand examination. Challenging aspects here are speckle noise in US images, artifacts, and the lack of contrast in the direction orthogonal to the US beam direction. Method An algorithm based on a rough lumen segmentation obtained by robust ellipse fitting was developed to deal with these conditions and estimate the lumen center in 2D B-mode scans. In a free-hand sweep examination, continuous image acquisitions are performed through time when the radiologist moves the probe on the patient’s neck. The result is a series of images that show 2D cross-sections of the carotid’s morphology. A tracking sensor (Flock of Birds) was attached to the probe and both were connected to a PC executing the Stradwin software, which relates spatial information to the acquisition data of the US probe. The spatial information was combined with the 2D lumen center estimates to provide a centerline in 3D. For validation, 19 carotid scans from 15 different patients were scanned, their centerlines calculated by the algorithm and compared with results acquired by manual annotations. Results The average Euclidean distance between both among all the examinations was 0.82 mm. For each examination, the percentage of these Euclidean distances below 2 mm was calculated; the average over all examinations was 92%. Conclusion Automated 3D estimation of carotid artery lumen centerlines in free-hand real-time ultrasound is feasible and can be performed with high accuracy. The algorithm is robust enough to keep the centerlines inside the vessel, even in the absence of contrast in parts of the vessel wall.