Practical object and flow structure segmentation using artificial intelligence

Journal Article (2024)
Author(s)

Ali R. Khojasteh (TU Delft - Fluid Mechanics)

W. van de Water (TU Delft - Fluid Mechanics)

J. Westerweel (TU Delft - Fluid Mechanics)

Research Group
Fluid Mechanics
DOI related publication
https://doi.org/10.1007/s00348-024-03852-7
More Info
expand_more
Publication Year
2024
Language
English
Research Group
Fluid Mechanics
Issue number
8
Volume number
65
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

This paper explores integrating artificial intelligence (AI) segmentation models, particularly the Segment Anything Model (SAM), into fluid mechanics experiments. SAM’s architecture, comprising an image encoder, prompt encoder, and mask decoder, is investigated for its application in detecting and segmenting objects and flow structures. Additionally, we explore the integration of natural language prompts, such as BERT, to enhance SAM’s performance in segmenting specific objects. Through case studies, we found that SAM is robust in object detection in fluid experiments. However, segmentations related to flow properties, such as scalar turbulence and bubbly flows, require fine-tuning. To facilitate the application, we have established a repository (https://github.com/AliRKhojasteh/Flow_segmentation) where models and usage examples can be accessed.