AG

A. Ghorbani Ghezeljehmeidan

info

Please Note

2 records found

Industrial quality control needs inspection systems that are accurate, explainable, and adaptable to new product categories with few labelled data. Traditional deep-learning detectors, such as memory-bank, normalising-flow, and reconstruction-based methods, reach near-perfect AUROC on the established MVTec AD benchmark, yet they emit only a binary defect verdict and a heatmap. They give no human-readable account of why a sample was flagged or what type of defect it carries, and that lack of interpretability is a primary obstacle to deploying automated inspection in safety- and audit-critical manufacturing.

This thesis asks whether an open vision-language model (VLM), fine-tuned on structured reasoning traces and refined with reinforcement learning, can deliver explainable anomaly detection that is competitive with the state of the art, on products it was not trained on and without per-product retraining or reference images. We build an end-to-end framework that fine-tunes the open-weight Qwen2.5-VL family on structured chain-of-thought reasoning traces. Each trace follows a six-phase template (Framing, Scan, Focus, Evaluate, Alternatives, Decide) and emits an XML output with a free-text rationale, a defect-type tag, a spatial location, and a binary verdict. Using Gemini 2.5-Flash we generate 14,472 such traces from the Real-IAD multi-view dataset, released here as the AnomalyThink dataset, and partition them into product- and class-stratified splits of 6,000 for supervised fine-tuning, 4,236 for GRPO, and 4,236 held out.

We run a controlled four-factor comparison of fine-tuning configurations across model size (3B versus 7B), vision-encoder freezing, supervised-data scale (6K versus the full 14.5K union), and training epoch (up to four), with the unfrozen encoder evaluated only at the larger scale. This is followed by Group Relative Policy Optimisation (GRPO) with an unweighted two-function reward scoring four bounded signals: format, verdict, semantic type, and location. Evaluation uses the DS-MVTec (1,670 samples) and VisA (2,141 samples) subsets of MMAD, together with a held-out Real-IAD split.

Our main result comes from a three-stage pipeline in which each stage feeds the next: supervised fine-tuning, GRPO, and a second supervised stage trained on data the GRPO model produced. Supervised fine-tuning on the 6,000-trace dataset reaches 80.16 % balanced accuracy on DS-MVTec and 64.78 % on VisA. GRPO with our reward functions lifts this to 82.73 % and 70.39 %. We then roll that GRPO model out at k = 8 over all 10,236 training images, which is the 6,000-image SFT split plus the 4,236-image GRPO split. We keep the traces it gets right and have a teacher correct or rewrite the rest. The new corpus is rebuilt on the 6,000 SFT images. Training the base Qwen2.5-VL-7B on it reaches 82.80 % and 72.07 %, the best result on that backbone, and beats the released IAD-R1 model on both subsets (81.92 % and 71.34 %) under the same evaluation harness. We repeat the same recipe end to end on a second backbone, LLaVA-OneVision-7B-SI. There the curated corpus reaches 87.32 % and 72.65 % at the selected epoch against 87.66 % and 72.38 % for SFT plus GRPO, and 74.29 % on VisA by epoch 4. On both backbones the supervised stage matches the reinforcement-learned one and exceeds it on VisA. The finding is therefore not specific to one model family. The last stage is a supervised one. What GRPO gave us was not the final model but the data we used to train it.

GRPO on its own helps when the supervised baseline is weak. Applied to the earlier supervised baseline it raises balanced accuracy to 82.73 % on DS-MVTec, 70.39 % on VisA, and 80.87 % on the held-out Real-IAD split, exceeding IAD-R1 on DS-MVTec. Applied on top of the stronger curated dataset, GRPO did not improve binary accuracy in our experiments. Reward kept rising while balanced accuracy stayed 1.6 to 4.0 points below the supervised initialisation. This held for all three advantage estimators we tried, within a single 120-step probe on one initialisation. Two further results follow. Within our data, the 6,000-trace split beats the full 14.5K union by 8.5 balanced-accuracy points on DS-MVTec at matched epochs, a data-count effect rather than a trace-length one. And freezing the vision encoder consistently beats unfreezing it, most clearly on the harder VisA benchmark.

The framework is reproducible on commodity hardware, two RTX A6000 GPUs with ZeRO-3 CPU offloading, and yields a single 7B model that detects, localises, and explains industrial defects in natural language, with no per-product retraining and no pixel-level masks at inference. ...

焊点可靠性通常采用电气失效准则进行评估。然而,在疲劳损伤初期,电阻通常保持稳定,仅在裂纹显著扩展后才会增加。因此,传统的监测方法能够提供关于失效前内部退化的信息有限。虽然三维X射线显微镜(3DXRM)能够对内部裂纹和空隙进行无损观察,但其庞大的图像体积使得一致的人工分析变得困难。

本论文开发了一种基于人工智能的BGA、FCBGA和QFN封装在热循环作用下的可靠性表征工作流程。采用YOLO11n-Seg模型检测重建的3DXRM图像中的裂纹、空隙和焊点结构。分割结果被转化为定量退化指标,包括裂纹体积比和主裂纹面积比。此外,还通过重复性、再现性、灵敏度和不确定性分析评估了整个测量工作流程的稳定性。

对于BGA样品,所提出的裂纹指标的变化趋势与电阻变化以及基于Arivis的现有结果一致。对于QFN样品,采用威布尔分析比较了-40℃至125℃和-40℃至150℃热循环下的退化情况。实验得到的退化尺度比为1.58,95%置信区间约为1.12-2.24,与已建立的热机械加速模型相符。 

该工作流程进一步扩展到扫描电镜图像筛选、空洞分析和焊料体积测量。总体而言,所提出的框架减少了人工图像分析的工作量,并能在焊点完全失效之前,提供关于焊点劣化更早、可重复且具有实际意义的信息。

Solder-joint reliability is commonly evaluated using electrical failure criteria. However, electrical resistance often remains stable during early fatigue damage and increases only after substantial crack propagation. Therefore, conventional monitoring provides limited information about internal degradation before failure. Although three-dimensional X-ray microscopy (3DXRM) enables non-destructive observation of internal cracks and voids, its large image volume makes consistent manual analysis difficult.
This thesis develops an AI-assisted reliability-characterization workflow for BGA, FCBGA, and QFN packages subjected to thermal cycling. A YOLO11n-Seg model was used to detect cracks, voids, and solder-joint structures in reconstructed 3DXRM images. The segmentation results were converted into quantitative degradation indicators, including crack volume ratio and main-crack area ratio. The stability of the complete measurement workflow was also evaluated through repeatability, reproducibility, sensitivity, and uncertainty analyses.
For BGA samples, the proposed crack indicators showed trends consistent with electrical resistance changes and existing Arivis-based results. For QFN samples, Weibull analysis was used to compare degradation under −40 ℃ to 125 ℃ and −40 ℃ to 150 ℃ thermal cycling. The experimental degradation-scale ratio was 1.58, with an approximate 95% confidence interval of 1.12–2.24, showing consistency with established thermo-mechanical acceleration models.
The workflow was further extended to SEM image screening, void analysis, and solder-volume measurement. Overall, the proposed framework reduces manual image-analysis effort and provides earlier, repeatable, and physically meaningful information about solder-joint degradation before complete electrical failure.


...