Does text matter?: Extending CLIP with OCR and NLP for image classification and retrieval

Contrastive Language-Image Pretraining (CLIP) has gained vast interest due to its impressive performance on a variety of computer vision tasks: image classification, image retrieval, action recognition, feature extraction, and more. The model learns to associate images with their descriptions, a powerful method which allows it to perform well on...

Model-specific Explainable Artificial Intelligence techniques: State-of-the-art, Advantages and Limitations

Artificial Intelligence (AI) and Machine learning (ML) applications are being widely used to solve different problems in different sectors. These applications have enabled the human-effort and involvement to be very low. The AI/ML systems<br/>make their own predictions and do not require a great deal of human help. However, over the last few...

Reinforcement Learning approach for decision-making in driver control shifting for semi-autonomous driving

Semi-autonomous driving innovations aim to bridge the gap to fully autonomous driving by co-operating with human drivers to lead to optimal choices on who should drive in different scenarios by offering different automation levels. However, in the present day, known semi-autonomous driving solutions do not generalise to every complex case of...

The application of Deep Learning to improving low count SPECT imaging

Preclinical SPECT systems such as the U-SPECT have been able to achieve sub-half-millimetre spatial resolution with the use of cylindrical pinhole collimators. Utilising this type of collimator comes at the cost of a reduction in the total number of detection events that take place. In order to compensate for this either the activity of the...

Deep Neural Networks and Optimization: A promising tag team

Machine learning has been a computer sciences buzzword for years. The technology has a lot of potential and a huge number of applications that spoke to people with and without knowledge of computer sciences. Image, text and speech recognition, social profiling, computergames, everything seemed possible. Machine learning is not as much in the...