In this article we present the state of the art in the field of autonomous surface ship navigation using machine learning. We discuss the main challenges towards the development of fully autonomous navigation systems with the International Regulations for Preventing Collisions at Sea (COLREGs). Finally, we propose two alternative approaches that are based on machine learning. Existing COLREGs-based navigation and collision avoidance algorithms are based on traditional search-based planning and optimization algorithms. We consider that these approaches are suitable when the problem space is defined completely and rigorously. However, experts believe that is not the case for COLREGs since it leaves many aspects open to the interpretation of the captain. For example, COLREGs expects that any collision avoidance action shall be taken with due regard to the observance of good seamanship, a concept not defined in the convention. Furthermore, many rules are defined using undefined concepts like safe distance, or keywords like early, or substantial, without giving any definition. COLREGs even allow for the rules to be broken to avoid an accident. Due to this, traditional planning approaches may not be able to handle complex scenarios that are underspecified according to COLREGs. An alternative is the use of machine learning (ML), reinforcement learning (RL) and imitation learning (IL) at the core of autonomous navigation systems. Machine learning is known to succeed and outperform traditional approaches specially in vaguely defined problem domains, where it is difficult, if not impossible, to create a full formal specification of the phenomenon under study. We consider this to be the case for COLREGs-based navigation and we conjecture that a ML-based navigation approach can outperform existing search-based and optimization algorithms.@en

We propose a method for scenario-based testing of maritime collision avoidance systems. The goal is to test an autonomous agent in scenarios that can lead to an unacceptable risk of collision or may clearly not comply with the International Regulations for Preventing Collisions at Sea (COLREGs).Our method is based on the use of a discriminating artificial neural network that is trained online while performing the testing of the agents. Our experimental results show that the proposed algorithm generates test suits composed mostly of challenging scenarios. This allows us to validate quickly if the agent under test can perform the collision avoidance maneuvers safely while abiding the COLREGs. @en

This paper explores the state of the art on to methods to verify and validate navigation algorithms for autonomous surface ships. We perform a systematic mapping study to find research works published in the last 10 years proposing new algorithms for autonomous navigation and collision avoidance and we have extracted what verification and validation approaches have been applied on these algorithms. We observe that most research works use simulations to validate their algorithms. However, these simulations often involve just a few scenarios designed manually. This raises the question if the algorithms have been validated properly. To remedy this, we propose the use of a systematic scenario-based testing approach to validate navigation algorithms extensively.@en