C. March Moya
Please Note
5 records found
1
Global-Local Attention vs Graph Neural Networks in the Reinforcement Learning Approach for the Dynamic Berth Allocation Problem
Bridging the Optimality Gap in Dynamic Berth Allocation Problem via Global-Local Attention
Reinforcement Learning for the Dynamic Berth Allocation Problem
Evaluating the Robustness of a Graph Neural Network Agent under Uncertainty of Estimated Time of Arrival
scheduling problem where vessels arrive dynamically over time and must be assigned to a berth. A pre-trained Graph Neural Network (GNN) based
reinforcement learning approach solves the problem efficiently but is dependent on estimated times of arrival [11]. However, vessels predominantly arrive later than estimated. this introduces unwanted uncertainty. We evaluate a pre-trained GNN agent under controlled ETA perturbations to create an information gap between the estimated and actual arrival times, using the original full information setting as a reference. The agent is evaluated using a factorial experimental setup over different deviation levels and instances to evaluate robustness under ETA uncertainty. The results show that the agent is robust to optimistic ETA deviations, with only limited performance degradation even at
larger introduced deviations. The robustness appears to mainly stem from the reactive nature of the agent and its associated scheduling process, which
limits the influence of ETA deviations on the decision making process. ...
scheduling problem where vessels arrive dynamically over time and must be assigned to a berth. A pre-trained Graph Neural Network (GNN) based
reinforcement learning approach solves the problem efficiently but is dependent on estimated times of arrival [11]. However, vessels predominantly arrive later than estimated. this introduces unwanted uncertainty. We evaluate a pre-trained GNN agent under controlled ETA perturbations to create an information gap between the estimated and actual arrival times, using the original full information setting as a reference. The agent is evaluated using a factorial experimental setup over different deviation levels and instances to evaluate robustness under ETA uncertainty. The results show that the agent is robust to optimistic ETA deviations, with only limited performance degradation even at
larger introduced deviations. The robustness appears to mainly stem from the reactive nature of the agent and its associated scheduling process, which
limits the influence of ETA deviations on the decision making process.
Comparing Encoder Architectures for the Discrete Berth Allocation Problem
Testing a pure attention transformer mechanism as an alternative to the GAT encoder a Reinforcement Learning agent uses to solve the Discrete Berth Allocation Problem
encoder in a reinforcement learning framework with a direct attention mechanism to solve the Dynamic Discrete Berth Allocation Problem (DDBAP): the challenge of assigning ships to specific docking spots over time. We tested two alternative designs, a Pure Attention Transformer and a topology-aware Edge-Transformer, against a baseline Graph Attention Network (GAT) using 27 simulated shipping scenarios. On average, the baseline GNN performed relatively better overall, scoring an average cost of 646.58 compared to 650.72 for the Edge-Transformer and 658.63 for the Pure Transformer. However, the best choice depends entirely on the size of the problem. The GNN works best in low-traffic situations with plenty of available berths because it ignores irrelevant background information. In contrast, when the port gets highly congested, such as 120 ships competing for just 5 berths, the global attention mechanism performs much better because it can anticipate long-term queue delays. Finally, while the attention-based models take significantly longer to train over 30,000 samples, they both process decisions in less than a second during live testing. This makes them highly practical for real-time maritime scheduling. ...
encoder in a reinforcement learning framework with a direct attention mechanism to solve the Dynamic Discrete Berth Allocation Problem (DDBAP): the challenge of assigning ships to specific docking spots over time. We tested two alternative designs, a Pure Attention Transformer and a topology-aware Edge-Transformer, against a baseline Graph Attention Network (GAT) using 27 simulated shipping scenarios. On average, the baseline GNN performed relatively better overall, scoring an average cost of 646.58 compared to 650.72 for the Edge-Transformer and 658.63 for the Pure Transformer. However, the best choice depends entirely on the size of the problem. The GNN works best in low-traffic situations with plenty of available berths because it ignores irrelevant background information. In contrast, when the port gets highly congested, such as 120 ships competing for just 5 berths, the global attention mechanism performs much better because it can anticipate long-term queue delays. Finally, while the attention-based models take significantly longer to train over 30,000 samples, they both process decisions in less than a second during live testing. This makes them highly practical for real-time maritime scheduling.
The Robustness of the GNN approach in application of different data-generation method
How robust is the GNN approach when applied to instances generated using different data-generation methods or distributions?
Reinforcement Learning for the Discrete Dynamic Berth Allocation Problem
Evaluating a trained Discrete Dynamic Berth Allocation model on Berth breakdowns