Transferable Reinforcement Learning in Forex Trading
Cross-Currency Adaptation Techniques for EUR/USD and GBP/USD
Y. Hancer (TU Delft - Electrical Engineering, Mathematics and Computer Science)
M.A. Sharifi Kolarijani – Mentor (TU Delft - Team Amin Sharifi Kolarijani)
Antonis Papapantoleon – Mentor (TU Delft - Applied Probability)
N. Yorke-Smith – Mentor (TU Delft - Algorithmics)
Julia Olkhovskaya – Graduation committee member (TU Delft - Sequential Decision Making)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
This paper investigates the effectiveness of transfer learning techniques for accelerating the training of deep reinforcement learning (RL) agents in the foreign exchange (Forex) market. Specifically, the transfer of policies learned on the EUR/USD currency pair to the GBP/USD pair is the focus. Four transfer learning approaches are systematically compared: zero-shot transfer, full fine-tuning, partial fine-tuning, and reward-function transfer. A modular pipeline was developed, incorporating sinusoidal and trend/momentum-based market features, stepwise agent-specific metrics, and deep Q-network (DQN) architectures from the Stable Baselines 3 framework. Agent performance is evaluated through cumulative reward and Sharpe ratio metrics.
Experimental results demonstrate that partial fine-tuning accelerates initial learning by preserving generic market features acquired from the EUR/USD pair. However, our results indicate that directly training on the target currency pair yields superior ultimate performance, highlighting the nuanced limitations and potential benefits of cross-currency transfer learning in algorithmic trading.