Deep Neural Network-Based Digital Pre-distortion for High Baudrate Optical Coherent Transmission

Journal Article (2022)
Author(s)

V. Bajaj (TU Delft - Team Sander Wahls, Nokia Bell Labs)

Fred Buchali (Nokia Solutions and Networks)

Mathieu Chagnon (Nokia Bell Labs)

Sander Wahls (TU Delft - Team Sander Wahls)

Vahid Aref (Nokia Solutions and Networks)

Research Group
Team Sander Wahls
Copyright
© 2022 V. Bajaj, Fred Buchali, Mathieu Chagnon, S. Wahls, Vahid Aref
DOI related publication
https://doi.org/10.1109/JLT.2021.3122161
More Info
expand_more
Publication Year
2022
Language
English
Copyright
© 2022 V. Bajaj, Fred Buchali, Mathieu Chagnon, S. Wahls, Vahid Aref
Research Group
Team Sander Wahls
Issue number
3
Volume number
40
Pages (from-to)
597-606
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

High-symbol-rate coherent optical transceivers suffer more from the critical responses of transceiver components at high frequency, especially when applying a higher order modulation format. Recently, we proposed in [20] a neural network (NN)-based digital pre-distortion (DPD) technique trained to mitigate the transceiver response of a 128~GBaud optical coherent transmission system. In this paper, we further detail this work and assess the NN-based DPD by training it using either a direct learning architecture (DLA) or an indirect learning architecture (ILA), and compare performance against a Volterra series-based DPD and a linear DPD. Furthermore, we willfully increase the transmitter nonlinearity and compare the performance of the three DPDs considered. The proposed NN-based DPD trained using DLA performs the best among the three contenders, providing more than 1~dB signal-to-noise ratio (SNR) gains for uniform 64-quadrature amplitude modulation (QAM) and PCS-256-QAM signals at the output of a conventional coherent receiver DSP. Finally, the NN-based DPD enables achieving a record 1.61~Tb/s net rate transmission on a single channel after 80~km of standard single mode fiber (SSMF).