ZZ

Z. Zhao

info

Please Note

13 records found

Conference paper (2024) - Zilong Zhao, Jiyue Huang, Lydia Y. Chen, Stefanie Roos
Generative Adversarial Networks (GANs) are increasingly adopted by the industry to synthesize realistic images using competing generator and discriminator neural networks. Due to data not being centrally available, Multi-Discriminator (MD)-GANs training frameworks employ multiple discriminators that have direct access to the real data. Distributedly training a joint GAN model entails the risk of free-riders, i.e., participants that aim to benefit from the common model while only pretending to participate in the training process. In this paper, we first define a free-rider as a participant without training data and then identify three possible actions: not training, training on synthetic data, or using pre-trained models for similar but not identical tasks that are publicly available. We conduct experiments to explore the impact of these three types of free-riders on the ability of MD-GANs to produce images that are indistinguishable from real data. We consequently design a defense against free-riders, termed DFG, which compares the performance of client discriminators to reference discriminators at the server. The defense allows the server to evict clients whose behavior does not match that of a benign client. The result shows that even when 67% of the clients are free-riders, the proposed DFG can improve synthetic image quality by up to 70.96%, compared to the case of no defense. ...
Journal article (2024) - Ping Wang, Chengpu Yu, Maolong Lv, Zilong Zhao
The adaptive practical prescribed-time (PPT) neural control is studied for multi-input multi-output (MIMO) nonlinear systems with unknown nonlinear functions and unknown input gain matrices. Unlike existing PPT design schemes based on backstepping, this study proposes a novel PPT control framework using the dynamic surface control (DSC) approach. Firstly, a novel nonlinear filter (NLF) with an adaptive parameter estimator and a piece-wise function is constructed to effectively compensate for filter errors and facilitate prescribed-time convergence. Based on this, a unified DSC-based adaptive PPT control algorithm, augmented with a neural networks (NNs) approximator, is developed, where NNs are used to approximate unknown nonlinear system functions. This algorithm not only addresses the inherent computational complexity explosion associated with traditional backstepping methods but also reduces the constraints on filter design parameters compared to the DSC algorithm that relies on linear filters. The simulation showcases the effectiveness and superiority of the devised scheme by employing a two-degree-of-freedom robot manipulator. ...
Journal article (2023) - Guozhi Wang, Binbin Pei, Haojun Xu, Maolong Lv, Zilong Zhao, Xiangwei Bu
This paper proposes a flight risk analysis method that combines risk assessment and visual deduction to study the causes of flight accidents, specifically the loss of control caused by failure factors. The goal is to explore the impact of these failure factors on loss-of-control events and illustrate the risk evolution under different scenarios in a clear and intuitive manner. To achieve this, the paper develops a failure scenario tree to guide flight simulations under different loss-of-control scenarios. The next step involves developing a multi-parameters risk assessment method that can quantify flight risk at each time step of the flight simulation. This assessment method uses entropy weight and a grey correlation algorithm to assign variable weights to the different parameters. Finally, the paper presents the visual deduction of the risk evolution process under different loss-of-control scenarios using a risk tree that concisely represents the time-series risk assessment results and failure logical chains. Taking three common failure factors (actuator failure, engine failure, and wing icing) as cases, the paper designs 25 different loss-of-control scenarios to demonstrate the flight risk analysis method. By comparing the risk evolution process under different loss-of-control scenarios, the paper explores the impact of the failure factors on flight safety. The analysis results indicate that this method combines risk analysis from both individual and global perspectives, enabling effective analysis of risk evolution in loss-of-control events. ...

Enhancing tabular data synthesis

Journal article (2023) - Zilong Zhao, Aditya Kunar, Robert Birke, Hiek Van der Scheer, Lydia Y. Chen
The usage of synthetic data is gaining momentum in part due to the unavailability of original data due to privacy and legal considerations and in part due to its utility as an augmentation to the authentic data. Generative adversarial networks (GANs), a paragon of generative models, initially for images and subsequently for tabular data, has contributed many of the state-of-the-art synthesizers. As GANs improve, the synthesized data increasingly resemble the real data risking to leak privacy. Differential privacy (DP) provides theoretical guarantees on privacy loss but degrades data utility. Striking the best trade-off remains yet a challenging research question. In this study, we propose CTAB-GAN+ a novel conditional tabular GAN. CTAB-GAN+ improves upon state-of-the-art by (i) adding downstream losses to conditional GAN for higher utility synthetic data in both classification and regression domains; (ii) using Wasserstein loss with gradient penalty for better training convergence; (iii) introducing novel encoders targeting mixed continuous-categorical variables and variables with unbalanced or skewed data; and (iv) training with DP stochastic gradient descent to impose strict privacy guarantees. We extensively evaluate CTAB-GAN+ on statistical similarity and machine learning utility against state-of-the-art tabular GANs. The results show that CTAB-GAN+ synthesizes privacy-preserving data with at least 21.9% higher machine learning utility (i.e., F1-Score) across multiple datasets and learning tasks under given privacy budget. ...

Enhancing Global Correlation of Table Synthesis via Fourier Transform

Conference paper (2023) - Zilong Zhao, Robert Birke, Lydia Y. Chen
An alternative method for sharing knowledge while complying with strict data access regulations, such as the European General Data Protection Regulation (GDPR), is the emergence of synthetic tabular data. Mainstream table synthesizers utilize methodologies derived from Generative Adversarial Networks (GAN). Although several state-of-the-art (SOTA) tabular GAN algorithms inherit Convolutional Neural Network (CNN)-based architectures, which have proven effective for images, they tend to overlook two critical properties of tabular data: (i) the global correlation across columns, and (ii) the semantic invariance to the column order. Permuting columns in a table does not alter the semantic meaning of the data, but features extracted by CNNs can change significantly due to their limited convolution filter kernel size. To address the above problems, we propose FCT-GAN the first conditional tabular GAN to adopt Fourier networks into table synthesis. FCT-GAN enhances permutation invariant GAN training by strengthening the learning of global correlations via Fourier layers. Extensive evaluation on benchmarks and real-world datasets show that FCT-GAN can synthesize tabular data with better (up to 27.8%) machine learning utility (i.e. a proxy of global correlations) and higher (up to 26.5%) statistical similarity to real data. FCT-GAN also has the least variation on synthetic data quality among 7 SOTA baselines on 3 different training-data column orders. ...
Conference paper (2023) - Zilong Zhao, Bogdan Robu, Ioan Landau, Luc Dugard, Nicolas Marchand, Louis Job
In this paper, we focus on the French Macro-economic model. We use real economic data, available as time series, starting from 1980s and openly provided by the INSEE. Variables such as Gross Domestic Production, Exportation, Importation, Household Consumption, Gross Fixed Capital Formation and Public expenditure are included in the analysis. Our objective is to maintain a constant economic growth rate according to the available resources. We implement an optimal control policy via LQR to achieve that. Since we aim to maintain a constant growth rate, the control system is modified for this purpose. We prove the efficiency with three experiments based on real data, and we test the method robustness with respect to: (1) variation of LQR parameters, (2) realistic constraints on inputs, and (3) perturbations on outputs. Results show that our designed control system can guide the output to the desired growth rate.MIMO model, LQR, Optimal control, Macroeconomic data. ...
Conference paper (2023) - Zilong Zhao, Robert Birke, Lydia Y. Chen
Generative Adversarial Networks (GANs) are typically trained to synthesize data, from images and more recently tabular data, under the assumption of directly accessible training data. While learning image GANs on Federated Learning (FL) and Multi-Discriminator (MD) systems has just been demonstrated, it is unknown if tabular GANs can be learned from decentralized data sources. Different from image GANs, state-of-the-art tabular GANs require prior knowledge on the data distribution of each (discrete and continuous) column to agree on a common encoding - risking privacy guarantees. In this paper, we propose GDTS, a distributed framework for GAN-based tabular synthesizer. GDTS provides different system architectures to match the two training paradigms termed GDTS_FL and GDTS_MD. Key to enable learning on distributed data is the proposed novel privacy-preserving multi-source feature encoding to capture the global data properties. In addition GDTS encompasses a weighting strategy based on table similarity to counter the detrimental effects of non-IID data and a validation pipeline to easily assess and compare the performance of different paradigms and hyper parameters. We evaluate the effectiveness of GDTS in terms of synthetic data quality, and overall training scalability. Experiments show that GDTS_FL achieves better statistical similarity and machine learning utility between generated and original data compared to GDTS_MD. ...

Poisoning Federated Learning without Data

Conference paper (2023) - Jiyue Huang, Zilong Zhao, Lydia Y. Chen, Stefanie Roos
Attacks on Federated Learning (FL) can severely reduce the quality of the generated models and limit the usefulness of this emerging learning paradigm that enables on-premise decentralized learning. However, existing untargeted attacks are not practical for many scenarios as they assume that i) the attacker knows every update of benign clients, or ii) the attacker has a large dataset to locally train updates imitating benign parties. In this paper, we propose a data-free untargeted attack (DFA) that synthesizes malicious data to craft adversarial models without eavesdropping on the transmission of benign clients at all or requiring a large quantity of task-specific training data. We design two variants of DFA, namely DFA-R and DFA-G, which differ in how they trade off stealthiness and effectiveness. Specifically, DFA-R iteratively optimizes a malicious data layer to minimize the prediction confidence of all outputs of the global model, whereas DFA-G interactively trains a malicious data generator network by steering the output of the global model toward a particular class. Experimental results on Fashion-MNIST, Cifar-10, and SVHN show that DFA, despite requiring fewer assumptions than existing attacks, achieves similar or even higher attack success rate than state-of-the-art untargeted attacks against various state-of-the-art defense mechanisms. Concretely, they can evade all considered defense mechanisms in at least 50% of the cases for CIFAR-10 and often reduce the accuracy by more than a factor of 2. Consequently, we design REFD, a defense specifically crafted to protect against data-free attacks. REFD leverages a reference dataset to detect updates that are biased or have a low confidence. It greatly improves upon existing defenses by filtering out the malicious updates and achieves high global model accuracy. ...
Conference paper (2022) - Yujin Zhu, Zilong Zhao, Robert Birke, Lydia Y. Chen
Tabular data synthesis is an emerging approach to circumvent strict regulations on data privacy while discovering knowledge through big data. Although state-of-the-art AI-based tabular data synthesizers, e.g., table-GAN, CTGAN, TVAE, and CTAB-GAN, are effective at generating synthetic tabular data, their training is sensitive to column permutations of input data. In this paper, we first c onduct a n e xtensive e mpirical s tudy to disclose such a property of permutation invariance and an in-depth analysis of the existing synthesizers. We show that changing the input column order worsens the statistical difference between real and synthetic data by up to 38.67% due to the encoding of tabular data and the network architectures. To fully unleash the potential of big synthetic tabular data, we propose two solutions: (i) AE-GAN, a synthesizer that uses an autoencoder network to represent the tabular data and GAN networks to synthesize the latent representation, and (ii) a feature sorting algorithm to find t he s uitable c olumn o rder o f i nput d ata f or CNN-based synthesizers. We evaluate the proposed solutions on five datasets in terms of the sensitivity to the column permutation, the quality of synthetic data, and the utility in downstream analyses. Our results show that we enhance the property of permutation-invariance when training synthesizers and further improve the quality and utility of synthetic data, up to 22%, compared to the existing synthesizers. ...
Journal article (2022) - Zehong Dong, Yinghui Li, Maolong Lv, Zilong Zhao, Binbin Pei
A new fixed-time fuzzy adaptive fault-tolerant control methodology is proposed for the longitudinal dynamics of hypersonic flight vehicles (HFVs) in the presence of actuator faults, uncertain dynamics, and external disturbances. In contrast with the conventional fixed-time control schemes that typically contain the fractional powers of errors in their designs, this work develops a low-complexity control structure in the sense of removing the dependence on the need of abovementioned fractional power terms by means of prescribed performance control (PPC) method. Different from the most existing PPC approaches where the initial conditions of tracking errors are required to be known, the newly proposed prescribed performance function (PPF) can relax such restrictions through choosing properly small initial values of PPF. Fuzzy logic systems (FLSs) are employed to handle unknown dynamics, and minimal learning parameter (MLP) technique is incorporated into the design for the purpose of alleviating computation burden. Closed-loop stability is rigorously proved via Lyapunov stability theory, and simulation results are eventually given to validate the effectiveness of the proposed control strategy. ...

Exploring Potential Risk to Privacy

Conference paper (2022) - Han Wu, Zilong Zhao, Lydia Y. Chen, Aad van Moorsel
Federated Learning (FL) has emerged as a potentially powerful privacy-preserving machine learning method-ology, since it avoids exchanging data between participants, but instead exchanges model parameters. FL has traditionally been applied to image, voice and similar data, but recently it has started to draw attention from domains including financial services where the data is predominantly tabular. However, the work on tabular data has not yet considered potential attacks, in particular attacks using Generative Adversarial Networks (GANs), which have been successfully applied to FL for non-tabular data. This paper is the first to explore leakage of private data in Federated Learning systems that process tabular data. We design a Generative Adversarial Networks (GANs)-based attack model which can be deployed on a malicious client to reconstruct data and its properties from other participants. As a side-effect of considering tabular data, we are able to statistically assess the efficacy of the attack (without relying on human observation such as done for FL for images). We implement our attack model in a recently developed generic FL software framework for tabular data processing. The experimental results demonstrate the effectiveness of the proposed attack model, thus suggesting that further research is required to counter GAN-based privacy attacks. ...
Journal article (2022) - Xiaolin Wang, Jihui Xu, Maolong Lv, Lei Zhang, Zilong Zhao
This article proposes a fixed-time adaptive fault-tolerant control methodology for a larger class of high-order (powers are positive odd integers) nonlinear systems subject to asymmetric time-varying state constraints and actuator faults. In contrast with the state-of-the-art control methodologies, the distinguishing features of this study lie in that: (a) high-order asymmetric time-varying tan-type barrier Lyapunov function (BLF) is devised such that the state variables can be convergent to the preassigned compact sets all the time provided their initial values remain therein, which not only preserves the constraints satisfaction, but warrants the validity of the adopted neural network approximator; (b) the proposed control design ensures the tracking errors converge to specified residual sets within fixed time and makes the size of the convergence regions of tracking errors adjustable a priori by means of a new BLF-based tuning function and a projection operator; (c) a variable-separable lemma is delicately embedded into the control design to extract the control terms in a “linear-like” fashion which not only overcomes the difficulty that virtual control signals appear in a non-affine manner, but also solves the problem of actuator faults. Comparative simulations results finally validate the effectiveness of the proposed scheme. ...
Conference paper (2020) - Jiyue Huang, Rania Talbi, Zilong Zhao, Sara Boucchenak, Lydia Y. Chen, Stefanie Roos
Federated Learning is an emerging distributed collaborative learning paradigm adopted by many of today's applications, e.g., keyboard prediction and object recognition. Its core principle is to learn from large amount of users data while preserving data privacy by design as collaborative users only need to share the machine learning models and keep data locally. The main challenge for such systems is to provide incentives to users to contribute high-quality models trained from their local data. In this paper, we aim to answer how well incentives recognize (in)accurate local models from honest and malicious users, and perceive their impacts on the model accuracy of federated learning systems. We first present a thorough survey on two contrasting perspectives: incentive mechanisms to measure the contribution of local models by honest users, and malicious users to deliberately degrade the overall model. We conduct simulation experiments to empirically demonstrate if existing contribution measurement schemes can disclose low-quality models from malicious users. Our results show there exists a clear tradeoff among measurement schemes in terms of the computational efficiency and effectiveness to distill the impact of malicious participants. We conclude this paper by discussing the research directions to design resilient contribution incentives. ...