Searched for: author%3A%22He%2C+J.%22
(1 - 17 of 17)
document
Chen, Yangkun (author), Yu, Chenghui (author), Zhu, Hengman (author), Liu, Shuai (author), Zhang, Yibing (author), Suarez, Joseph (author), Zhao, Liang (author), He, J. (author), Chen, Jiaxin (author)
We present the results of the second Neural MMO challenge, hosted at IJCAI 2022, which received 1600+ submissions. This competition targets robustness and generalization in multi-agent systems: participants train teams of agents to complete a multi-task objective against opponents not seen during training. We summarize the competition design...
journal article 2023
document
Gao, Z. (author), He, J. (author), Fritz, Martin (author), Shen, Y. (author), Zong, Z. (author), Spalink, Gerd (author), Alavi, S.M. (author), Staszewski, R.B. (author), Babaie, M. (author)
This article introduces a low-jitter low-spur fractional-N phase-locked loop (PLL) adopting a new concept of a time-mode arithmetic unit (TAU) for phase error extraction. The TAU is a time-signal processor that calculates the weighted sum of input time offsets. It processes two inputs - the period of a digitally controlled oscillator (DCO)...
journal article 2023
document
He, J. (author), Suau, M. (author), Baier, Hendrik (author), Kaisers, Michael (author), Oliehoek, F.A. (author)
How can we plan efficiently in a large and complex environment when the time budget is limited? Given the original simulator of the environment, which may be computationally very demanding, we propose to learn online an approximate but much faster simulator that improves over time. To plan reliably and efficiently while the approximate simulator...
conference paper 2022
document
Suau, M. (author), He, J. (author), Spaan, M.T.J. (author), Oliehoek, F.A. (author)
Learning effective policies for real-world problems is still an open challenge for the field of reinforcement learning (RL). The main limitation being the amount of data needed and the pace at which that data can be obtained. In this paper, we study how to build lightweight simulators of complicated systems that can run sufficiently fast for...
conference paper 2022
document
Suau, M. (author), He, J. (author), Çelikok, Mustafa Mert (author), Spaan, M.T.J. (author), Oliehoek, F.A. (author)
Due to its high sample complexity, simulation is, as of today, critical for the successful application of reinforcement learning. Many real-world problems, however, exhibit overly complex dynamics, which makes their full-scale simulation computationally slow. In this paper, we show how to factorize large networked systems of many agents into...
conference paper 2022
document
Gao, Z. (author), He, J. (author), Fritz, Martin (author), Gong, J. (author), Shen, Y. (author), Zong, Z. (author), Chen, Peng (author), Staszewski, R.B. (author), Alavi, S.M. (author), Babaie, M. (author)
In a fractional-N PLL, it is beneficial to minimize the input range of its phase detector (PD) as it promotes better linearity and higher PD gain for suppressing noise contributions of the following loop components. This can be done by canceling the predicted instantaneous time offset between the frequency reference (FREF) and the variable...
conference paper 2022
document
Gao, Z. (author), Fritz, Martin (author), He, J. (author), Spalink, Gerd (author), Staszewski, R.B. (author), Alavi, S.M. (author), Babaie, M. (author)
We present a broadband digital PLL (DPLL)-based phase modulator supporting wide frequency modulation (FM) bandwidth (BW). It compensates for the EVM degradation due to the non-uniform period of the retimed updating clock and shortens the nonlinearity calibration time of the digitally controlled oscillator (DCO) with a phase-domain digital pre...
conference paper 2022
document
Suau, M. (author), He, J. (author), Congeduti, E. (author), Starre, R.A.N. (author), Czechowski, A.T. (author), Oliehoek, F.A. (author)
Due to its perceptual limitations, an agent may have too little information about the environment to act optimally. In such cases, it is important to keep track of the action-observation history to uncover hidden state information. Recent deep reinforcement learning methods use recurrent neural networks (RNN) to memorize past observations....
journal article 2022
document
Suau, M. (author), He, J. (author), Spaan, M.T.J. (author), Oliehoek, F.A. (author)
Learning effective policies for real-world problems is still an open challenge for the field of reinforcement learning (RL). The main limitation being the amount of data needed and the pace at which that data can be obtained. In this paper, we study how to build lightweight simulators of complicated systems that can run sufficiently fast for...
conference paper 2022
document
Dabrowski, M.M. (author), Stead, D. (author), He, J. (author), Yu, Feng (author)
Although the cities in the Pearl River Delta (PRD) in China are amongst the world’s cities most exposed to flooding due to climate change, surprisingly little is done to address this problem. This article explores the barriers to the emergence of policies adapting to the growing flood risk in two PRD cities, Guangzhou and Shenzhen, underlining...
journal article 2021
document
Li, M. (author), McDonald, B. C. (author), McKeen, S. A. (author), Eskes, H. (author), Levelt, Pieternel Felicitas (author), Francoeur, C. (author), Harkins, C. (author), He, J. (author), Barth, M. (author)
Nitrogen oxides (NO<sub>x</sub>) are air pollutants critical to ozone and fine particle production in the troposphere. Here, we present fuel-based emission inventories updated to 2018, including for mobile source engines using the Fuel-based Inventory of Vehicle Emissions (FIVEs) and oil and gas production using the Fuel-based Oil and Gas ...
journal article 2021
document
Igl, Maximilian (author), Gambardella, Andrew (author), He, J. (author), Nardelli, Nantas (author), Siddharth, N (author), Böhmer, J.W. (author), Whiteson, Shimon (author)
We present Multitask Soft Option Learning (MSOL), a hierarchical multitask framework based on Planning as Inference. MSOL extends the concept of options, using separate variational posteriors for each task, regularized by a shared prior. This “soft” version of options avoids several instabilities during training in a multitask setting, and...
conference paper 2020
document
He, J. (author), Suau, M. (author), Oliehoek, F.A. (author)
How can we plan efficiently in real time to control an agent in a complex environment that may involve many other agents? While existing sample-based planners have enjoyed empirical success in large POMDPs, their performance heavily relies on a fast simulator. However, real-world scenarios are complex in nature and their simulators are often...
journal article 2020
document
Dabrowski, M.M. (author), Stead, D. (author), Yu, Feng (author), He, J. (author)
In some of the delta cities which are the most exposed to flooding caused by climate change - like Shenzhen and Guangzhou investigated in this paper - there is surprisingly little recognition of this problem and hardly any action is taken to address it. This paper draws on the insights from these two cases to address the following research...
conference paper 2016
document
Wu, J. (author), Ning, F. (author), Trinh, T.T. (author), Kjelstrup, S. (author), Vlugt, T.J.H. (author), He, J. (author), Skallerud, B.H. (author), Zhang, Z. (author)
Despite observations of massive methane release and geohazards associated with gas hydrate instability in nature, as well as ductile flow accompanying hydrate dissociation in artificial polycrystalline methane hydrates in the laboratory, the destabilising mechanisms of gas hydrates under deformation and their grain-boundary structures have not...
journal article 2015
document
He, J. (author)
Shanghai, like the other big cities along China’s coastline, has witnessed extraordinary growth in its economy and population with industrial development and rural-to-urban migration generating extensive urban expansion. Shanghai’s GDP growth rate has been over 10 per cent for more than 15 years. Its population in 2013 was estimated at 23.47...
doctoral thesis 2015
document
He, J. (author)
This paper intends to evaluate implementation of Shanghai Master Plan: 2001-2020 (01SHMP), which concerned peripheral development and urban restructuring.
conference paper 2012
Searched for: author%3A%22He%2C+J.%22
(1 - 17 of 17)