C.J.M. Verhoeven
Please Note
22 records found
1
Deep Reinforcement Learning Versus Evolution Strategies
A Comparative Survey
Deep reinforcement learning (DRL) and evolution strategies (ESs) have surpassed human-level control in many sequential decision-making problems, yet many open challenges still exist. To get insights into the strengths and weaknesses of DRL versus ESs, an analysis of their respective capabilities and limitations is provided. After presenting their fundamental concepts and algorithms, a comparison is provided on key aspects, such as scalability, exploration, adaptation to dynamic environments, and multiagent learning. Current research challenges are also discussed, including sample efficiency, exploration versus exploitation, dealing with sparse rewards, and learning to plan. Then, the benefits of hybrid algorithms that combine DRL and ESs are highlighted.
HERMES Radio
Energy and Spectral Efficient Transmitter architectures for small satellites
Lunar Zebro’s mission is heading the race for deploying the world’s smallest and lightest swarm of nanorovers on the surface of Moon. The concept validation of a single nanorover is of crucial importance, as it will be the launching pad for deploying a swarm of those nanorovers thereafter. Then, they will get connected in a network, acting as a single device and performing scientific missions analyzing data from remote points on the Moon’s surface. In the current study, the complete set of thermo-mechanical-radiation analyses for Lunar Zebro nanorovers are carried out. These range from the Ground Segment to the Moon environment, taking also into account the extreme mechanical and thermal environment at launch-transit conditions when the nanorover is attached to the lander. An innovative ray tracing method to evaluate the effect of the thermal environment on the Lunar Zebro nanorovers is explained in this paper. Material choices, structural design, and mechanical/thermal strategies for the nanorover to overcome the launch, space and Moon’s conditions are shown. The different analyses methods used, expected loads and results obtained should serve as a baseline for evaluating the behaviour of other small devices attached to a lander when aiming for any space mission. More specifically, for those aiming to go to the Moon, the environmental and mechanical expectations here can also be implemented. The ultimate outcome of the paper is the environmental survivability assurance from an analytical perspective of these nanorovers when being sent to the Moon. The validation of the survivability of a single nanorover will be a breakthrough in the space swarm robotics’ field, resulting in the successful performance of the lightest swarm of nanorovers ever deployed on the Moon’s surface.
The past two decades have witnessed a renewed interest in low frequency radio astronomy, with a particular focus on frequencies above 30 MHz e.g., LOFAR (LOw Frequency ARray) in the Netherlands and its European extension ILT, the International LOFAR Telescope. However, at frequencies below 30 MHz, Earth-based observations are limited due to a combination of severe ionospheric distortions, almost full reflection of radio waves below 10 MHz, solar eruptions and the radio frequency interference (RFI) of human-made signals. Moreover, there are interesting scientific processes which naturally occur at these low frequencies. A space or Lunar-based ultra-low-frequency (also referred to as ultra-long-wavelength, ULW) radio array would suffer significantly less from these limitations and hence would open up the last, virtually unexplored frequency domain in the electromagnetic spectrum. A roadmap has been initiated by astronomers and researchers in the Netherlands to explore the opportunity of building a swarm of satellites to observe at the frequency band below 30 MHz. This roadmap dubbed Orbiting Low Frequency Antennas for Radio Astronomy (OLFAR), a space-based ultra-low frequency radio telescope that will explore the Universe's so-called dark ages, map the interstellar medium, and study planetary and solar bursts in the solar system and search them in other planetary systems. Such a radio astronomy system will comprise of a swarm of hundreds to thousands of satellites, working together as a single aperture synthesis instrument deployed sufficiently far away from Earth to avoid terrestrial RFI. The OLFAR telescope is a novel and complex system, requiring yet to be proven engineering solutions. Therefore, a number of key technologies are still required to be developed and proven. The first step in this roadmap is the NCLE (Netherlands China Low Frequency Explorer) experiment, which was launched in May 2018 on the Chinese Chang'e 4 mission. The NCLE payload consists of a three monopole antenna system for low frequency observations, from which the first data stream is expected in the second half of 2019, which will provide important feedback for future science and technology opportunities. In this paper, the roadmap towards OLFAR, a brief overview of the science opportunities, and the technological and programmatic challenges of the mission are presented.
This paper discusses some of the solutions to the issue of data congestion in Nano-satellite missions. The complexity of Nano-satellite missions has increased over the years, generating more data than ever and this paradigm shift has in-turn resulted in the need for larger downlink bandwidth requirements. The larger bandwidth's necessity and limited availability of frequency spectrum in lower frequencies spectrum has resulted in the problem of data congestion and invoked the need to investigate the use of mmWave frequency bands for Nano-satellite missions. In this paper, three use cases are discussed to demonstrate the need for using frequency bands higher than X-band and the communication strategy discussed in the use-cases are not restricted to the specific application mentioned in the use-cases but can be extended to similar applications. Irrespective of the frequency bands, there is a need to adapt standards such as DVB.S2 and DVB.S2X (Satellite digital broadcasting standard) that provide spectral efficient modulation schemes. Although these well-established standards are already used in satellite communications, this work proposes further optimization on the modulation schemes that helps improve efficiency of the transmitter front-end. A comparison between 16/32-QAM, 16/32-APSK, 16/32-oAPSK and the proposed 16/32-pAPSK (Polar-filtered Amplitude Phase Shift Keying) modulation schemes are discussed. Some of the practical challenges in using mmWave communications for nano-satellite missions are addressed in this paper with a study on the state-of-the-art mmWave semiconductor technology that are suitable for SSPA (Solid State Power Amplifier) design specifically for nano-satellite missions.
Observations in this frequency bands from Earth are highly challenging as the ionosphere is opaque to these frequency bands. Furthermore, RFI (Radio Frequency Interferences) generated on Earth makes it highly challenging to perform astronomical observations below 30MHz band. The impediments faced by Earth-based or near-Earth-based radio astronomy for these frequency bands is the motivation to perform measurements from the far-side of the moon.
The purpose of using a swarm of nanosatellites to perform low frequency observations is to enable the realization of long observation baselines and additionally, the effective aperture of observation increases with the number of satellites. For the swarm of nanosatellites to operate as a single aperture, it is very important to cross-correlate the information collected by each satellite and this is where the ISL becomes very crucial. Apart from exchanging data collected by the payload, other information such as attitude and timing information needs to be exchanged.
This work derived mission level requirements which would be used to define a suitable communication architecture for space-based radio astronomy missions such as OLFAR. The approach chosen for communication system for such a swarm mission will comprise of two types of ISL: High data-rate directional link that will be used to exchange payload date and low data-rate omni-directional link that will be used to exchange attitude, timing information and be used for localization, positioning and ranging of the nanosatellites in the swarm. This work will present link budgets to show the feasibility of the proposed communication architecture and derive the specs to further design the transceivers. ...
Observations in this frequency bands from Earth are highly challenging as the ionosphere is opaque to these frequency bands. Furthermore, RFI (Radio Frequency Interferences) generated on Earth makes it highly challenging to perform astronomical observations below 30MHz band. The impediments faced by Earth-based or near-Earth-based radio astronomy for these frequency bands is the motivation to perform measurements from the far-side of the moon.
The purpose of using a swarm of nanosatellites to perform low frequency observations is to enable the realization of long observation baselines and additionally, the effective aperture of observation increases with the number of satellites. For the swarm of nanosatellites to operate as a single aperture, it is very important to cross-correlate the information collected by each satellite and this is where the ISL becomes very crucial. Apart from exchanging data collected by the payload, other information such as attitude and timing information needs to be exchanged.
This work derived mission level requirements which would be used to define a suitable communication architecture for space-based radio astronomy missions such as OLFAR. The approach chosen for communication system for such a swarm mission will comprise of two types of ISL: High data-rate directional link that will be used to exchange payload date and low data-rate omni-directional link that will be used to exchange attitude, timing information and be used for localization, positioning and ranging of the nanosatellites in the swarm. This work will present link budgets to show the feasibility of the proposed communication architecture and derive the specs to further design the transceivers.
The frequency range below 30 MHz remains one of the last unexplored frequency ranges in radio astronomy However, Earth-based observations at these wavelengths are severely impeded, due to man-made radio frequency interference (RFI) and atmospheric opacity. To overcome this impediment, various space-based radio astronomy studies have been proposed in the past decade, notably the OLFAR (Orbiting low Frequency Antennas for Radio Astronomy) study, which proposed a satellite swarm for ultra-long wavelength observation. To realize this mission, various technological challenges of a satellite swarm are currently being addressed, particularly antenna design, navigation, communication, distributed processing, and overall system and mission design. Secondly, the RFI levels at various altitudes from Earth is currently unknown, which is a hindrance in general for radio astronomy. To this end, we propose the use of high-altitude ballooning experiments to validate OLFAR sub-systems in pseudo-representative conditions. Furthermore, these ballooning experiments will measure the RFI in the ultra-long wavelength spectrum at various altitudes from Earth. Our project is termed LOBE (Low-frequency observations using high-altitude Balloon Experiments), and in this paper, we present an overview of the science objectives, payload, and the technological and programmatic challenges of the LOBE project.
This paper presents a software-defined testbed to perform hardware-in-The-loop test of miniaturized coherent transponders. Such a setup has been designed to minimize the access threshold for future users, heavily relying on available open source applications and commercial hardware, targeting future coherent transponders for interplanetary CubeSats. The paper presents the overall architecture of the testbed, a tradeoff to select the most suited development framework and the detailed design of the different blocks. Upcoming interplanetary CubeSat missions that would require a coherent transponder are also presented to highlight the need sof such a system. Software qualification, given the use of third-party software with multiple developers, was also addressed to guarantee performances can be consistent and reliable.
A distributed space system (DSS) is an architecture with more than one spacecraft to achieve a common objective. A number of questions arise with respect to the characteristics and dynamics of distributed system in space. How fast is the system spreading? How are the elements within the system distributed? Is it tightly or loosely packed? What is the effect of perturbations on its absolute and relative dynamics? What are the chances of a collision within the system? There has not been much research in these areas concerning a DSS. In this paper, quantitative metrics are established that allow characterizing DSS and assisting in answering above questions.Key performance indicators for a DSS are identified as size or envelope of the cluster, a distribution measure, and a measure for collision. Determining the geometric system size is straightforward through numerical or analytical propagation methods. The focus of this paper will be on the other two metrics: a cluster distribution index (CDI) and a measure for collision probability within the system. The distribution index can be used to assess the effectiveness of DSS in meeting system requirements such as coverage and resolution. An n-dimensional grid-based numerical approach is used to evaluate CDI. The collisions analysis using line-integral method (CALM) is proposed as an effective and efficient approach to analyzing collision probability within DSS. Results show that the CDI is an effective indicator to assess the influence of perturbations, such as differential drag, on spatial distribution of the system. The CALM approach is three orders of magnitude faster than existing approaches that evaluate collision probability for non-linear motion.
New directions
SWANS – Sensor wireless actuator network in space
Multidisciplinary Space Education in a Blended Learning Environment
The New Spaceflight Minor at Delft University of Technology