Evaluating Large Language Model Performance on User and Language Defined Elements in Code

Large Language Models of code have seen significant jumps in performance recently. However, these jumps tend to accompany a notable and perhaps concerning increase in scale and costs. We contribute an evaluation of prediction performance with respect to model size by assessing the layer-wise progression for language and user-defined elements in...

Proposal of Metrics to Visualise Performance of Prognostics Case Studies in Aerospace

With the increasing availability of sensor data to monitor the health of systems and components, maintenance is encountering a shift from the traditional preventive and corrective methodologies to a predictive approach. Given that maintenance, repair and overhaul are a significant operational cost to organizations, it is imperative that the...

Benchmarking Distributed Database Performance and Dependability under Partial System Failures

Many types of database management systems exist, but finding the one that is right for a specific use case is becoming increasingly more difficult. Benchmarks allow one to compare various systems, but in a world where distributed DBMSs are increasingly used for mission critical purposes, we find most existing benchmarks neglect fault tolerance...

Decision support tool for performance evaluation of urban transshipment networks with electric freight vehicles in low emission zone

Urban transshipment network is a transshipment solution for last-mile distribution in dense metropolitan regions. In this network, a set of micro hubs located in the urban areas are used for deconsolidating shipments and transferring them from high capacity vehicles to light freight vehicles that eventually deliver to customer locations. Due to...

Performance evaluation of the crumb rubber modified bitumen containing warm-mix additives

The crumb rubber modified bitumen (CRMB) has been utilized in pavement industries to mainly reduce the environmental impacts of the wasted tires by turning unwanted scrap tires into new bituminous materials. However, the relatively high viscosity compared to the conventional asphalt is the major drawback of the CRMB. The higher mixing and...

Workload Characterization and Modeling, and the Design and Evaluation of Cache Policies for Big Data Storage Workloads in the Cloud

The proliferation of big-data processing platforms has already led to radically different system designs, such as MapReduce and the newer Spark. Understanding the workloads of such systems enables tuning and could foster new designs. However, whereas MapReduce workloads have been characterized extensively, relatively little public knowledge...

Optimal traffic light control: performance evaluation applying a general evaluation methodology

The ongoing increase in urbanization and traffic congestion creates an urgent need to operate our transportation systems with maximum efficiency. Traffic signal control optimization is considered one of the main ways to solve traffic problems in urban networks. In publications in the field of intelligent transportation systems, a vast amount of...

Performance evaluation of the RYSEN: a 3D overground body weight support system

Body weight support (BWS) systems are widely used in gait rehabilitation. These systems allow patients to gradually increase training intensity and promote independent walking. Currently, there is no standardized method to assess the performance of BWS systems. This work proposes methods and metrics that can be used to assess and compare any...

Performance Evaluation of a Software-Defined Wireless Sensor Network

Software-Defined Networking (SDN) potentially can improve the flexibility and management of Wireless Sensor Networks (WSNs). To investigate the impact of SDN on WSN, in this thesis, we consider three Software-Defined Wireless Sensor Network (SD-WSN) frameworks, namely SDN-WISE, SDWN-ONOS, and TinySDN. After comparing these frameworks, the...

Fine-grained Performance Evaluation of Large-scale Graph Processing Systems

In the age of information our society generates data at an increasing and already alarming rate. To keep up with the rapid increase in the amount of available data, the academics have shown strong interests in the emerging research field of Big Data Processing (BDP), which explores technologies aiming at efficient processing of enormous amounts...

Performance Evaluation of Distributed SQL Query Engines and Query Time Predictors

With the decrease in cost of storage and computation of public clouds, even small and medium enterprises (SMEs) are able to process large amounts of data. This causes businesses to increase the amounts of data they collect, to sizes that are difficult for traditional database management systems to handle. Distributed SQL Query Engines (DSQEs),...