Resolving Strategies for A Serverless ComputingService Timeout Limitation

With the fast maturing of cloud-based technologies, a variety of cloud services proposed by numerous cloud service vendors to help businesses in a range of scales move to cloud solutions easily. In the cloud computing market, the services are categorized with different service models. Each service model has its own distinct characteristics,...

Large Scale In-Database Machine Learning Using Cloud Native Workflows

During the last decade, the proliferation of smartphones, social media and streaming services has provoked an explosion of multimedia data. This large amount of image and video sources combined with more powerful and inexpensive computational capabilities brought by the cloud computing paradigm has facilitated the rapid growth of new machine...

A Cloud-Based DevOps Toolchain for Efficient Software Development

In the traditional software development life cycle, development and operation are divided into different departments. The conflict between departments and, besides, the lack of automation usually leads to low software development efficiency and slow software delivery. Thus, the concept of DevOps is introduced, which combines different...

Analysis of a Data Processing Pipeline for Generating Knowledge Graphs from Unstructured Data: Data Processing Pipeline for Knowledge Graphs

With the rapid growth of unstructured data across different mediums, it exposes new challenges for its analysis. To overcome this, data processing pipelines are designed with the help of different tools and technologies for the analysis of data at different stages. One of the applications which we find useful for our company is the creation of...

Autonomous Exploration by Cooperative Robots

Imagine being lost in a desert with a bunch of friends, all of a sudden. Survival will be difficult. You will have mirages, distrust among friends and no means to leave landmarks on the sand. Unable to locate yourself, you will have no means to contact people with maps. The best you can do in such a situation is to stay together in the vicinity...

Mounting External Storage in HopsFS

A desirable feature of distributed file systems is to enable clients to mount<br/>external namespaces, allowing them to access physically remote data as if it was<br/>transparently stored in the local cluster. This feature is desirable in a variety of<br/>scenarios, such as in enterprise hybrid-cloud deployments, where some data may be stored...

Stream Processing System for Product Quality Prediction using Sensor data: Distributed data Processing

Improving the Performance of the Variant Calling Workflow for DNA Sequencing

The growing DNA data volumes that originate from novel efficient DNA sequencing methods expose new challenges to computer systems used to process this genomic data. BigData technologies in the Hadoop environment, in particular Apache Spark and the Hadoop Distributed File System (HDFS), are increasingly adapted in state-of-the-art Bioinformatic...

Scheduling the Spark Framework under the Mesos Resource Manager

Using clusters of servers and datacenters to process large numbers of data- and computation-intensive jobs is becoming mainstream. The need for large clusters is driven by the fact that many workloads are growing at a faster rate than the advances in single computer performance. To manage processing in a cluster of multiple computers, several...

Performance Evaluation of Distributed SQL Query Engines and Query Time Predictors

With the decrease in cost of storage and computation of public clouds, even small and medium enterprises (SMEs) are able to process large amounts of data. This causes businesses to increase the amounts of data they collect, to sizes that are difficult for traditional database management systems to handle. Distributed SQL Query Engines (DSQEs),...

KOALA-C: A Scheduler for Integrated Multi-Cluster and Multi-Cloud Environments

In this work, we propose the design of KOALA-C, a task scheduling system that can operate in integrated multi-cluster and multi-cloud environments based on two previous work: KOALA and SkyMark. We design and evaluate a number of task allocation and resource provisioning policies through both simulations and real-world experiments using KOALA-C.

A workload model for MapReduce

MapReduce is a parallel programming model used by Cloud service providers for data mining. To be able to enhance existing and to develop new MapReduce sys- tems, we need to evaluate the performance of these systems. To this end we intro- duce in this work the Cloud Workloads Archive Toolbox. This toolbox facilitates the analysis of MapReduce...

Tribler-G: A Decentralized Social Network for Playing Chess Online

There are currently many systems that offer online board games, for instance, social networking sites, where board games enjoy enormous popularity, but also systems such as the Internet Chess Club, which has been around for over a decade. However, these systems are all centralized and typically have drawbacks for the user, such as subscription...

Adding Cycle Scavenging Support to the Koala Grid Resource Manager

Cycle scavenging (CS) is the process of using otherwise idle computational resources to provide large, aggregate, amounts of computational power. It is the core principle of so-called desktop grids and volunteer computing, which use the idle cycles of desktop computers to do computations. However, resources in a multicluster grid likewise may...

Trace-based performance analysis of scheduling bags of tasks in grids

Grid computing promises large scale computing facilities based on distributed systems. Much research has been done on the subject of increasing the performance of grids. We believe that an adequate performance analysis of grids requires knowledge of the workload and the architecture of the grid. Currently, researchers assume that grids are...

Performance Analysis of Chainsaw-based Live P2P Video Streaming

Due to the growing popularity of viewing media over the Internet, content servers are suffering from more and more stress every day. This problem is traditionally solved by enhancing the server infrastructure at the content provider, which is effective but also costly. A more cost effective solution would be to use P2P technology to distribute...

Reducing Free Riding in Peer-to-Peer Systems with Supervised Teaming

Peer-to-peer technology has produced thriving communities in which peers contribute bandwidth to each other. However, when free riding occurs, these communities will not be able to sustain themselves without incentives to enforce this contribution. This thesis presents Supervised Teaming, a peer-to-peer transfer protocol that gives uploading...