On distributing load in cloud computing: A real application for very-large image datasets

Abstract

Managing large image collections has become an important issue for information companies and institutions. We present a cloud computing service and its application for the storage and analysis of very-large images. This service has been implemented using multiple distributed and collaborative agents. For image storage and analysis, a regionoriented data structure is utilized, which allows storing and describing image regions using low-level descriptors. Different types of structural relationships between regions are also taken into account. A distinctive goal of this work is that data operations are adapted for working in a distributed mode. This allows that an input image can be divided into different sub-images that can be stored and processed separately by different agents in the system, facilitating processing very-large images in a parallel manner. A key aspect to decrease processing time for parallelized tasks is the use of an appropriate load balancer to distribute and assign tasks to agents with less workload.