An integrated resource management and scheduling system for grid data streaming applications

Abstract

Grid data streaming applications are novel from others in that they require real-time data supply while the processing is going on, which necessitates harmonious collaborations among processors, bandwidth and storage. Traditional scheduling approaches may not be sufficient for such applications, for they usually focus on only one aspect of resources, mainly computational resources. A resource management and scheduling system for such applications is developed in this paper, which is responsible for enabling their running based on Globus toolkit. An integrated scheme is proposed, including admission control, application selecting, processor assigning, allocation of bandwidth and storage, with corresponding algorithms elaborated. Evaluation results show excellent performance and scalability of this system.