A gateway-based framework for data interoperation between grids

A data-gateway, a gateway-based framework, is proposed to solve the problems in grid data interoperation, such as heterogeneous storage resources, different job requirements, and numerous failures. The data-gateway is a professional solver for data interoperation that can make the data interoperation as an independent and general modular separated from job inter-operation, and promote parallel processing of the interoperation tasks. A job description language based on ClassAD is introduced in the data-gateway, which can provide a very flexible and extensible data model, and can be used to describe arbitrary services and constraints, as well as the scale mechanism in a plug-in style so that the scalability of the data-gateway for heterogeneous storage resources is improved well. Dynamic protocol selecting mechanism and failure recovering mechanism used in the date-gateway can provide a nice environment like failure-free network and storage devices, and enhance the system's availability. Experiment results show that the data-gateway can implement data interoperation between heterogeneous grid infrastructures rapidly, recover failures automatically without any human interaction, and complete all kinds of data interoperation tasks efficiently.