Henrik Thostrup Jensen

Henrik Thostrup Jensen

Aalborg University

The Taiga Storage System

Taiga is (yet another) grid storage system intended for storing files. On the primary focus areas is retaining consistency in the system as a whole. The system is modelled using REST (i.e., not Web Services), and uses REST methods to ensure consistency. Furthermore REST is used to replace common proxy delegation, with a simple, yet fine-grained system for secure access. The system uses HTTP and SSL as protocol foundation. Since these technologie are very common it is easy to create clients or in other way interface to the system.

Taiga provides three services: Metadata catalog, storage, and transfer. These services can be combined into a decentralized highly available system or to a rather simple storage system. The metadata catalog service can host several collections for different users, and hence places metadata in the same legue as files, i.e., something everyone can create. The storage service provides an abstraction called to spaces to easy administration for both local adminstrations and file owners. A transfer services is always co-located with a storage service, and can only pull files. While this model may seem restrictive, it means the local transfer policies can easily be adhered to, and efficient scheduling can be done.

Download presentation

storage.pdf

Biography

Ph.d. student in Grid Computing at Aalborg University. Currently working with data management. Interested in consistency issues from a system perspective, availability, and the possibilities in combining REST with Grid. Have previously worked with job management for the ARC middleware.