Jon Olav Hauglid

DYFRAM: dynamic fragmentation and replica management in distributed database systems

In distributed database systems, tables are frequently fragmented and replicated over a number of sites in order to reduce network communication costs. How to fragment, when to replicate and how to allocate the fragments to the sites are challenging problems that has previously been solved either by static fragmentation, replication and allocation, or based on a priori query analysis. Many emerging applications of distributed database systems generate very dynamic workloads with frequent changes in access patterns from different sites. In such contexts, continuous refragmentation and reallocation can significantly improve performance. In this paper we present DYFRAM, a decentralized approach for dynamic table fragmentation and allocation in distributed database systems based on observation of the access patterns of sites to tables. The approach performs fragmentation, replication, and reallocation based on recent access history, aiming at maximizing the number of local accesses compared to accesses from remote sites. We show through simulations and experiments on the DASCOSA distributed database system that the approach significantly reduces communication costs for typical access patterns, thus demonstrating the feasibility of our approach.

Savanta--search, analysis, visualisation and navigation of temporal annotations

In this article, we present Savanta, an information gathering interface for temporal, semantic video annotations. In Savanta, we integrate various methods and paradigms for information gathering, including visualisation, filtering, data mining, navigation and search, in order to explore the possible advantages of doing so. We posit that a seamless integration of multiple access methods, combined with an improved interval visualisation scheme and dynamically generated metadata, will result in greater user satisfaction compared to conventional approaches for searching and querying video databases—despite the increased complexity that may result. We perform a formal usability evaluation comparing Savanta to systems based on traditional search/query paradigms, and conclude that Savanta outperforms them with regard to both power and usability, especially for complex and open-ended tasks.

PROQID: partial restarts of queries in distributed databases

In a number of application areas, distributed database systems can be used to provide persistent storage of data while providing efficient access for both local and remote data. With an increasing number of sites (computers) involved in a query, the probability of failure at query time increases. Recovery has previously only focused on database updates while query failures have been handled by complete restart of the query. This technique is not always applicable in the context of large queries and queries with deadlines. In this paper we present an approach for partial restart of queries that incurs minimal extra network traffic during query recovery. Based on results from experiments on an implementation of the partial restart technique in a distributed database system, we demonstrate its applicability and significant reduction of query cost in the presence of failures.

Efficient and Robust Database Support for Data-Intensive Applications in Dynamic Environments

Requirements from new types of applications call for new database system solutions. Computational science applications performing distributed computations on Grid networks with requirements for efficient storage and query solutions are now emerging. For this purpose we have developed DASCOSA-DB, a P2P-based distributed database system, which in addition to providing location-transparent storage and querying, also includes novel features like efficient partial restartof queries and redistribution of query operators in the context of failure, dynamic refragmentation and allocation, and distributed semantic caching. In this demo, the novel features will be demonstrated, combined with a more general description of the architecture and demonstration of the distributed query processing capabilities.

WebSTAR: video database on WWW

In this paper we present the WebSTAR system, which is a prototype of a video database on the World Wide Web. The WebSTAR system allows owners of video material to make their video available on the Internet together with suitable metadata descriptions. Through ordinary web browser, users on the Internet can search, browse and play back the available video material on their computer screen. Users who want a deeper understanding of the contents of the video can have the relevant metadata visualized in synchronicity with the video playback.

SESAM: searching supported by analysis of metadata

This paper presents a novel approach for database searching where the user is assisted in locating relevant objects in query results. This is made possible by an active user interface which asks the user dynamically generated questions based on collected information of the properties of the objects in the result. The answers to these questions are used to retain only objects with the indicated properties, thereby improving precision. SESAM, a World Wide Web-based prototype based on this approach, is presented. It has been successfully tested using a large, real-life database.

Site-autonomous distributed semantic caching

Semantic caching augments cached data with a semantic description of the data. These semantic descriptions can be used to improve execution time for similar queries by retrieving some data from cache and issuing a remainder query for the rest. This is an improvement over traditional page caching, since caches are no longer limited to only base tables but are extended to contain intermediate results. In large-scale distributed database systems, using a central server with complete knowledge of the system will be a serious bottleneck and single point of failure. In this paper, we propose a distributed semantic caching method where sites make autonomous caching decisions based on locally available information, thereby reducing the need for centralized control. We implement the method in the DASCOSA-DB distributed database system prototype and use this implementation to do experiments that show the applicability and efficiency of our approach. Our evaluation shows that execution times for queries with similar subqueries are significantly reduced and that overhead caused by cache management is marginal.

The DASCOSA-DB Grid Database System

Computational science applications performing distributed computations using grid networks are now emerging. These applications have new and demanding requirements for efficient query processing. To meet these requirements, we have developed the DASCOSA-DB distributed database system. In this chapter, a detailed overview of the architecture and implementation of DASCOSA-DB is given, as well as a description of novel features developed to better support typical data-intensive applications running on a grid system: fault-tolerant query processing, dynamic refragmentation, allocation and replication of data fragments, and distributed semantic caching.