Michael O. Jewell

Linked Data and You: Bringing Music Research Software into the Semantic Web

Abstract The promise of the Semantic Web is to democratize access to data, allowing anyone to make use of and contribute back to the global store of knowledge. Within the scope of the OMRAS2 Music Information Retrieval project, we have made use of and contributed to Semantic Web technologies for purposes ranging from the publication of music recording metadata to the online dissemination of results from audio analysis algorithms. In this paper, we assess the extent to which our tools and frameworks can assist in research and facilitate distributed work among audio and music researchers, and enumerate and motivate further steps to improve collaborative efforts in music informatics using the Semantic Web. To this end, we review some of the tools developed by the OMRAS2 project, examine the extent to which our work reflects the Semantic Web paradigm, and discuss some of the remaining work needed to fulfil the promise of online music informatics research.

Canyons, deltas and plains: towards a unified sculptural model of location-based hypertext

With the growing ubiquity of mobile devices, new ways of sensing context and the emergence of the mobile Web, digital storytelling is escaping the confines of the desktop and intertwinging in new and interesting ways with the physical world. Mobile, location aware, narrative systems are being applied to a range of areas including tour guides, educational tools and interactive fiction. Despite this there is little understanding of how these applications are related or how they link with existing hypertext models and theory. We argue that location aware narrative systems tend to follow three patterns (canyons, deltas and plains) and that it is possible to represent all of these patterns in a conceptual sculptural hypertext model. Our model builds on a general sculptural mechansim (of pre-conditions and behaviours) to include locality and narrative transitions as first class elements, opening the possibility of standardised viewers, formats, and hybrid stories. We show how existing structures can be mapped onto this conceptual sculptural model, and how narratives defined in the model can take advantage of open data sources and sensed contextual data. To demonstrate this we present the GeoYarn system, a prototype which implements the model to create interactive, location aware narratives, using all three patterns.

Understanding Energy Consumption at Work: Learning from Arrow Hill

Most work around technological interventions for energy conservation to date has focussed on changing individual behaviour. Hence, there is limited understanding of communal settings, such as office environments, as sites for intervention. Even when energy consumption in the workplace has been considered, the emphasis has typically been on the individual. To address this gap, we conducted a study of energy consumption and management in one workplace, based on a combination of workshops with a broad range of stakeholders, and quantitative data inspections. We report and discuss findings from this study, in light of prior literature, and we present a set of implications for design and further research. In particular, three themes, and associated intervention opportunities, emerged from our data: (1) energy wastage related to “errors”; (2) the role of company policies and the negotiation that surrounds their implementation; and (3) the bigger energy picture of procurement, construction and travel.

CBS: a concept-based sequencer for soundtrack composition

Existing methods of music composition vary from probability-based techniques to grammatical generation methods, yet the majority focus on the creation of independent pieces with no ties to other media. Our concept-based sequencer (CBS) aims to use semantic markup of temporal media in combination with genetic algorithms to generate music that can fit scripted content such as film and radio. Genetic algorithms offer an evolutionary approach, which allows mutation but within a specified context. The concept here allows for linkage between media. We describe the techniques behind the CBS, and the construction of a Web-based repository for concept mappings.

Connecting the things to the internet: an evaluation of four configuration strategies for wi-fi devices with minimal user interfaces

The availability of low-power Wi-Fi radio modules opens up opportunities to leverage the existing prevalent Wi-Fi infrastructure for large-scale trials and deployments of Ubicomp technology. In this paper we address the challenge of supporting end-users, especially when they are not technical experts, in connecting new low-power, low-cost Wi-Fi devices with very minimal UIs to an existing, secure Wi-Fi infrastructure. We report two usability studies through which 30 participants, with no formal technical training, compared 4 alternative configuration techniques, selected based on cost and consumption constraints, and on adoption in off-the-shelf products. Through an analysis of success rate and causes of failure, our results indicate that two techniques are noticeably more usable than others. These are a web-based configuration mechanism, where users connect to an access point on the Wi-Fi device, and one that makes use of a standard audio cable to connect a smartphone to the device to be configured.

A distributed approach to musical composition

Current techniques for automated composition use a single algorithm, focusing on one aspect of musical generation. In our system we make use of several algorithms, distributed using an agent oriented middleware, with each specialising on a separate aspect of composition. This paper describes the architecture and algorithms behind this system, with a focus on the agent framework used for implementation. We show early results which encourage a future application of this framework in automated music composition and analysis.

A middleware for a large array of cameras

Large arrays of cameras are increasingly being employed for producing high quality image sequences needed for motion analysis research. This leads to the logistical problem with coordination and control of a large number of cameras. In this paper, we used a lightweight multi-agent system for coordinating such camera arrays. The agent framework provides more than a remote sensor access API. It allows reconfigurable and transparent access to cameras, as well as software agents capable of intelligent processing. Furthermore, it eases maintenance by encouraging code reuse. Additionally, our agent system includes an automatic discovery mechanism at startup, and multiple language bindings. Performance tests showed the lightweight nature of the framework while validating its correctness and scalability. Two different camera agents were implemented to provide access to a large array of distributed cameras. Correct operation of these camera agents was confirmed via several image processing agents.

The narrative braid: a model for tackling the narrative paradox in adaptive documentaries

The Narrative Paradox is a theory that describes interaction and narrative cohesion as being in tension, and asserts that the structure of a narrative is disrupted by user adaptivity, leading to possible incoherence as the system accounts for interaction. We propose an approach that may reduce this disruption. Specifically, we propose to model a narrative as a collection of threads, woven together into the final discourse as a narrative braid. By separately maintaining logical coherence within a thread and thematic coherence between threads we believe it is possible to introduce interactivity while maintaining a strong narrative structure. We discuss how this may be applied to adaptive documentaries which, with a wide base of recorded material and diverse plot threads, provide a rich medium for initial experimentation in this area.

The xeros data model: tracking interpretations of archaeological finds

At an archaeological dig, interpretations are built around discovered artifacts based on measurements and informed intuition. These interpretations are semi-structured and organic, yet existing tools do not capture their creation or evolution. Patina of Notes (PoN) is an application designed to tackle this, and is underpinned by the Xeros data model. Xeros is a graph structure and a set of operations that can deal with the addition, edition, and removal of interpretations. This data model is a specialisation of the W3C PROV provenance data model, tracking the evolution of interpretations. The model is presented, with operations defined formally, and characteristics of the representation that are beneficial to implementations are discussed.

Digital energy visualizations in the workplace: the e-Genie tool

ABSTRACT Building management systems are designed for energy managers; there are few energy-feedback systems designed to engage staff. A tool, known as e-Genie, was created with the purpose of engaging workplace occupants with energy data and supporting them to take action to reduce energy use. Building on research insights within the field, e-Genie’s novel approach encourages users to make plans to meet energy-saving goals, supports discussion and considers social energy behaviours (e.g. discussing energy issues, taking part in campaigns) as well as individual actions. A field-based study of e-Genie indicated that visualizations of energy data were engaging and that the discussion ‘Pinboard’ was particularly popular. Pre- and post-survey (N = 77) evaluation of users indicated that people were significantly more concerned about energy issues and reported engaging more in social energy behaviour after about two weeks of e-Genie being installed. Concurrently, objective measures of electricity use decreased over the same period, and continued decreasing over subsequent weeks. Indications are that occupant-facing energy-feedback visualizations can be successful in reducing energy use in the workplace; furthermore, supporting social energy behaviour in the workplace is likely to be a useful direction for promoting action.