Noris Mohd Norowi

Artificial Immune Recognition System with Nonlinear Resource Allocation Method and Application to Traditional Malay Music Genre Classification

Artificial Immune Recognition System (AIRS) has shown an effective performance on several machine learning problems. In this study, the resource allocation method of AIRS was changed with a nonlinear method. This new algorithm, AIRS with nonlinear resource allocation method, was used as a classifier in Traditional Malay Music (TMM) genre classification. Music genre classification has a great important role in music information retrieval systems nowadays. The proposed system consists of three stages: feature extraction, feature selection and finally using proposed algorithm as a classifier. Based on results of conducted experiments, the obtained classification accuracy of proposed system is 88.6 % using 10 fold cross validation for TMM genre classification. The results also show that AIRS with nonlinear allocation method obtains maximum classification accuracy for TMM genre classification.

Order dependent feature selection in Concatenative Sound Synthesis using Analytical Hierarchy Process

Advancement in computing has opened up the possibility of mechanizing the process of music creation. Through Concatenative Sound Synthesis, best matched segments between target and source sounds are found and synthesized. Factors that affect the distance of the match, such as the order and weight of the features are examined and presented here. A robust algorithm to automatically assign consistent weights to all features through the use of Analytic Hierarchy Process is also designed and described.

A User-Defined Gesture Set for Music Interaction in Immersive Virtual Environment

In recent years, hand-tracking technologies had been implemented in Virtual Reality application, allowing users to use natural hand gesture for interaction within the environment. However, little efforts have been conducted in understanding users preference when they use their hands to interact with the VR world. In this paper, the result of a guessability test for hand gestures in order to operate musical tasks to support music interaction within immersive Virtual Environment. A total number of 750 gestures have been elicited from 15 participants for 50 selected tasks, including 10 musical tasks. Our result enables a smaller size of gesture set to be elicited from the users. The implications of this work can be relevant in hand gesture design, gesture interaction, and gestural interfaces design for music interaction, all of which are highlighted in this study.

A review on gesture recognition technology in children's interactive storybook

Over the past few years, gesture recognition has made its debut in education and virtual reality environment. This paper reviews the current literature in gesture recognition technology for interactive storybooks and the existing methods and challenges for this technology. A conceptual framework is proposed to resolve two main challenges that have been reviewed from previous work: to provide a novel interaction to young children and to ensure accuracy of gesture when using gesture based input sensor. The proposed method is the future work which provides the direction towards developing virtual reality storybooks for children.

Calibration on Co-located Ad-Hoc Multi Mobile System

This paper presents findings about connectivity issues when using clock wise swipe gesture of mobiTop system. The mobiTop system is a multi-mobile system that allows users to come together at any location and perform collaborative tasks and information sharing by extending their mobile devices. This study investigates the user experience issues when multiple users calibrate and align multiple mobile devices using the mobiTop system. From the study, users took an average of 5.47 minutes to initiate connections between multiple devices. The finding shows that the existing calibration setting is too complicated for the users despite the step-by-step tutorial provided by the system. The findings also show that although only one user is needed to initiate to connectivity, most of the users tend to contribute towards simultaneous connectivity input leading to system disorientation. Following this, several connectivity methods explored that can be employed by the mobiTop system to minimize connectivity time and promote a seamless integration between the users and the system.

MobiTop: Interactivity Issues in a Multi-Mobile System

Mobile devices are increasingly becoming an important part of technology. As the demand for handling information grows, so does the need for collaboration in integrating and managing multiple forms of information. With its small screen, it is relatively uncomfortable for a group of people to perform task collaboratively. This paper presents MobiTop - a multi-mobile system that integrates mobile devices that works seamlessly together -- promoting an extended screen size for the mobile devices to support collaboration. However, interactivity issues such as bezels and screen orientation are found to restrict users from performing collaborative tasks favourably. This paper discusses the interactivity issues pertaining multi-mobile systems and offers guidelines for designers.

A Comparison of Gestural and Touch-Based Interface for Designing a Virtual Percussion Instrument

The paper presents an exploratory study to design a new virtual musical instrument for Kompang, using the natural hand for interaction purpose. The study first explores the potential technologies that are low-cost, easy to access and most importantly, these technologies use hand-based interaction. Two input devices that fulfil these requirements are selected, and then developed as low-fidelity interfaces. A study was conducted to identify which interface was preferable by the user for future development. A set of design criteria was also identified at the end of study for development of a virtual Kompang instrument.

Informing Technological Enhancements Through Art: Practitioners’ Perspectives and Reflection

In this paper, we reflect on our experience, and outline our design process in using an app, which is freely available on mobile app stores, called Artcodes that reads custom-made markers in an artwork, and with markers made using temporary tattoos. Artcodes was used previously with permanent markers drawn on objects. However, our application of Artcodes is different from previous work because we used moveable markers and used markers on human skin. By appropriating Artcodes for our artwork and temporary tattoos, we suggest that, in the future, Artcodes algorithm may be improved to differentiate between shadows, wrinkles and lines if it were to be used in other settings involving human skins as to create a more embedded experience.

Designing A Virtual Empowerment Mobile App for the Blinds

The Virtual Empowerment App for the Blinds is an empowerment mobile application for the blind. It is developed based on the modules of the existing Latihan Maya Kejayaan Orang Kurang Upaya app, which was intended to empower persons with physical disabilities. As the requirements of persons with physical disabilities greatly differ from that of vision disabilities, this study aims to develop an app that would help blind users to navigate the module of Latihan Maya Kejayaan OKU by themselves based on the requirements observed from the blind users. An interface design to develop a functional and practical app for the blinds is proposed. A comparison between different gesture platforms was also compared. Three tests were conducted, namely the preliminary testing, pilot testing and final testing to analyze the interaction of users when using the app. Results suggested that the extended app developed based on the design proposed in this study were easily navigated and adapted by persons with vision disabilities.

Designing a Natural Musical Interface for a Virtual Musical Kompang using User-Centered Approach

A plethora of music related application can be found on mobile device platform. Therefore, the development of appropriate application using proper system design approach becomes crucial. The paper presents a study to design natural musical interface for the Kompang instrument, which use hand touch as interaction input. Based on User-Centered Design (UCD) approach, a low-fidelity prototype with four interface designs was developed for users to choose the most suitable one according to their preference. High-fidelity prototype was developed based on opinion captured during test on low-fidelity prototype. Result showed that the developed application gained good responses from users in terms of effectiveness, efficiency and satisfaction.