Hernán Molina

How to Measure and Evaluate Web Applications in a Consistent Way

In the present chapter we analyze the rationale to measure and evaluate software and web applications or products from different perspectives. First, we focus on the process for measurement and evaluation, i.e. the main technical activities that might be planned. Second, we discuss a measurement and evaluation framework that relies on a sound conceptual base. This framework so-called INCAMI (Information Need, Concept model, Attribute, Metric and Indicator) is based on our ontological proposal of metrics and indicators. The underlying hypothesis is that without appropriate recorded metadata of information needs, attributes, metrics and indicators it is difficult to ensure measure and indicator values are repeatable and comparable among organization’s projects. Moreover, analyses and comparisons could be performed in an inconsistent way. Third, in order to illustrate the measurement and evaluation process and framework with specific models and procedures an inspection methodology named WebQEM (Web Quality Evaluation Method) is used. In addition, a case study on the external quality of the shopping cart component of a typical e-commerce website is carried out. Finally, additional discussions about the flexibility of the measurement and evaluation framework as well as concluding remarks are drawn.

Organization-Oriented measurement and evaluation framework for software and web engineering projects

A common challenge faced by many software and Web organizations is to have sound specifications of metrics and indicators metadata, and a clear establishment of measurement and evaluation frameworks and programs. In addition, organizations can succeed in this endeavour if resulting measurements and evaluations are tailored to their information needs for specific purposes, contexts, and user viewpoints. In previous works an ontology for software metrics and indicators was specified based as much as possible on the concepts of specific ISO standards. In this paper, we discuss a measurement and evaluation framework so-called INCAMI (Information Need, Concept model, Attribute, Metric and Indicator), which is based on that ontology. We argue this framework can be more robust and well-established than the GQM (Goal-Question-Metric) paradigm for measurement and evaluation purposes. Finally, an example is presented and the strengths and weaknesses of this framework compared with others are analysed as well.

Assessing Web Applications Consistently: A Context Information Approach

In order to assess Web applications in a more consistent way we have to deal not only with non-functional requirement specification, measurement and evaluation (M&E) information but also with the context information about the evaluation project. When organizations record the collected data from M&E projects, the context information is very often neglected. This can jeopardize the validity of comparisons among similar evaluation projects. We highlight this concern by introducing a quality in use assessment scenario. Then, we propose a solution by representing the context information as a new add-in to the INCAMI M&E framework. Finally, we show how context information can improve Web application evaluations, particularly, data analysis and recommendation processes.

Towards the Support of Contextual Information to a Measurement and Evaluation Framework

A framework that precisely defines the information used in measurement and evaluation activities in an organizations software projects can provide more consistent and comparable solutions. Nevertheless, differences in the context, determined by each particular project, could affect the coherence and comparison among results. In this paper, the importance of using context information in measurement and evaluation activities in software projects is discussed. Also, we propose a model and a strategy for representing and using context information to the measurement and evaluation framework so-called INCAMI, in order to assist in the recommendation of design solutions and in the interpretation of results.

Context-Based Recommendation Approach for Measurement and Evaluation Projects

Data, information and knowledge are recognized as useful assets for analysis, recommendation and decision making at any business level of an organization. Providing the right information for decision making considering different user-requirements, projects and situations is, however, a difficult issue. A frequently-neglected challenge is to cope with the influence of contextual issues affecting the success of outcomes and decisions. Particularly, when conducting quality evaluations in software organizations, it is of paramount importance to identify beforehand the contextual issues affecting outcomes and interpretations for measurement and evaluation projects. Therefore, the relevant context information should be clearly identified, specified and recorded for performing more robust analysis and recommendations. In this work, a domain-independent context model and a mechanism to integrate it to any application domain is presented. The context model is built upon a measurement and evaluation framework enabling quantification and semantic capabilities. The context model is then integrated in the mentioned framework itself to enable recommendations in meas- urement and evaluation projects.

Measurement and evaluation as a quality driver

Quality assurance, and particularly, measurement, evaluation and analysis are support processes to the main engineering processes. In this manuscript we present an integrated strategy whose rationale is supported by a well-defined measurement and evaluation process, a conceptual framework that relies on an ontological base, and quality evaluation methods and tools instantiated from both the framework and process. Particularly, we focus on some measurement and evaluation process views for specifying project context, nonfunctional requirements, measurement, evaluation and analysis. Finally, a discussion about the benefits of having an integrated approach as quality driver for software and web projects is drawn.