Methods for group evaluations

When the focus of the user experience study is on social aspects, it is interesting to study participants as a group instead of single participants.

Attrak-Work questionnaire

Questionnaire for evaluating UX of mobile news journalism systes. Based on AttrakDiff but elaborated for the context.

Group-based expert walkthrough

It is a scenario based usability inspection method, aiming to identify usability-problems, possible design improvements and successful/good design solutions in a given user interface. The evaluations are conducted as group usability inspections and require no previous training of the evaluators. Thus the method supports evaluators not accustomed to usability inspections. The group-based expert walkthrough is particularly suited for early evaluations of applications specific to a particular work domain. The method is grounded on the assumption that usability-problems and possible design improvements identified by work-domain experts utilized as evaluators had far higher impact on the subsequent development processes than these identified by usability-experts. Combined with other methods, such as probing material it goes beyond the usability aspect and collects UX issues.

Kansei Engineering Software

The software follows the Kansei Engineering procedure suggested by Schütte (2006). {Additional info: Kansei Engineering is a method for translating feelings and impressions into product parameters. The method was invented in the 1970ies by Prof. Nagamachi at Kure University (now Hiroshima International University). Prof. Nagamachi recognized that companies often want to quantify the customer's impression of their products. Kansei Engineering can "measure" the feelings and shows the correlation to certain product properties. In consequence products can be designed in a way, which responds the intended feeling. Source:

It uses techniques such as Semantic differential technique (Osgood, 1957) and the Quantification Theory Type I (Komazawa and Hajashi, 1976)

Living Lab Method

Living labs presents a research methodology for sensing, prototyping, evaluating and refining complex solutions in multiple and evolving real life contexts. Living Lab is aiming to create and evaluate in collaborative multi-contextual empirical real-world environment.

OPOS – Outdoor Play Observation Scheme

Method is used to evaluate children's experience in outdoor pervasive gaming.

Product Personality Assignment

Participants are given a selection of product designs and a questionnaire of different personalities that they assign to designs (list of Briggs-Myers, e.g. "sensible", "friendly"). They are also asked about the reasons for the selections.

Product Semantic Analysis (PSA)

A semantic scale that is built for each evaluation case separately via user interviews and by using product semantics as the theoretical basis.

Resonance testing

Resonance testing is a method to validate product concepts againts a set of experiential goals. It is primarily intended for use with physical products