Högskolan i Skövde

This paper presents a mixed evaluation design including quantitative and qualitative datain order to validate the scope, validity, and reliability of a recently developed CLAM method and tool. A central part of the evaluation was the use of a modified pluralistic walkthroughthat was created to better suit the industrial domain. The evaluation of CLAM was performed in a demonstration factory focusing on manufacturing of street scooters and electric pedal cars. The modified walkthrough was conducted on the shop floor, during on-going assembly, which stresses the representativeness of a real-world setting of manufacturing. The modified pluralistic walkthrough functioned accurately as an evaluation method of CLAM and the exhaustive comments and data from the user representatives were very beneficial. The quantitative results show convicting evidence of CLAM’s utility for assessing cognitive load while the qualitative results indicate that some modifications have to be made in order to enhance the actual tool in order to avoid misinterpretations resulting in misleading outcomes.