טכניון מכון טכנולוגי לישראל
הטכניון מכון טכנולוגי לישראל - בית הספר ללימודי מוסמכים  
M.Sc Thesis
M.Sc StudentGad-Nomberg Danit
SubjectDesigning a Tool for LMS Quality Evaluation For the
Technion
DepartmentDepartment of Quality Assurance and Reliability
Supervisors Dr. Daniel Galin
Dr. Avigail Barzilai
Full Thesis text - in Hebrew Full thesis text - Hebrew Version


Abstract

Moodle Learning Management System (LMS) is a distance learning system used in the Technion as a pedagogical and academic tool employed to assist faculty members in developing and maintaining courses, and to assist students in their studies. Implementation project of LMS in an academic institution is very extensive and affects all students and academic staff.

Furthermore, there are about 60 LMS products that may be suitable for the Technion. In 2005, Moodle 1.56 was chosen to replace WebCT (the Technion’s LMS since 2000). Moodle was chosen on the basis of a document which discussed specific requirements as well as on a pilot study.

This M.Sc. dissertation presents a comprehensive process of development for evaluation of LMS suitability for the Technion.

The product of this development can provide support for decision makers in selecting a new LMS product.

The project’s first stage was dedicated to a comprehensive bibliographic survey. The main sources identified were: the original Technion requirements document; and several relevant papers that included comprehensive sets of metrics for evaluation of LMS tools.

In the second stage, the findings of the bibliographic study were analyzed in order to develop a combined, improved LMS evaluation tool. In the analysis process, the author’s professional experience in the area of testing software products was employed, and several missing areas were identified. New metrics were developed to complete a set of metrics that could best evaluate an LMS product. The evaluation tool covers all aspects of functionality, user interface and maintenance. Overall, 96 metrics were defined to cover the areas of use by lecturers and students and the professional maintenance of the LMS tools.

This metrics set is presented in QFD (Quality Functioning Deployment), which is a supporting table for decision making. This table consolidates the requirements with their respective metrics weights. To complete the evaluation tool, a three-level scale was defined for each metric for LMS evaluation.

In the final stage of the work, the described tool was fully applied by the author to evaluate the new version of current Technion Moodle LMS system. The author examined the efficiency of the tool and was able to form an impression of the upcoming version of Moodle that is being considered for implementation by the Technion. The trial implementation proved that the LMS evaluation tool is practical and ready for future implementation by the Technion to support future decision regarding LMS products.