SlideWiki has 4 workpackages specially devoted to the execution and evaluation of trials in the following areas: Secondary Education, Professional and Vocational Training, Higher Education, and Open Community Education.
Partners involved in the trials have developed a general plan for the three years of the SlideWiki project. All the trials are organized into the three following phases of incremental complexity:
- An initial evaluation in Year 1, where the objective is mainly to obtain feedback and comments in order to adapt the SlideWiki platform to the needs of the community.
- An organization-wide evaluation in Year 2, where the main objective is to involve a larger number of people belonging to the different organizations in the project.
- A domain-wide evaluation in Year 3, where the objective is mainly to demonstrate the suitability of the SlideWiki platform for people in the project domain, and also for people outside the organizations involved in the trials and in the project.
During Year 1, the planned trials were focused on setting up, executing and evaluating initial pilots. For this purpose, existing materials were collected, imported and reviewed into the SlideWiki platform (in the majority of cases, the SlideWiki Beta Version). All the planned trials were conducted and reported successfully. Trials were evaluated using a questionnaire about usability and usefulness, and specific feedback was provided to the development team.
This initial evaluation of the SlideWiki platform was mainly focused on the authoring part of the educational materials in controlled environments. The main goal of Year 1 trials, was to test the platform and provide useful feedback to the development team.
During this year (Year 2), the planned trials will be a continuation of those begun in Year 1 (most in the last quarter of 2016), and will be focused on collaborative authoring and teaching with the SlideWiki platform.
Now that we are in the second year of the project, we can report the 27 trials performed during the first year (mainly during the last trimester of 2016). The trials are grouped as follows:
- Three project consortium partners coordinated and implemented the trials related to secondary education, with a special focus on STEM (Science, technology, engineering and mathematics) education. The four trials performed were
- WP6-1: Open Data & Transparency (ZGZ)
- WP6-2: Participatory Budgeting, Future Scientists, Active Citizens (ZGZ)
- WP6-3: Educational Robotics With Different Robotics Platforms (SdR)
- WP6-4: How to Program a Robot System (Fraunhofer)
- Five project consortium partners executed and evaluated trials that are used for professional and vocational training. These trials are aimed at continuing education and part‐time training for people who are employed; particularly one of the trials trains learners with cognitive disabilities. The eight trials performed were
- WP7-1: Creation of Easy-to-Read content (Lectura Fácil) (ACC)
- WP7-2: Media Competence (IHKBIZ)
- WP7-3: Open Government (EKDDA)
- WP7-4: Basic Interoperability Concept (EKDDA)
- WP7-5: Interoperability Maturity Model (IMM) (EKDDA)
- WP7-6: Training for customers of PUPIN products (PUPIN)
- WP7‐7: Open School for Adults (GFOSS)
- WP7‐8: Open Data (GFOSS)
- Six project consortium partners were focused on the large‐scale usage, testing and evaluation of SlideWiki and the associated tools and services in higher‐education The eight trials performed were
- WP8‐1: Semantic Web and Linked Data (UPM)
- WP8‐2: Semantic Data Web Technologies, Enterprise Information Systems (UBO)
- WP8-3: Computer Engineering and Information Theory, Telecommunications (PUPIN)
- WP8‐4: Semantic Web technologies, Advanced IT infrastructures (PUPIN)
- WP8‐5: Designing Usable and Accessible Technologies (SOTON)
- WP8‐7: Semantic Web and Linked Data (VU)
- WP8‐8: Progressive Software Engineering Aspects (InfAI)
- WP8-9: Linked Data (UFRJ)
- Seven project consortium partners executed and evaluated trials with informal learners involving the use of a wide range of Massive Open Online Courses (MOOCs) and Open Educational Resources (OERs). These trials were in the area of Open Community Education. The seven trials performed were
- WP9-1: Open Data (UPM)
- WP9-2: MOOC (UPV)
- WP9-3: Self-Regulated Learning (OU)
- WP9-4: Foundations of Data Science (SOTON)
- WP9-5: Open Data Social Movements (UFRJ)
- WP9-6: Progressive Software Engineering Aspects (InfAI)
- WP9-7: Open Government and Transparency (ZGZ)
After the execution of the aforementioned trials, the usability of the SlideWiki Beta Version is considered borderline for the average of participants. The usefulness of SlideWiki Beta Version for viewing slides is considered also borderline, while the usefulness for creating slides is considered low. This result is somehow expected since Year 1 trials were conceived as an initial evaluation for the first Beta release of SlideWiki.
With respect to the scenario of viewing slides, participants provided suggestions for new features as for example zooming the content and displaying the slide numbers.
Regarding the scenario of creating slides, most of the participants in the trials reported problems while importing existing slides in pptx format, problems related to the format of tables and images, as well as problems in the slide ordering. In addition, participants provided some suggestions for using drag and drop in slide reordering and slide themes to fix the formatting issues.
On the other hand, the clean and simple interface of SlideWiki Beta Version gained some positive mentions from trials participants. Participants also deemed useful the possibility of organizing slides into decks and sub-decks as well as the option of reusing slides from different decks and sub-decks.
Most of the issues, problems and suggestions concerning SlideWiki Beta Version were discussed in detail during the SlideWiki plenary meeting at Genoa (November 2016) and development tasks were prioritized with respect to the importance for each trial. In addition, a continuous feedback loop has been created to establish a strong connection between the SlideWiki users and developers.
It is also worth mentioning that some requirements arose as relevant after the execution of the trials as for example the accessibility of the platform for viewing and creating slides as well as the possibility of uploading slides in open formats.