{"CACHEDAT":"2026-11-11 20:00:00","HOWSUBJECTMAP":{},"SLUG":"course-evaluation-aMwULMfBfp","MARKDOWN":"In the SciLMi pilots, the BITs were evaluated externally by HÉTFA in a mixed-methods design along three dimensions: the design of the BITs, the competences they addressed, and the course experience. The evaluation combined pre-, post-, and follow-up surveys, semi-structured interviews with trainers and organisers, structured observation of the sessions, the teachers' daily feedback during the on-site weeks, and live polls during the virtual follow-up ([→ Course Format & Delivery: From BITs to PRO](/doc/course-format-delivery-from-bits-to-pro-vcTyvPbRxd#h-evaluation)). The results are presented in D 7.2, and the findings on the blended format in D 7.3. Such a comprehensive evaluation is required to validate a course ([→ Validation & Implementation Criteria](/doc/validation-implementation-criteria-8SSOwd2R7F#h-validation-criteria)).\n\nFor regular deliveries, less formal evaluation formats are better suited. In line with the Quality Standards for Courses under Key Action 1 ([→ Validation & Implementation Criteria](/doc/validation-implementation-criteria-8SSOwd2R7F#h-foundations)), they use participant feedback both during the course to adapt it immediately (formative evaluation) and at its end to improve future deliveries (summative evaluation).\n\n# Formative Evaluation during the Course\n\nThe BIT includes regular opportunities for participants to give feedback on the learning process, the course structure, the activities and group work, and their individual needs:\n\n* **Today in Review**: At the end of each on-site day, participants give anonymous feedback in a short online survey. In its evening meeting, the trainer team discusses the feedback together with its own observations and adapts the next day accordingly ([→ Grow Module: Today in Review](/doc/grow-module-aYf9kWjngu#h-today-in-review)).\n\n# Summative Evaluation\n\nAt the end of the on-site week, participants and trainers look back on the week together ([→ Grow Module: Week in Review](/doc/grow-module-aYf9kWjngu#h-week-in-review)):\n\n* **Hopes & Fears Revisited**: Participants and trainers revisit the board from the first day and discuss which hopes were fulfilled, which fears proved unfounded, and what remains open. In the SciLMi pilots, the board covered expectations, motivations, and fears ([→ Hopes & Fears](/doc/grow-module-aYf9kWjngu#h-hopes-and-fears)).\n* **Open Feedback Round**: Participants share openly what they liked and did not like, including suggestions for improvement.\n* **Highlights & Take-Aways**: Participants collect the highlights of the week and write down their personal take-aways.\n\n\n:::tip\nA formalised survey in the virtual sessions can systematise and support this process digitally. Participants answer the same short live poll twice: at the virtual kick-off as expectations and at the virtual follow-up as experience. The poll covers the learning outcomes (self-assessment of the competences addressed), the course design, the course experience, and the support during the classroom implementation phase (**PRO**: virtual coaching). A tool that displays both results side by side can serve as a starting point for a joint reflection in the follow-up.\n\n:::\n\nThe lesson plans and HOW activities (**PRO**: in their revised versions) also provide insight into how participants apply the SciLMi approach in their teaching. Course providers can use them to identify strengths and areas for improvement in the modules and materials.","RENDERMODE":"markdown","HTML":"
In the SciLMi pilots, the BITs were evaluated externally by HÉTFA in a mixed-methods design along three dimensions: the design of the BITs, the competences they addressed, and the course experience. The evaluation combined pre-, post-, and follow-up surveys, semi-structured interviews with trainers and organisers, structured observation of the sessions, the teachers' daily feedback during the on-site weeks, and live polls during the virtual follow-up (blank\" rel=\"noopener\">→ Course Format & Delivery: From BITs to PRO). The results are presented in D 7.2, and the findings on the blended format in D 7.3. Such a comprehensive evaluation is required to validate a course (blank\" rel=\"noopener\">→ Validation & Implementation Criteria).
\nFor regular deliveries, less formal evaluation formats are better suited. In line with the Quality Standards for Courses under Key Action 1 (→ Validation & Implementation Criteria), they use participant feedback both during the course to adapt it immediately (formative evaluation) and at its end to improve future deliveries (summative evaluation).
\nThe BIT includes regular opportunities for participants to give feedback on the learning process, the course structure, the activities and group work, and their individual needs:
\nAt the end of the on-site week, participants and trainers look back on the week together (→ Grow Module: Week in Review):
\nA formalised survey in the virtual sessions can systematise and support this process digitally. Participants answer the same short live poll twice: at the virtual kick-off as expectations and at the virtual follow-up as experience. The poll covers the learning outcomes (self-assessment of the competences addressed), the course design, the course experience, and the support during the classroom implementation phase (PRO: virtual coaching). A tool that displays both results side by side can serve as a starting point for a joint reflection in the follow-up.
The lesson plans and HOW activities (PRO: in their revised versions) also provide insight into how participants apply the SciLMi approach in their teaching. Course providers can use them to identify strengths and areas for improvement in the modules and materials.
","UPDATEDAT":"2026-11-04T14:34:10.049Z","ID":"afd0db02-4f27-433c-b74a-21023ce77cd8","TITLE":"Course Evaluation"}