The evaluation of the project “FROM LITERACY TO DIGITAL AND TECHNOLOGICAL TRAINING” has been very positive, since all the quantitative and qualitative indicators defined in the application have been either achieved or surpassed.
A good example of this is that the educational contents of the Intellectual Output of the project, the “STRUCTURED AND PERSONALIZED COURSE FOR THE DIGITAL TRAINING OF ADULTS: FROM LITERACY TO DIGITAL AND TECHNOLOGICAL TRAINING”, have been expanded and improved by making a larger number of micropills than what was initially planned, in addition to translating them into French, which has allowed to expand the impact and dissemination of the project in France.
Also, the evaluation of the quality of the results is “very high” or “high” according to most experts, trainers, and education professionals who conducted this assessment.
Lastly, it should be noted that this evaluation was also carried out by dozens of experts external to the project, as well as by the participants and the people involved in it. It has also been positively evaluated and selected to participate in the International Education Congresses EDULEARN 2022 (14th Annual International Conference on Education and New Learning Technologies) and ICERI 2022 (15th Annual International Conference of Education, Research and Innovation).
INTERNAL EVALUATION
The internal evaluation of the project has as main objectives the control of the progress, the quality and execution of the activities, and the control of schedule and times. This evaluation and monitoring of the project has been carried out through a Total Quality System, in which the whole project was divided into simpler parts with shared objectives: Processes; each of these processes contributes to the achievement of one or more objectives of the project, and encompasses the set of activities necessary to achieve them.
By establishing such a fragmented and compartmentalized structure, it was easy to implement an effective evaluation system that covered each of the levels. Thus, each time an activity, process, or stage ended, a specific evaluation was carried out to analyze the level of compliance through the proposed indicators and establishing, where appropriate, corrective measures.
This preliminary evaluation had the participation of all the participants, who used various evaluation tools such as Google Files to send their proposals for improvement and share their evaluation tools with the rest of the partners to improve the project.
The project culminated in a Final Evaluation Stage, which was undoubtedly one of the most important parts of it, since it verified the achievement of the objectives and the fulfillment of the indicators of the project as a whole, which are mostly aimed at the process and results.
This evaluation was carried out through a highly participatory process that involved the project managers, technicians, and staff of the different partner organizations, collaborating entities, and adult students. Their participation was enhanced through spaces for analysis and reflection throughout the many activities that comprise this final stage of evaluation. Some of them are:
- EVALUATION MEETINGS WITH BENEFICIARIES.
- MEETINGS WITH MULTIPLIERS.
- EVALUATION ACTIVITIES OF THE PROJECT STAGES (PREPARATION, IMPLEMENTATION, AND DISSEMINATION).
- CONTROL AND FOLLOW-UP ACTIVITIES IN TRANSNATIONAL MEETINGS.
- ACTIVITIES FOR THE ANALYSIS OF EVALUATION DOCUMENTS.
- VIRTUAL MEETINGS OF THE TOTAL QUALITY MONITORING WORK TEAM.
- DRAFTING THE FINAL REPORT.
- FINAL WORKING MEETING OF THE COORDINATION TEAM.
The whole evaluation process was carried out through the TOTAL QUALITY MONITORING system. The WORK TEAM was coordinated by LUIS GÓMEZ ESTRADA of IKASIA TECHNOLOGIES, and in it also participated: Víctor García (REDTREE), Eleftheria Skordalaki (NTUA), Senentxu Lanceros (UNIVERSIDADE DO MINHO), Juliana Alice Ferreira Oliveira (NANOPAINT), and Fabienne Vidal (GRETA DU VELAY).
.
PILOT TEST
Within the project “FROM LITERACY TO DIGITAL AND TECHNOLOGICAL TRAINING: INNOVATIVE AND CUSTOMIZABLE TRAINING ITINERARY TO FACILITATE THE EMPLOYABILITY AND INCLUSION OF ADULTS”, multiple pilot tests have been carried out in 7 adult/ lifelong educational centers and a technology company in Spain, France, Greece, and Portugal.
These pilot tests focused on the “STRUCTURED AND PERSONALIZED COURSE FOR THE DIGITAL TRAINING OF ADULTS: FROM LITERACY TO DIGITAL AND TECHNOLOGICAL TRAINING”, since this is the Intellectual Output of the project, but the rest of its results have also been tested.
The main objective of these activities has been to improve the quality of the results of the project through the participation of the adult students themselves, the beneficiaries of the project in the evaluation and improvement of these results, while ensuring that they answered to their learning needs.
The pilot tests were developed during the final phase of the project, meaning, during the months of April to August 2022. The educational centers and work centers involved were the following:
- Adults University – Universitat Politècnica de València (Spain).
- Nanopaint – Design your technology (Portugal).
- Greta from Le Puy-en-Velay (France).
- Greta from Monistrol-sur-Loire (France).
- Greta from Yssingeaux (France).
- Second Chance School Haute-Loire (France).
- FormaLab – fablab of Greta du Velay (France).
- Adult School of the National Technical University of Athens (Greece).
The results were very positive and satisfactory, since the students involved showed great motivation for the contents of the online course, evaluated its quality as very good, and made proposals for improvement for the results of the project. We also had the participation of professors and experts from the companies involved.
Lastly, the realization of these pilot tests also enhanced the dissemination and impact of the results of the project throughout Europe, especially in Spain, France, Greece, and Portugal.
.
EXTERNAL EVALUATION
In order to validate the quality of the project and the results generated in it, a large number of international expert evaluators in the field of innovative education have been contacted (several of them members of the evaluation committees of the most relevant international conferences on the subject of educational innovation).
Below, we list the set of experts that have evaluated the project:
| EXPERT | DISCIPLINE | COUNTRY |
| David Martí | Industrial Engineering | SPAIN |
| Luis Gómez | Electronics Engineering | SPAIN |
| Agustín López | Journalism | SPAIN |
| Ignacio Candel | Chemical Engineering | SPAIN |
| Antonio García | Industrial Engineering | SPAIN |
| Javier Martí | Computer Science Engineering | SPAIN |
| Mª Jesús Suesta | Tourism | SPAIN |
| Jose Luis Bernat | Software Engineering | SPAIN |
| Chelo González | Food Technology | SPAIN |
| Wendy Gorton | Educational Technology | USA |
| Mónica Fernández | Communication & Public Relations | SPAIN |
| Eladio Duque | Marketing & Public Relations | SPAIN |
| Juanan Herrero | Graphic Design | SPAIN |
| Jose F. Cabeza | Organic Chemistry | SPAIN |
| Joanna Lees | Veterinary Medicine | FRANCE |
| Ana Tomás | Architecture | SPAIN |
| Ignacio Ballester | Energetic Engineering | SPAIN |
| Iván Martínez | Architecture | SPAIN |
| Miguel Peiró | Audiovisual Production | SPAIN |
| Xema Pedrós | Audiovisual Production | SPAIN |
| Javier Domenech | Industrial Engineering | SPAIN |
| Lorena López | Law and Business Administration | SPAIN |
| Sergio Pérez | Mechanical Engineering | SPAIN |
| Ismael Serrano | Business and Administration Management | SPAIN |
| Xavier Lefranc | Materials Engineering | FRANCE |
| Norma Barrachina | Law | SPAIN |
| Amparo Girós | Genomics | SPAIN |
| Elena Ors | Veterinary Medicine | SPAIN |
| Maria Porcel | Chemical Engineering | SPAIN |
| Achim Dannecker | Fachhochschule Nordwestschweiz FHNW | SWITZERLAND |
| Adriana Agnes Repellin-Moreno | Universidad Panamericana | MEXICO |
| Aileen Cotter | Cork Institute of Technology | IRELAND |
| Akihiro Maeda | Ryukoku University | JAPAN |
| Alan Belcher | Ashford University | UNITED STATES |
| Alia Ammar | Drexel University | UNITED STATES |
| Ana Henriques | Instituto de Educação da Universidade de Lisboa | PORTUGAL |
| Ana Paula Lopes | Polytechnic Institute of Oporto | PORTUGAL |
| Anna Romagnuolo | University of Tuscia | ITALY |
| Annette Redmon | University of Cincinnati | UNITED STATES |
| Anemona Peres | Frontex | POLAND |
| Asako Ohno | Osaka Sangyo University | JAPAN |
| Bob Barrett | American Public University | UNITED STATES |
| Boza Tasic | Ryerson University | CANADA |
| Bozena Mannova | Czech Technical University in Prague | CZECH REPUBLIC |
| Breno Deffanti | Graded – The American School of São Paulo | BRAZIL |
| Brian Garibaldi | Johns Hopkins University School of Medicine | UNITED STATES |
| Catherine O’Donnell | Ulster University | UNITED KINGDOM |
| Chang-Tik Chan | Monash University Malaysia | MALAYSIA |
| Chiew Hong Ng | National Institute of Education | SINGAPORE |
| Christopher Evans | Cardiff University | UNITED KINGDOM |
| Christopher Mattatall | University of Lethbridge | CANADA |
| Craig Loewen | University of Lethbridge | CANADA |
| Craig Walker | Oklahoma State Department of Education | UNITED STATES |
| Cynthia Rosas Magallanes | Instituto Mexicano del Seguro Social (IMSS) | MEXICO |
| Dania Bilal | University of Tennessee, Knoxville | UNITED STATES |
| Daniel Abrahams | University of Arkansas – Fayetteville | UNITED STATES |
| Darren Falconer | The University of Western Australia | AUSTRALIA |
| David Jennings | University College Dublin | IRELAND |
| Eulalia Tramuns | Escola Horitzó in Barcelona | SPAIN |
| Elmaziye Özgür | Eastern Mediterranean University | CYPRUS |
| Ewa Bogacz-Wojtanowska | Jagiellonian University | POLAND |
| Fausto Brevi | Politecnico di Milano | ITALY |
| Fernando Enrique Ortiz Rodriguez | Universidad Autonoma de Tamaulipas | MEXICO |
| Fiachra Ó Súilleabháin | University College Cork | IRELAND |
| Filomena Soares | Polytechnic of Porto | PORTUGAL |
| Francesco Galati | University of Parma | ITALY |
| Frank Brosow | University of Education Ludwigsburg | GERMANY |
| Hanna-Riitta Kymäläinen | University of Helsinki | FINLAND |
| Helen Reddy | University of Nottingham | UNITED KINGDOM |
| Helmut Wöllik | Carinthia University of Applied Sciences | AUSTRIA |
| Hiroyuki Obari | Aoyama Gakuin University | JAPAN |
| Iolie Nicolaidou | Cyprus University of Technology | CYPRUS |
| Jacqueline Baxter | The Open University | UNITED KINGDOM |
| James Mackay | Wellington Institute of Technology | NEW ZEALAND |
| Jaroslaw Kujawski | University of Gdansk | POLAND |
| Jenny Eppard | Zayed University | UNITED ARAB EMIRATES |
| Joanna Richardson | City, University of London | UNITED KINGDOM |
| João Monteiro | ISPGAYA – Instituto Superior Politécnico Gaya | PORTUGAL |
| John Craft | Appalachian State University | UNITED STATES |
| Joseph Agbenyega | Emirates College for Advanced Education | UNITED ARAB EMIRATES |
| Judith Szerdahelyi | Western Kentucky University | UNITED STATES |
| Kari Krell | MacEwan University | CANADA |
| Kay Gallagher | Zayed University | UNITED ARAB EMIRATES |
| Jana Bérešová | University of Trnava | SLOVAKIA |
| Jane Davies | University of Nottingham | MALAYSIA |
| Kathleen O’Sullivan | University College Cork | IRELAND |
| Kari Krell | MacEwan University | CANADA |
| Kay Gallagher | Zayed University | UNITED ARAB EMIRATES |
| Laila Nordstrand Berg | Western Norway University of Applied Sciences | NORWAY |
| Laurie Henry | Salisbury University | UNITED STATES |
| Luis Roseiro | Instituto Superior de Engenharia de Coimbra | PORTUGAL |
| Luke Raeside | Technological University Dublin | IRELAND |
| Laura Zizka | Ecole Hôtelière de Lausanne / HES-SO University of Applied Sciences and Arts Western Switzerland | SWITZERLAND |
| Leonor Silva de Mattos | University of Hertfordshire | UNITED KINGDOM |
| Louise Robson | University of Sheffield | UNITED KINGDOM |
| Manuel Gericota | Polytechnic of Porto | PORTUGAL |
| Maria Rudneva | RUDN University (Peoples’ Friendship University of Russia) | RUSSIAN FEDERATION |
| Martha Leal-Gonzalez | Institute of Innovation and Technology Transfer of Nuevo Leon | MEXICO |
| Matome Mashiapata | University of South Africa | SOUTH AFRICA |
| Mayaugust Finkenberg | Stevenson University | UNITED STATES |
| Mike Hillis | California Lutheran University | UNITED STATES |
| Murali Venkatesh | Syracuse University | UNITED STATES |
| Maria Luisa Spreafico | Politecnico di Torino | ITALY |
| Maria Susy Rogers | The University of South Wales | UNITED KINGDOM |
| Marion Milton | Unviersity of Notre Dame | AUSTRALIA |
| Martina Bode | University of Illinois at Chicago | UNITED STATES |
| Michelle Flood | Royal College of Surgeons | IRELAND |
| Monika Jakubiak | Maria Curie-Sklodowska University | POLAND |
| Nathalie Wessseling | Amsterdam University of Applied Sciences | NETHERLANDS |
| Orlando Belo | Universidade do Minho | PORTUGAL |
| Paul Fenn | University of Sheffield | UNITED KINGDOM |
| Paul Holland | Swansea University | UNITED KINGDOM |
| Paul Hunter | IMD, International Institute for Management Development | SWITZERLAND |
| Peter Gabor | University of Calgary | CANADA |
| Peter Haber | Salzburg University of Applied Sciences | AUSTRIA |
| Pia Palotie | Valmennuskeskus Public | FINLAND |
| Pirkko Pollari | JAMK University of Applied Sciences | FINLAND |
| Polona Gradišek | University of Ljubljana | SLOVENIA |
| Richard Spencer | Middlesbrough College | UNITED KINGDOM |
| Rosa Cendros Araujo | Western University | CANADA |
| Salman Azhar | Auburn University | UNITED STATES |
| Rebecca Allen | University of Cincinnati | UNITED STATES |
| Sandra Gomes | IPAM | PORTUGAL |
| Sean Lancastle | University of Bristol | UNITED KINGDOM |
| Sérgio Luis Monteiro da Silva | CNA – Cultural Norte Americano | BRAZIL |
| Sinéad McCotter | University of York | UNITED KINGDOM |
| Sylvia Dempsey | Cork Institute of Technology | IRELAND |
| Siobhan O’Sullivan | Khalifa University in Medical Education | UNITED ARAB EMIRATES |
| Suzy Connor | Kyushu University | JAPAN |
| Teemu Patala | Context Learning Finland Oy | FINLAND |
| Teresa Cardoso | Universidade Aberta, LE@D | PORTUGAL |
| Taija Votkin | Aalto University | FINLAND |
| Taketoshi Yokemura | Shibaura Institute of Technology | JAPAN |
| Tammy Ladwig | University of Wisconsin Fox Valley | UNITED STATES |
| Thomas Lavery | The Royal Academy of Engineering | UNITED KINGDOM |
| Thomas Rachfall | Hochschule Merseburg | GERMANY |
| Tunde Szecsi | Florida Gulf Coast University | UNITED STATES |
| Victor Fester | University of Waikato | NEW ZEALAND |
| Victoria Brennan | Liverpool John Moores University | UNITED KINGDOM |
| Victoria Kompanets | Lappeenranta University of Technology | FINLAND |
| Wayne Bailey | The University of Huddersfield | UNITED KINGDOM |
| Wendy Gorton | EdTechTeam | UNITED STATES |
.
RESULTS OF THE EVALUATION
