Lean Startup as a Learning Methodology for Developing Digital and Research Competencies | Ávalos | Journal of New Approaches in Educational Research

From research carried out on the subject ever since the beginning of the 21st century ( OCDE, 2005; OECD, 2018; Rychen & Salganik, 2000) we can find an international concern towards the appropriate skills that the education system must provide for citizens to face the challenges of the new century. Skills such as learning to innovate, digital and office literacy, improving people’s personal and professional life, as well as axiological and ethical training, are some of those that stand out in the current century. Authors such as Luna (2015) and Figueroa (2017) coincide in the need to acquire skills such as those indicated which prepare citizens for current challenges and demands, thus highlighting the need to rethink the learning methodology towards roles and training spaces that are more participatory and applied to experiential contexts.

In this sense, from different international contexts the appropriate skills for this century have been defined, from diverse models of development arising from the association of universities such as Partnership for 21st Century (2009); from international organisms such as UNESCO (2008), UNESCO (2016) and OECD (2018), from the European Union ( Vuorikari, Punie, Carretero, & Brande, 2016) or from the national scope, in this case Costa Rica ( Zúñiga, Núñez, Brenes, & Chacón, 2013).

However, from the responsibility that universities must assume in providing solutions to the demands of society, Shank (2011) criticizes that, from the reality of the system, there is a decontextualized training of the needs of each population. That is to say a learning system which lacks meaning and in its absence, reproduces contents that are not significant for the students in their training, and develops tough competition, instrumental abilities and skills without the necessary understanding to be adapted to real scenarios. As stated by Alabart (sf) (quoted in Borafull 2014), “the current educational system forces everyone to go through the tube of homogenization, not considering individual talents and instilling knowledge of a generic and non-significant character” (p. 156).

Digital competencies

Digital competency, as such, appears in the European Reference Framework in 2006 in recognition of the European Union of basic skills that every citizen of the 21st century should develop in order to be competent: Recommendation of the European Parliament and of the Council of December 18, 2006 on key competencies for lifelong learning. Although digital competency was recognized and defined as one of the 8 basic competencies, it was not until 2013 ( Ferrari, 2013) that a well-founded definition was established:

Digital competency is a set of knowledge, skills, attitudes, strategies, values and awareness required when using ICT and digital media to perform tasks, solve problems, communicate, manage information, collaborate, create and share content and build knowledge in an effective, efficient, appropriate, critical, creative, autonomous, flexible, ethical and reflective way for work, leisure, participation, learning, socialization, consumption and empowerment (Ferrari, 2013, p. 4)

This study takes the European Reference Framework as a theoretical base, in which the reference framework and understanding of digital competency is developed in 2013 ( Ferrari, 2013) and revised in 2016( Vuorikari et al., 2016). Following this, the following digital competencies have been identified for our study( Vuorikari et al., 2016)

• Information management: related to effective searches, evaluation, storage and retrieval of information.
• Communication: including all communicative actions carried out through ICT tools (social networks, blogs, chats, etc.).
• Content creation: such as the ability to create all kinds of content (blogs, websites, wikis, presentations, infographics, etc.).
• Problem solving: with a specific focus on critical thinking and problem solving centered on technology and with the effective ability to find answers to questions posed.
• Security: related to digital identity management, privacy, configuration of tools and profiles, etc.

Research competencies

Currently one of the main concerns of the education system is the lack of research skills in the training of its professionals, as has been demonstrated in recent years, from statistical reports such as the State of Education and studies developed in Costa Rican territory, highlighting the lack of research productions from this sector( Ávalos, 2018).

Lean Startup as a learning methodology

The Lean Startup method was created by Erick Ries in 2011. According to Ries, the method enhances those “practices that favor the creation of Startups successfully and with little likelihood of experiencing losses” (Ries, 2011, p. 39). It is based on the scientific method for its execution and considers a series of steps that are fundamental in its development: creating, measuring and learning.

• The contextualization of knowledge: working with learning experiences with a realistic approach, promoting an improvement of mindset and problem solving.
• The development of entrepreneurial attitudes: by enhancing collaborative work, creative mentality, effective communication, permanent observation, experimentation, analysis of situations, development of innovative proposals. All of which, together with technological resources can appropriate the student body with digital competency and from design processes, with the measurement of proposals, the verification and socialization of results and the research competency.
• The development of soft skills is encouraged: those that predispose students to adopt changes and adjust to them in a proactive way, to be empathetic, to know how to look for solutions to different situations, to develop divergent thinking, processes of self-motivation and thus flexible and innovative thinking.

The study took place in three stages during the years 2015-2017, and included as a study population the student body of the School of Educational Sciences, who were taking the course Mixed Methods Research (MMR).

During the assessment stage, a documentary review was developed, as well as the implementation of instruments to students and teachers, together with processes to improve the learning methodology. In the processual stage and final stage of research, the course was developed with the incorporation of the Lean Startup method as a learning methodology. This implied making use of techniques and strategies such as Project Based Learning (PBL), research seedbeds, collaborative work and mediating the development of conceptual and procedural knowledge of the subject through the use of tools such as: wiki, reflective journals, academic forums, chat, Skype, WhatsApp and Google drive, all conducive to effective communication, self-regulation of learning, teamwork, divergent thinking and solving situations, conducive to learning for life( Riyanti et al., 2017). These modifications were generated in 2016 and implemented in 2017, with the objective of testing the effectiveness of the Lean Startup method as a learning methodology to guarantee building digital and research competencies in the student body of the subject Mixed Methods Research.

The study is framed within a descriptive, explanatory and applied research which has been developed in three stages: diagnostic, processual and final( Pérez, 2006). It is an explanatory sequential mixed type( Creswell, 2015), which seeks to respond to the phenomenon studied by contrasting qualitative and quantitative data( Pérez, Galán, & Quintanal, 2012).

Sample

The study was carried out with students from different degrees of the Faculty of Educational Sciences who were studying the course Mixed Methods Research during the years 2015 to 2017 and professors who offered the subject during those years. In practice, there was a total sample of 531 subjects of which 319 were women and 212 were men; the average age of the participants was between 30 to 50 years old. Sampling was carried out for the diagnostic and processual stage in a simple random probability with 95% reliability and a 5% margin of error, considering 116 students and 3 teachers in the diagnostic stage, 201 students in the processual stage who participated in the survey and a review of performance reports of 173 other students in the subject. The final stage was done in a non-probabilistic way for convenience, working with a group of 33 students and 5 teachers from the course( Sáez, 2017).

Creation of the survey

In the diagnostic and processual stage, two surveys were designed as data collection instruments with the intention of knowing the achievement of digital and research competencies reached by the students in the course. Each survey consisted of 5 parts: sociodemographic information, methodology used, methodological strategies, ICT resources used, research skills and abilities achieved at the end of the course; Likert scales were used in its deployment. Also, interviews were conducted with teachers in the diagnostic stage. In the final stage, interviews were conducted with students and teachers, as well as observation processes using checklists. The validation of the surveys and interviews was carried out by experts in the areas of Technology, Pedagogy and Research prior to deploying them to the participating sample( McMillan & Schumacher, 2005). The variables to be analyzed were: the acquisition of digital and research competencies as dependent variables and as independent variables: learning methodology, ICT resources and learning experiences.

Reliability of the survey

For the quantitative part of the survey, the statistical package SPSS was used, highlighting a normal distribution in the behavior of the variables, the factorial analysis technique was used to determine the correlation of the variables; from the results of KMO and Bartlett tests, a high level of correlation between the factors 0.903 was shown, with a high significance. Justifying the results obtained by the Cronbach’s Alpha test, which determined a high reliability in the instruments 0.91 for the survey used in the diagnostic stage with 76 elements and 0.94 for the survey applied in the processual stage, which consisted in 92 elements; In the qualitative part, the content analysis technique was used with the tool Atlas Ti( Bisquerra, 2014).

Initial and processual stage

With a percentage of less than 50% of the sample surveyed, the student body determined, in the diagnostic study, that the methodology developed by teachers in the course MMR was from Good to Very Good, highlighting aspects such as counseling (32.8%) and follow-up meetings (42%). ICT resources most used in the mediation of the subject were: the notification board (37.1%), the academic forum (32.8%), platform mail (32.8%) and from learning experiences, the technique of Project-Based Learning (PBL), through the development of research projects, as the technique most used in the development of the subject (see Figure 1 ).

In the processual stage, a review of the methodology used by teachers in 2015-2016 was carried out, based on the ANOVA test. Generally speaking it was evident that the methodology did not vary from one year to another in spite of the changes in the learning experiences, aspects such as: follow-up (M1) p=.078/ 3131 F, motivation in the course of activities (M 4) p=.076/ 3167 F and fulfillment of learning objectives (M 5) p=.476/.509 F, did not show differences in the items analyzed from one year to another. Out of the twelve methodology variables reviewed, the only one that showed any variation was (M 6), in environments of respect and collaboration, p=.018/ 5645 F; the data is detailed inTable 1 .

Subsequently, a correlation was made between the items of the methodology and digital competencies (CD) and research (CI) to determine the behavior of the variables in the acquisition of competencies according to the methodology used. For this purpose, a factorial analysis was first carried out to group the competencies, highlighting from the matrix of components a reduction of factors to two predominant components in the digital competency (CD): information management (.649) and problem solving using critical thinking (-.617). In the case of research competencies (IQ) one component was highlighted: communication (.701). Once the competency factors were identified, the correlation was made with the methodology used by the teaching staff, highlighting a significance in the digital information management competency (CD 2, see Table 2) with regard to the other two competencies.

The results in table 2 demonstrate a high significance that is changing in information management (CD2) in contrast with the methodology variables, with p < .05. This means that the (CD2) is going to increase or decrease according to the type of methodology developed by the teaching staff in the subject. Problem solving (CD1) and communication competencies (CI) did not achieve this significance which, according to the data presented, seem to require another type of methodology that favors the development of these competencies in learning processes.

Final stage: Digital competency and research through emerging learning methodologies

After considering the results of the methodology used by the teaching staff during the initial and processual stages, it was possible to demonstrate their responsibilities as platform administrators and not as managers of new knowledge construction processes( Ávalos, 2018). As a result, more than 50% of the research competencies focused on information search and content analysis capacities, and in percentages lower than 50% other relevant competencies, such as: problem solving, critical and reflective thinking, ethical-social impact and communication, based on studies by Jou and Wang (2013), and OECD (2018). Among the digital competencies achieved according to the student body and in a percentage greater than 50% were: a positive attitude towards the use of technological resources and the use of certain tools on the platform, leaving other competencies undeveloped with a percentage data below 40%. These included: communication and collaboration, the creation of digital content in problem solving, which have been supported in studies by Brynjolfsson and McAfee (2014), Gisbert and Lázaro (2015) y Rangel (2015), as well as in approaches made by UNESCO (2016). This data is expanded in Table 3.

As a product of the previous panorama, the Lean Startup methodology was implemented in the first four-month period of 2017, after the final stage of the study, testing the experience with a group of 33 students from the course Mixed Methods Research. This methodology was based on the redesigning of learning methodology and didactic strategies focused on learning by doing, challenge-based learning, design thinking and mobile learning, which according to Peñalver (2017), are activities that enable the development of skills such as creativity, effective communication, critical thinking, collaborative work and a change of mentality towards innovations. Such changes can be seen in Figure 2 .

In order to develop techniques and strategies linked to collaborative work and (PBL), with the Lean Startup methodology, it was necessary to review the existing tools in Moodle’s LMS platform, identifying those that would be of greater benefit in the student’s analysis and reflection processes for the subject’s learning experiences and those which, in addition, would promote collaborative work. Therefore, the use of reflective journals and wiki were some of the tools incorporated into the learning experience, as well as others detailed in the previous table.

The aim was to level the workload on the platform based on the observations made in previous periods (2016-1 and 2016-2), ensuring that the activities were interrelated, so that the group’s efforts to generate an electronic dictionary on research topics using the Wiki and individual reflections developed in reflective journals were contributions that assigned more weight to the knowledge of each student in the subject (MMR). This was done in order to generate their own research project approach and make an effective pedagogical use of technological tools that they had not used before, which allowed them to increase their knowledge and practice in the use of technology while developing research knowledge, encouraging also the use of other tools such as Skype, WhatsApp and Chat, and more accompaniment and motivation that was highlighted by the students in the SWOT’s( Ávalos, 2018).

As for the development of the subject improvements (MMR), prior to the changes it was necessary to develop a learning methodology, which is presented inFigure 3 with the implementation of the Lean Startup method as a learning methodology.

By materializing the system that underpins the Lean Startup build-measure-learn methodology, it was possible for students to move from a methodology focused on instructional learning to one by doing. In this way, in the building stage the student body developed activities that allowed them to reinforce observation, inquiry, analysis and reflection. They interacted constantly with different tools such as Wiki in collaborative learning spaces for the development of a digital dictionary on research topics, with the reflective diary in the development of weekly annotations, sensitizing their observations on the object of study to be researched. With videos to reinforce thematic contents of the subject, they developed processes of synthesis, verification and application of the theory in identifying their object of study for the development of their research project through the technique (PBL) and collaborative work actions. The teacher was a facilitating agent and mentor who promoted the development of attitudes such as critical thinking, collaborative work, originality, leadership, creativity and transversal values in the education of the student body such as respect, tolerance, empathy and ethics.

In the measuring stage, in the performance of activities and follow-up of the learning achieved, both the student body and the teacher identified weaknesses and strengths in the training processes from actions such as self-evaluation, co-evaluation and one-way evaluation. This was carried out through progress reviews, delivery of reports, participant observation processes, SWOT’s delivered by the students themselves on the improvements to be developed in the subject and the work done using wiki, chats, forums and networked media such as Skype. All of this was developed from a philosophy of evaluating to learn. Finally, in the learning process the student body evidenced a change on the importance of research for the improvement of its own didactic model from their work with “Semilleros de investigación” ( Seas, 2016), recognizing the importance of collaborative work in the development of research processes and from the use of a methodology oriented towards doing, supported by technological tools of greater interaction. This led to the development of digital and research competencies, which had not been attended, although they had been identified, in the stages of diagnostic and processual research.

As for the interviews with teachers and students in order to validate the effectiveness of a new learning methodology, an electronic interview was conducted ; in which both actors agreed that in order to establish improvements in the learning methodology it was necessary to consider aspects such as follow-up, continuous evaluation, development of clear instructions, collaborative work and permanent feedback (interview with teachers, December 22, 2017) and that in order to achieve such improvements it was advisable to first train the teaching team in the Lean Startup methodology and in the tools to be used in virtual environments before implementing a new methodology. They highlighted the importance of entering into new learning practices for achieving contextualized and significant learning, and on the other hand, the need to bear in mind the interests of the university, the increase in the working hours of the team of trainers, since with the current dedication (¼ T) little can be done to generate innovation processes. It also highlights some of the teachers’ own impressions of the proposed methodology: P4. “Yes, I agree, being an entrepreneur is an excellent option for the development of competent professionals who are open to the challenges of today’s market and labor context”. (Professor 4, personal communication, December 22, 2017) ( Ávalos, 2018, p. 291), other teacher contributions are also highlighted:

P1. Yes, I agree, from my point of view it is necessary to do different things to obtain different results, it seems to me a viable proposal from the resources required for its implementation and to test different methodologies. (Professor 4, personal communication, December 22, 2017).

P3. Nowadays an entrepreneurial attitude is necessary in any area of life, therefore, in education, considering that it is a field that is continually being renewed, being innovative is a necessity. (Professor 3, personal communication, December 22, 2017).

Furthermore, from the acquisition of digital competencies, the results of the research made it clear that in the initial and processual stages, only the competence of an open attitude towards the knowledge society and the use of digital resources had been evidenced in a percentage greater than 50%, prevailing among learners a lack of knowledge of office automation skills and a complete lack of ubiquitous understanding of technological tools to transform the learning achieved in real-world solutions. This complemented the contributions of López (2013), Sevillano and Vázquez (2015) and Sepúlveda et al. (2017).

Therefore, with the implementation of the Lean Startup methodology, it was possible to show that digital competencies based on the approaches of Rangel (2015), Fernández and Fernández (2016), -referring to the effective use of information, communication from network spaces, information management, use of ethics, creation of educational content, responsible use of technologies, improvement proposals from concrete and realistic applicable actions- could be developed during the different learning experiences and work methodology implementing the phases of the Lean Startup method: building, measuring and learning.

Bearing this in mind the acquisition of soft skills such as self-regulation, self-motivation, a mind set for coping with change, communication, leadership and empathy is emphasized ( Patiño et al., 2016). Coincidentally, the skills mentioned are compatible with others favored by the Lean Startup Method established by Riyanti et al. (2017) and Peñalver (2017): namely communication, teamwork, creativity and problem solving.

According to Borafull (2014) the contributions on the reality of companies are, as he states: “currently developed within networks of cells with their own knowledge and not in pyramids; they do not compete, they communicate, cooperate and create online”, (p. 156). Following this, it would appear necessary to rethink the methodologies used to educate professionals, considering from their educational curriculum, the opportunities offered by the Lean Startup method, it can be concluded from their research, that this method is a driver of soft skills within which entrepreneurial thinking takes strength( Gupte, 2015; Schwarts, 2016).

The work presented here reinforces proactive attitudes such as those proposed by Luna (2015) and Sepúlveda et al. (2017) that visualize the possibilities of entrepreneurial thinking as a competency that can be transversal to several areas; from entrepreneurship ( Schwarts, 2016; Sepúlveda et al., 2017), innovation and research ( Jou & Wang, 2013; Davison & Palermo, 2015; Anderson, 2016; Peñalver, 2017) and digital competencies Gisbert and Lázaro (2015), Pérez-Escoda (2017)

Finally, it can be concluded that it is necessary for universities to strive to rethink the current learning methodology, from the use of emerging methods such as Lean Startup and that this methodology focuses on fostering innovation, contextualization and feasibility of knowledge through attitudes that allow the individual to build transformative ideas, to measure their innovations against the demands of the real world and to learn from their mistakes, and improvement opportunities in their learning. Because only then will the acquisition of research and digital competencies be executed in an innate way in the learning processes thus achieving a profile of a comprehensive professional, that meets “in situ” with the demands of this century.

¹ https://youtu.be/TJ6RL0gRBOA

1. Anderson, J. (2016). Inquiry-based learning. Teaching Secondary Mathematics, Cambridge University Press. Cambridge. 117-145. https://doi.org/10.1017/CBO9781316442814.007.
2. Ávalos, C. (2018). Uso del método Lean Startup en el análisis y rediseño de estrategias didácticas para la formación en investigación. Tesis de Doctorado en Educación. Madrid, España. UNED. Recuperado de, Retrieved from https://bit.ly/2SP3Z1V.
3. Bisquerra, R. (2014). Metodología de la Investigación Educativa, La Muralla S.A. Madrid.
4. Brynjolfsson, E., & McAfee, A. (2014). The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies, Norton & Company. New York. Retrieved from https://bit.ly/1L103Gk.
5. Creswell, J. (2015). A Concise Introduction to Mixed Methods Research, Sage. USA, Los Angeles.
6. Ferrari, A. (2013). A framework for developing and understanding digital competence in Europe. Retrieved from http://goo.gl/sbPQB7.
7. Figueroa, M. (2017). Habilidades del Siglo XXI para todos. Compartir palabra maestra. Retrieved from https://bit.ly/2rrs4mB.
8. Fishbein, M. (2014). Lean Education: What College Students Can Learn From Lean Startups. Retrieved from https://bit.ly/1wUIyes.
9. Gisbert, M., & Lázaro, J.L. (2015). Professional development in teacher digital competence and improving school quality from the teachers perspective: a case study. New Approaches. Educational Research, 4(2):115-122. https://doi.org/10.7821/naer.2015.7.123. Retrieved from https://bit.ly/2TpfiD9.
10. Gutiérrez, A., & Apaolaza, U. (2014). Lean Startup como herramienta para la generación de un modelo de negocio basado en la gestión de medios digitales. Congreso Internacional de Dirección de Proyectos e Ingeniería. July. Alcañiz. July, 16-18. Retrieved fromhttps://bit.ly/2nOFXWk. Recuperado de.
11. Luna, C. (2015). El futuro del aprendizaje 2 ¿Qué tipo de aprendizaje se necesita en el siglo XXI?, UNESCO. Retrieved from https://bit.ly/2vVdHIt.
12. López, M. (2013). Aprendizaje, Competencias y TIC, Pearson Education. México.
13. McMillan, J., & Schumacher, S. (2005). Investigación educativa. Pearson. Madrid.
14. OCDE, (2005). The definition and selection of key competencies. Executive summary, Retrieved from http://www.oecd.org/pisa/35070367.pdf.
15. OECD, (2018). The Future of Education and Skills. Education 2030, Institute of Educational Technologies. Paris. Retrieved from http://bit.ly/2Wnbi7G.
16. Pérez, R. (2006). Evaluación de Programas Educativos, La Muralla. Madrid.
17. Pérez, R., Galán, A., & Quintanal, J. (2012). Métodos y diseños de investigación en educación, UNED. Madrid España.
18. Pérez-Escoda, A. (2017). Competencias mediáticas, TIC y competencias digitales, Editorial UOC. Barcelona.
19. Rangel, A. (2015). Competencias docentes digitales: propuesta de un perfil. Píxel-Bit. Revista de Medios y Educación, 46:235-248. https://doi.org/10.12795/pixelbit.2015.i46.15. Retrieved from https://bit.ly/2Ubq24n.
20. Rectores, C. N. (2017). Sexto Informe del Estado de la Educación. San José, Costa Rica, Retrieved from https://bit.ly/2fe6eL0.
21. Ries, E. (2011). The Lean Startup. How today´s entrepreneurs use continuous innovation to create radically successful businesses, Crown Business. New York.
22. Ritika, P. (2015). Lean Startup story: from volunteer to entreprenuer, Lean Startup Corporation. Retrieved from https://bit.ly/2XI0Qog.
23. Rychen, D.S., & Salganik, L.H. (2000). Defining and selecting key competencies, Hogrefe. Göttingen.
24. Schwarts, B. (2016). Efecto dominó [Rippling]. Como los emprendedores sociales propagan la innovación por todo el mundo, Empresa Activa. Barcelona.
25. Seas, J. (2016). Didáctica General I, EUNED. San José.
26. Sepúlveda, J., Denegri, M., Orellana, L., Criado, N., Mendoza, J., Salazar, P., & Yung, G. (2017). Características emprendedoras personales y alfabetización económica: una comparación entre estudiantes universitarios del sur de Chile. Interdisciplinaria, 34(1):107-124. https://doi.org/10.16888/interd.2017.34.1.7. Retrieved from https://bit.ly/2UoAs0r.
27. Sevillano, M., & Vázquez, E. (2015). Modelos de investigación en contextos móviles y ubicuos en Educación Superior, McGraw-Hill. Madrid.
28. Shank, R. (2011). Teaching Minds: How Cognitive Science Can Save Our Schools, College Press. New York.
29. Sáez, J. (2017). Investigación Educativa. Fundamentos teóricos, procesos y elementos prácticos. (Enfoque práctico con ejemplos esencial para TFG, TFM y tesis), UNED España, AEBOE.
30. UNESCO, (2008). Estándares de competencia en TIC para docentes, Retrieved from https://bit.ly/2Vru4WD.
31. UNESCO, (2016). Competencias y estándares TIC desde la dimensión pedagógica, Retrieved from https://bit.ly/2ulveWd.
32. Vuorikari, R., Punie, Y., Carretero, S., & Brande, L.V. (2016). DigComp 2.0: The digital competence framework for citizens. Update Phase 1: The Conceptual Reference Model, European Commission. Luxembourg.
33. Zúñiga, M., Núñez, O., Brenes, M., & Chacón, D. (2013). La ruta hacia la apropiación de las TIC en los educadores costarricenses. En Cuarto Informe Estado de la Educación, Programa Estado de la Nación. San José.