A toolkit for successful workplace learning analytics at software vendors
- Authors: Whale, Alyssa Morgan
- Date: 2024-04
- Subjects: Computer-assisted instruction , Intelligent tutoring systems , Information visualisation
- Language: English
- Type: Doctoral theses , text
- Identifier: http://hdl.handle.net/10948/64448 , vital:73713
- Description: Software vendors commonly provide digital software training to their stakeholders and therefore are faced with the problem of an influx of data collected from these training/learning initiatives. Every second of every day, data is being collected based on online learning activities and learner behaviour. Thus, online platforms are struggling to cope with the volumes of data that are collected, and companies are finding it difficult to analyse and manage this data in a way that can be beneficial to all stakeholders. The majority of studies investigating learning analytics have been conducted in educational settings. This research aimed to develop and evaluate a toolkit that can be used for successful Workplace Learning Analytics (WLA) at software vendors. The study followed the Design Science Research (DSR) methodology, which was applied in iterative cycles where various components of the toolkit were designed, developed, and evaluated by participants. The real-world-context was a software vendor, ERPCo, which has been struggling to implement WLA successfully with their current Learning Experience Platform (LXP), as well as with their previous platform. Qualitative data was collected using document analysis of key company documents and Focus Group Discussions (FGDs) with employees from ERPCo to explore and confirm different topics and themes. These methods were used to iteratively analyse the As-Is and To-Be situations at ERPCo and to develop and evaluate the proposed WLA Toolkit. The method used to analyse the collected data from the FGDs was the Qualitative Content Analysis (QCA) method. To develop the first component of the toolkit, the Organisation component, the organisational success factors that influence the success of WLA were identified using a Systematic Literature Review (SLR). These factors were discussed and validated in two exploratory FGDs held with employees from ERPCo, one with operational stakeholders and the other with strategic decision makers. The DeLone and McLean Information Systems (D&M IS) Success Model was used to undergird the research as a theory to guide the understanding of the factors influencing the success of WLA. Many of the factors identified in theory were found to be prevalent in the real-world-context, with some additional ones being identified in the FGDs. The most frequent challenges highlighted by participants were related to visibility; readily available high-quality data; flexibility of reporting; complexity of reporting; and effective decision making and insights obtained. Many of these related to the concept of usability issues for both the system and the information, which is specifically related to System Quality or Information Quality from the D&M IS Success Model. The second and third components of the toolkit are the Technology and Applications; and Information components respectively. Therefore, architecture and data management challenges and requirements for these components were analysed. An appropriate WLA architecture was selected and then further customised for use at ERPCo. A third FGD was conducted with employees who had more technical roles in ERPCo. The purpose of this FGD was to provide input on the architecture, technologies and data management challenges and requirements. In the Technology and Applications component of the WLA Toolkit, factors influencing WLA success related to applications and visualisations were considered. An instantiation of this component was demonstrated in the fourth FGD, where learning data from the LXP at ERPCo was collected and a dashboard incorporating recommended visualisation techniques was developed as a proof of concept. In this FGD participants gave feedback on both the dashboard and the toolkit. The artefact of this research is the WLA Toolkit that can be used by practitioners to guide the planning and implementation of WLA in large organisations that use LXP and WLA platforms. Researchers can use the WLA Toolkit to gain a deeper understanding of the required components and factors for successful WLA in software vendors. The research also contributes to the D&M IS Success Model theory in the information economy. In support of this PhD dissertation, the following paper has been published: Whale, A. & Scholtz, B. 2022. A Theoretical Classification of Organizational Success Factors for Workplace Learning Analytics. NEXTCOMP 2022. Mauritius. A draft manuscript for a journal paper was in progress at the time of submitting this thesis. , Thesis (PhD) -- Faculty of Science, School of Computer Science, Mathematics, Physics and Statistics , 2024
- Full Text:
- Date Issued: 2024-04
- Authors: Whale, Alyssa Morgan
- Date: 2024-04
- Subjects: Computer-assisted instruction , Intelligent tutoring systems , Information visualisation
- Language: English
- Type: Doctoral theses , text
- Identifier: http://hdl.handle.net/10948/64448 , vital:73713
- Description: Software vendors commonly provide digital software training to their stakeholders and therefore are faced with the problem of an influx of data collected from these training/learning initiatives. Every second of every day, data is being collected based on online learning activities and learner behaviour. Thus, online platforms are struggling to cope with the volumes of data that are collected, and companies are finding it difficult to analyse and manage this data in a way that can be beneficial to all stakeholders. The majority of studies investigating learning analytics have been conducted in educational settings. This research aimed to develop and evaluate a toolkit that can be used for successful Workplace Learning Analytics (WLA) at software vendors. The study followed the Design Science Research (DSR) methodology, which was applied in iterative cycles where various components of the toolkit were designed, developed, and evaluated by participants. The real-world-context was a software vendor, ERPCo, which has been struggling to implement WLA successfully with their current Learning Experience Platform (LXP), as well as with their previous platform. Qualitative data was collected using document analysis of key company documents and Focus Group Discussions (FGDs) with employees from ERPCo to explore and confirm different topics and themes. These methods were used to iteratively analyse the As-Is and To-Be situations at ERPCo and to develop and evaluate the proposed WLA Toolkit. The method used to analyse the collected data from the FGDs was the Qualitative Content Analysis (QCA) method. To develop the first component of the toolkit, the Organisation component, the organisational success factors that influence the success of WLA were identified using a Systematic Literature Review (SLR). These factors were discussed and validated in two exploratory FGDs held with employees from ERPCo, one with operational stakeholders and the other with strategic decision makers. The DeLone and McLean Information Systems (D&M IS) Success Model was used to undergird the research as a theory to guide the understanding of the factors influencing the success of WLA. Many of the factors identified in theory were found to be prevalent in the real-world-context, with some additional ones being identified in the FGDs. The most frequent challenges highlighted by participants were related to visibility; readily available high-quality data; flexibility of reporting; complexity of reporting; and effective decision making and insights obtained. Many of these related to the concept of usability issues for both the system and the information, which is specifically related to System Quality or Information Quality from the D&M IS Success Model. The second and third components of the toolkit are the Technology and Applications; and Information components respectively. Therefore, architecture and data management challenges and requirements for these components were analysed. An appropriate WLA architecture was selected and then further customised for use at ERPCo. A third FGD was conducted with employees who had more technical roles in ERPCo. The purpose of this FGD was to provide input on the architecture, technologies and data management challenges and requirements. In the Technology and Applications component of the WLA Toolkit, factors influencing WLA success related to applications and visualisations were considered. An instantiation of this component was demonstrated in the fourth FGD, where learning data from the LXP at ERPCo was collected and a dashboard incorporating recommended visualisation techniques was developed as a proof of concept. In this FGD participants gave feedback on both the dashboard and the toolkit. The artefact of this research is the WLA Toolkit that can be used by practitioners to guide the planning and implementation of WLA in large organisations that use LXP and WLA platforms. Researchers can use the WLA Toolkit to gain a deeper understanding of the required components and factors for successful WLA in software vendors. The research also contributes to the D&M IS Success Model theory in the information economy. In support of this PhD dissertation, the following paper has been published: Whale, A. & Scholtz, B. 2022. A Theoretical Classification of Organizational Success Factors for Workplace Learning Analytics. NEXTCOMP 2022. Mauritius. A draft manuscript for a journal paper was in progress at the time of submitting this thesis. , Thesis (PhD) -- Faculty of Science, School of Computer Science, Mathematics, Physics and Statistics , 2024
- Full Text:
- Date Issued: 2024-04
An e-learning environment for enterprise resource planning systems
- Authors: Whale, Alyssa Morgan
- Date: 2016
- Subjects: Blended learning Computer-assisted instruction Information storage and retrieval systems -- Business
- Language: English
- Type: Thesis , Masters , MCom
- Identifier: http://hdl.handle.net/10948/13182 , vital:27159
- Description: Enterprise Resource Planning (ERP) education can positively impact the success of an ERP implementation. Incorporating new tools and technologies into the learning process can potentially alleviate the evident problems with ERP education. Blended learning and e-learning environments both offer opportunities for improvement in education. However, there are various factors and components that need to be in place for such an environment to be successful. The aim of this research is to provide an ERP e-Learning Environment (ERPeL) that can assist with ERP education in terms of creating an integrated and comprehensive learning environment for novice ERP users. In order to achieve this aim, this study followed the Design-Based Research (DBR) methodology which is specific to educational technology research and was applied in iterative cycles where various components of the environment were evaluated by different participants. Quantitative and qualitative data was collected by means of field studies (interviews, focus groups and questionnaires). The proposed ERPeL underwent several iterations of feedback and improvement. In order to determine the success of e-learning, various critical success factors and evaluation criteria were investigated. Field studies were conducted in order to validate the theory in a real-world context. An initial field study was conducted with third year Nelson Mandela Metropolitan University (NMMU) students who were enrolled in the 2014 ERP systems’ module in the Department of Computing Sciences. Many of the problems identified in theory were found to be prevalent in the real-world context. One of the DBR process cycles involved the implementation of specific components of the ERPeL at the Developing and Strengthening Industry-driven Knowledge-transfer between developing Countries (DASIK) introduction to ERP systems course. Participants were either NMMU students, academic staff or industry delegates. The components evaluated included videos, learning content, badges, assessment and the SYSPRO Latte m-learning application. Additional components of a leader board, live chats, peer reviewing, expert reviews, user generated content, consultancy with experts and SYSPRO ERP certification were implemented in the subsequent cycle where participants were 2015 third year NMMU ERP systems students. The criteria used to evaluate the success of the ERPeL and its e-learning components were adapted from literature and a new set of evaluation criteria for e-learning was proposed. The ERPeL is made up of Moodle, the SYSPRO ERP System, the SYSPRO e-Learning System, the SYSPRO Latte m-learning application, learning content and components. Overall the ERPeL was positively received by the various sample groups. The research results indicate that the use of an e-learning environment for ERP systems was positively received. The most positive aspects reported were the implementation of e-learning components such as the interactive videos, simulations and m-learning. In support of this Masters dissertation, the following three papers have been published and presented at two local conferences and one international conference: 1. SACLA 2014, Port Elizabeth (South Africa); 2. SAICSIT 2015, Stellenbosch (South Africa); and 3. IDIA 2015, Zanzibar (Tanzania).
- Full Text:
- Date Issued: 2016
- Authors: Whale, Alyssa Morgan
- Date: 2016
- Subjects: Blended learning Computer-assisted instruction Information storage and retrieval systems -- Business
- Language: English
- Type: Thesis , Masters , MCom
- Identifier: http://hdl.handle.net/10948/13182 , vital:27159
- Description: Enterprise Resource Planning (ERP) education can positively impact the success of an ERP implementation. Incorporating new tools and technologies into the learning process can potentially alleviate the evident problems with ERP education. Blended learning and e-learning environments both offer opportunities for improvement in education. However, there are various factors and components that need to be in place for such an environment to be successful. The aim of this research is to provide an ERP e-Learning Environment (ERPeL) that can assist with ERP education in terms of creating an integrated and comprehensive learning environment for novice ERP users. In order to achieve this aim, this study followed the Design-Based Research (DBR) methodology which is specific to educational technology research and was applied in iterative cycles where various components of the environment were evaluated by different participants. Quantitative and qualitative data was collected by means of field studies (interviews, focus groups and questionnaires). The proposed ERPeL underwent several iterations of feedback and improvement. In order to determine the success of e-learning, various critical success factors and evaluation criteria were investigated. Field studies were conducted in order to validate the theory in a real-world context. An initial field study was conducted with third year Nelson Mandela Metropolitan University (NMMU) students who were enrolled in the 2014 ERP systems’ module in the Department of Computing Sciences. Many of the problems identified in theory were found to be prevalent in the real-world context. One of the DBR process cycles involved the implementation of specific components of the ERPeL at the Developing and Strengthening Industry-driven Knowledge-transfer between developing Countries (DASIK) introduction to ERP systems course. Participants were either NMMU students, academic staff or industry delegates. The components evaluated included videos, learning content, badges, assessment and the SYSPRO Latte m-learning application. Additional components of a leader board, live chats, peer reviewing, expert reviews, user generated content, consultancy with experts and SYSPRO ERP certification were implemented in the subsequent cycle where participants were 2015 third year NMMU ERP systems students. The criteria used to evaluate the success of the ERPeL and its e-learning components were adapted from literature and a new set of evaluation criteria for e-learning was proposed. The ERPeL is made up of Moodle, the SYSPRO ERP System, the SYSPRO e-Learning System, the SYSPRO Latte m-learning application, learning content and components. Overall the ERPeL was positively received by the various sample groups. The research results indicate that the use of an e-learning environment for ERP systems was positively received. The most positive aspects reported were the implementation of e-learning components such as the interactive videos, simulations and m-learning. In support of this Masters dissertation, the following three papers have been published and presented at two local conferences and one international conference: 1. SACLA 2014, Port Elizabeth (South Africa); 2. SAICSIT 2015, Stellenbosch (South Africa); and 3. IDIA 2015, Zanzibar (Tanzania).
- Full Text:
- Date Issued: 2016
- «
- ‹
- 1
- ›
- »