{"id":361,"date":"2019-10-06T16:04:37","date_gmt":"2019-10-06T13:04:37","guid":{"rendered":"https:\/\/www.compufinancials.nl\/?p=361"},"modified":"2019-10-14T13:12:39","modified_gmt":"2019-10-14T10:12:39","slug":"quality-assurance-approaches-when-using-low-code-platforms","status":"publish","type":"post","link":"https:\/\/www.compufinancials.nl\/wp\/blogpost\/quality-assurance-approaches-when-using-low-code-platforms\/","title":{"rendered":"Quality Assurance approaches when using low-code platforms"},"content":{"rendered":"\n

Reviewing paper ‘Developing a Software Quality Framework for low-code Model Driven Development Platforms based on Behaviour Driven Development Methodology’ (Braams, 2017).<\/p>\n\n\n\n

\n\n\n\n

Application of a Behaviour Driven Development approach<\/h2>\n\n\n\n

A case study at one company\neMagiz using the Low-Code Model Driven Development (LCMDD) platform Mendix is\nexecuted, to examine a possible fit of the Behaviour Driven Development (BDD)\nmethodology and LCMDD for developing a testing within LCMDD. Based on a\npractitioner\u2019s experience (Outsystems) the author assumes that BDD is the best\nfit to LCMDD for quality assurance. A literature study on BDD is presented. The\nmaturity of testing in the LCMDD field is expressed based on Testing Maturity\nModel (which is part of the Capability Maturity Model) and it is concluded that\nLCMDD is nearing the end of level 2 and moving towards level 3. The paper\nconcludes that \u201cthe potential for automation in the context of LCMDD is\nhindered by the low maturity of the entire field\u2026\u201d. The paper presents a brief\nLCMDD software quality framework, which should be validated with further\nempirical research.<\/p>\n\n\n\n

\n\n\n\n
\"\"<\/figure>
\n

The research and its results<\/h2>\n\n\n\n

<\/p>\n<\/div><\/div>\n\n\n\n

The research question is not very clear from the start of the paper. In the abstract the author presents a short research question in the second half of a sentence \u201c\u2026., research is needed to investigate a possible quality assurance approach\u201d. This could have been made clearer by adding a hypothesis; \u201cwould a Behaviour Driven Development (BDD) approach improve quality assurance within the LCMDD field\u201d.   <\/p>\n\n\n\n

\n\n\n\n

“By 2024 three-quarter of large enterprises will be using at least four low-code tools for both IT application development and citizen development initiatives”.<\/p>www.gartner.com accessed 4th of October 2019<\/cite><\/blockquote>\n\n\n\n

\n\n\n\n

The research question is very relevant as more and more companies are discovering the potential benefits from using a Low-Code platform. Based on Gartner’s ‘Magic Quadrant for Enteprise Low-Code Application Platforms’, by 2024 low-code application development will be responsible for more than 65% of application development activity (www.gartner.com accessed 4th of October 2019). Understanding any changes on quality assurance processes when using low-code platform is a relevant for all companies starting using them.<\/p>\n\n\n\n

The research presented in the paper is original. When doing further research on this topic using key words in different combinations: no-code; low-code; testing; quality assurance; behaviour driven development; strategy, no peer-reviewed papers where found on the same or corresponding topics. <\/p>\n\n\n\n

Adding a\nclear description of BDD with its six characteristics according to Solis &\nWang (2011), would have improved understanding the BDD concept. Solis &\nWang argue that BDD focuses mainly on the implementation phase of a software\nproject and provide limited support in the analysis and planning phase. To\nconnect quality assurance in the LCMDD situation with its context of quality\nassurance within a company as a whole, a connection of the proposed quality\nframework with the EFQM model can add further understanding of the interaction\nbetween IS quality and quality assurance within the company\u2019s processes.\nInformation systems dimensions should be integrated as supportive mechanisms in\nthe EFQM for successful application of EFQM (Sadeh, Arumugam & Malarvizhi,\n2013). Sadeh et. al., propose an IS-QM model where information systems\u2019 quality\nprocesses are interlinked with the other EFQM dimensions.<\/p>\n\n\n\n

\n\n\n\n

“Netherlands’ largest construction company the BAM is using Mendix for their operation excellence goals”<\/p>www. mendix.com\/customer-stories\/ accessed 5th of October 2019<\/cite><\/blockquote>\n\n\n\n

\n\n\n\n

There is a literature study included on four researchers and a case study within one small company. The case study was conducted by doing three semi-structured interviews at eMagiz. The literature study includes several relevant thinkers on testing and quality. The case is of limited value as it includes only one small company, having only one client. An addition case study within a large company would have reduced the limited contribution of the findings. For instance Netherlands\u2019 largest construction company the BAM is using Mendix for operational excellence (among others) mendix.com\/customer-stories\/<\/a> (accessed 5th of October 2019). <\/p>\n\n\n\n

\n\n\n\n

“A Resource Based View: Information Systems are not sufficient to create competitive advantage”<\/p>(Taher, 2012)<\/cite><\/blockquote>\n\n\n\n

\n\n\n\n
\"\"<\/figure>
\n

Adding a holistic view on how and why companies should use LCMDD like a Resource Based View (RBV) approach, would improve the context of LCMDD. According to Taher (2012), information systems are essential but not enough to attain competitive advantage. As part of the BDD approach \u2013 IT resource and non-IT resources are interacting in creating value and quality with LCMDD. How are these resources interacting and influencing each other? When applying a RBV, could resource orchestration<\/em> (Taher, 2012) support quality assurance in LCMDD projects?<\/p>\n<\/div><\/div>\n\n\n\n

\n\n\n\n
\"\"<\/figure>
\n

BDD, DevOps & ‘Silo Busting’<\/h2>\n<\/div><\/div>\n\n\n\n
\n\n\n\n

The research contains a literature study and a case study including three interviews at one small company. The literature research seems appropriate where it includes important frameworks from Cynefin, Adzic and Agile testing matrix. The case study is of limited value and does not support the finding and proof for the developed software quality framework.<\/p>\n\n\n\n

\n\n\n\n

“Outsystems has incorporated BDD and DevOps functionality into their low-code platform”<\/p>https:\/\/www.outsystems.com\/news\/outsystems-five-new-devops-features-low-code\/ accessed 5th of October 2019<\/cite><\/blockquote>\n\n\n\n

\n\n\n\n

The value of the findings could be increased by referring to the fact that Outsystems.com (as the author is referring to this company to legitimate the linkage between BDD and LCMDD) has incorporated BDD in their quality framework in combination with a DevOps way of working (www.outsystems.com<\/a> accessed 5th October 2019). Further interesting question here is to examine the connection of BDD with DevOps. For instance, to call in another practitioner IBM, they are actually linking BDD directly to a DevOps culture in \u2018Build a DevOps culture and team\u2019 (www.ibm.com<\/a> accessed <\/sup>5th October 2019). A DevOps culture is characterised by collaboration across roles and departments focusing on the business objectives instead of the departmental objectives (ww.ibm.com). Another important aspect on QA approach is the culture within the company. Further research on the impact of the culture on the effectiveness of the proposed quality framework would add to possible application. Further research on the question how a DevOps culture relates to the \u2018integrated-independence\u2019 as explained by Chapman & Chua (2003) would add to the topic about \u2018Silo busting\u2019 .<\/p>\n\n\n\n

The paper does not include quantitative research. The qualitative analyses are more or less based on assumptions by the author, referring to the stories presented of thought leaders (according to the author). The conclusions by the author: \u201dfit of BDD with LCMDD, lack of established testing methodology & the proposed LCMDD Quality framework\u201d are not supported by data and therefore lack sufficient background to support a solid and relevant contribution.   <\/p>\n\n\n\n

\n\n\n\n
\"\"<\/figure>
\n

Possible improvements on presentation<\/h2>\n<\/div><\/div>\n\n\n\n

The paper is well structured but lacks tables and figures. In several situations where the author discusses other frameworks, figures and tables within the body of the text would have improved the readability and understanding of the topic. In general, a larger part of the used concepts and methods are not explained, assuming the reader being familiar with them. Terms are all written out, explanation of some concepts (for instance BDD) is missing.<\/p>\n\n\n\n

The result \u2013\nresearch aim \u2013 the proposed quality framework for LCMDD is presented hardly\nreadable in the appendix. Presenting the proposed model in readable size within\nthe body of the text including explanation of the different stages within the\nmodel would have made the quality model much more clear.<\/p>\n\n\n\n

\n\n\n\n
\"\"<\/figure>
\n

Company wide context?<\/h2>\n<\/div><\/div>\n\n\n\n

Significance of the quality model would be improved if  a connection of Behaviour Driven Development with company wide IS projects was included: How does LCMDD and BDD fit into the implementation of ERP systems? Does it improve\/mitigate the concern expressed by Chapman & Chua (2003) about possible increasing misconnect between the standardised and automated processes and the day-to-day business processes impacting the quality of management control. <\/em><\/p>\n\n\n\n

\n\n\n\n

Reference list<\/h4>\n\n\n\n

Braams, S. (2017). Developing a Software Quality Framework for Low-Code Model Driven Development\nPlatforms Based on Behaviour Driven Development Methodology<\/em>. University of\nTwente, The Netherlands.<\/p>\n\n\n\n

Chapman, C. & Chua, W.F. (2003). Technology-Driven Integration, Automation and Standardization of\nBusiness Processes<\/em>. Managing accounting in the digital economy.  Oxford University Press. pp74-94.<\/p>\n\n\n\n

Gartner.com. https:\/\/www.gartner.com\/en\/documents\/3956079<\/a>, via www.outsystems.com<\/a>. Magic Quadrant for Enterprise Low-Code Application\nPlatforms<\/em>.\nAccessed 4th of 2019.<\/p>\n\n\n\n

IBM https:\/\/www.ibm.com\/garage\/method\/practices\/code\/practice_behavior_driven_development\/practice_building_culture<\/a>.\nAccessed 5th<\/sup> of October 2019.<\/p>\n\n\n\n

Mendix.\nhttps:\/\/www.mendix.com\/customer-stories\/<\/a> Bam customer story. Accessed 5th<\/sup> of October 2019.<\/p>\n\n\n\n

Sadeh, E.,\nArumugam, V. C., & Malarvizhi, C. A. (2013). Integration of EFQM framework\nand quality information systems. Total Quality Management\n& Business Excellence<\/em>, 24<\/em>(1-2), 188-209.<\/p>\n\n\n\n

Solis, C.,\n& Wang, X. (2011). A study of the\ncharacteristics of behaviour driven development<\/em>. In 2011 37th EUROMICRO Conference on Software\nEngineering and Advanced Applications (pp.\n383-387). IEEE.<\/p>\n\n\n\n

Taher, M (2012). Resource-Based View Theory<\/em>. In Y.K. Dwivedi et al. (eds.), Information Systems Theory: Explaining and Predicting Our Digital Society, Vol. 1<\/em>, Integrated Series in Information Systems Vol. 1, pp151-161. Springer Science+Business Media, LLC 2012.<\/p>\n","protected":false},"excerpt":{"rendered":"

Reviewing paper ‘Developing a Software Quality Framework for low-code Model Driven Development Platforms based on Behaviour Driven Development Methodology’ (Braams, 2017).<\/p>\n","protected":false},"author":2,"featured_media":362,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"off","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[7],"tags":[],"_links":{"self":[{"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/posts\/361"}],"collection":[{"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/comments?post=361"}],"version-history":[{"count":46,"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/posts\/361\/revisions"}],"predecessor-version":[{"id":454,"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/posts\/361\/revisions\/454"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/media\/362"}],"wp:attachment":[{"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/media?parent=361"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/categories?post=361"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.compufinancials.nl\/wp\/wp-json\/wp\/v2\/tags?post=361"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}