5977fde40c2fad6249e81aa5c429dc0cf324be20
[phd-thesis.git] / intro / intro.tex
1 \documentclass[../thesis.tex]{subfiles}
2
3 \input{subfilepreamble}
4 \setcounter{chapter}{0}
5
6 \begin{document}
7 \input{subfileprefix}
8 \chapter{Prelude}%
9 \label{chp:introduction}
10 \begin{chapterabstract}
11 This chapter introduces the dissertation by providing:
12 \begin{itemize}
13 \item a general introduction to the topics and research directions;
14 \item a reading guide;
15 \item background material on the \glsxtrlong{IOT}, \glsxtrlongpl{DSL}, \glsxtrlong{TOP}, \gls{ITASK}, and \gls{MTASK};
16 \item and a detailed overview of the scientific contributions of this dissertation.
17 \end{itemize}
18 \end{chapterabstract}
19
20 This dissertation is about orchestrating \gls{IOT} systems harmlessly and efficiently.
21 \todo{beter?}
22 There are at least 13.4 billion devices connected to the internet at the time of writing \citep{transforma_insights_current_2023}.
23 Each of these devices sense, act, or otherwise, interact with people, computers, and the environment.
24 Despite their immense diversity, they are all computers and they all require software to operate.
25
26 An increasing number of these connected devices are so-called edge devices that operate in the \gls{IOT}.
27 Edge devices are the leaves of the \gls{IOT} systems.
28 They perform the interaction with the physical world.
29 It is not uncommon for edge devices to be physically embedded in the fabric itself.
30 Typically, they reside in hard-to-reach places such as light bulbs, clothing, smart electricity meters, buildings, or even farm animals.
31 The majority of edge devices are powered by microcontrollers.
32 Microcontrollers are equipped with a lot of connectivity for integrating peripherals such as sensors and actuators.
33 The connectivity makes them very suitable to interact with their surroundings.
34 These miniature computers contain integrated circuits that accommodate a microprocessor designed for use in embedded applications.
35 As a consequence, microcontrollers are cheap; tiny; have little memory; and contain a slow, but energy-efficient processor.
36
37 When coordinating an orchestra of edge devices, there is room for little error.
38 Edge devices come and go, perform their own pieces, or are sometimes instructed to perform a certain piece, they might even operate without a central authority.
39 In a traditional setting, an \gls{IOT} engineer has to program each device and their interoperation using different programming paradigms, programming languages, and abstraction levels.
40 This results in semantic friction, which makes programming and maintaining \gls{IOT} systems a complex and error-prone process.
41
42 This dissertation describes the research carried out around orchestrating these complex \gls{IOT} systems using \gls{TOP}.
43 \Gls{TOP} is an innovative tierless programming paradigm for interactive multi-layered systems.
44 By utilising advanced compiler technologies, much of the internals, communication, and interoperation between the tiers or layers of the applications are automatically generated.
45 The compiler makes an application controlling all interconnected components from a single declarative specification of the required work.
46 For example, the \gls{TOP} system \gls{ITASK} is used to program all layers of multi-user distributed web applications from a single source specification.
47 It is implemented in the general-purpose lazy functional programming language \gls{CLEAN}, and therefore requires relatively powerful hardware.
48 The inflated hardware requirements are no problem for regular computers but impractical for the average edge device.
49
50 This is where an additional \glspl{DSL} must play its part.
51 \Glspl{DSL} are programming languages tailored to a specific domain.
52 Consequently, jargon is not expressed in terms of the language itself, but are built-in language features.
53 Furthermore, the \gls{DSL} can eschew language or system features that are irrelevant for the domain.
54 Using \glspl{DSL}, hardware requirements can be drastically lowered, even while maintaining a high abstraction level for the specified domain.
55
56 To incorporate the plethora of edge devices in the orchestra of a \gls{TOP} system, the \gls{MTASK} system is used.
57 The \gls{MTASK} language is a novel programming language for programming \gls{IOT} edge devices using \gls{TOP}.
58 Where \gls{ITASK} abstracts away from the gritty details of multi-tier web applications, \gls{MTASK} has domain-specific abstractions for \gls{IOT} edge devices, maintaining the high abstraction level that \gls{TOP} offers.
59 As it is integrated with \gls{ITASK}, it allows for all layers of an \gls{IOT} application to be programmed from a single source.
60
61 \section{Reading guide}%
62 \label{lst:reading_guide}
63 This work is structured as a purely functional rhapsody.
64 The \citet{wikipedia_contributors_rhapsody_2022} define a musical rhapsody is defined as follows:
65 \begin{quote}\emph{%
66 A \emph{rhapsody} in music is a one-movement work that is episodic yet integrated, free-flowing in structure, featuring a range of highly contrasted moods, colour, and tonality.}
67 \end{quote}
68 This dissertation consists of three episodes.
69 \Cref{prt:dsl} is a paper-based---otherwise known as cumulative---episode containing chapters that provide insight in advanced \gls{DSL} embedding techniques for \gls{FP} languages.
70 The chapters can be read independently of each other.
71 \Cref{prt:top} is a monograph showing \gls{MTASK}, a \gls{TOP} \gls{DSL} for the \gls{IOT}.
72 Hence, the chapters in this episode are best read in order.
73 It introduces \gls{IOT} edge device programming, shows the complete \gls{MTASK} language, provides details on how \gls{MTASK} is integrated with \gls{ITASK}, shows how the byte code compiler is implemented, presents a guide for green computing with \gls{MTASK}, and ends with a conclusion and overview of future and related work.
74 \Cref{prt:tvt} consists of a single chapter that is based on a journal article.
75 The chapter provides a qualitative and quantitative comparison of traditional tiered \gls{IOT} programming and tierless programming using a real-world application.
76 The chapter is readable independently.
77
78 The following sections in this prelude provide background material on the \gls{IOT}, \glspl{DSL}, and \gls{TOP} after which a detailed overview of the contributions is presented.
79
80 \section{Internet of things}%
81 \label{sec:back_iot}
82 The \gls{IOT} is growing rapidly, and it is changing the way people and machines interact with each other and the world.
83 While the term \gls{IOT} briefly gained interest around 1999 to describe the communication of \gls{RFID} devices \citep{ashton_internet_1999,ashton_that_2009}, it probably already popped up halfway the eighties in a company speech by \citet{lewis_speech_1985}:
84
85 \begin{quote}
86 \emph{The \glsxtrlong{IOT}, or \glsxtrshort{IOT}, is the integration of people, processes and technology with connectable devices and sensors to enable remote monitoring, status, manipulation and evaluation of trends of such devices.}
87 \end{quote}
88
89 Much later, CISCO states that the \gls{IOT} started when there were as many connected devices as there were people on the globe, i.e.\ around 2008 \citep{evans_internet_2011}.
90 Today, \gls{IOT} is the term for a system of devices that sense the environment, act upon it, and communicate with each other and the world they operate in.
91 These connected devices are already in households all around us in the form of smart electricity meters, fridges, phones, watches, home automation, \etc.
92
93 When describing \gls{IOT} systems, a tiered---or layered---architecture is often used for compartmentalisation.
94 The number of tiers depends on the required complexity of the model.
95 For the intents and purposes of this thesis, the layered architecture as shown in \cref{fig:iot-layers} is used.
96
97 \begin{figure}
98 \centering
99 \includestandalone{iot-layers}
100 \caption{A layered \gls{IOT} architecture.}%
101 \label{fig:iot-layers}
102 \end{figure}
103
104 To explain the tiers, an example \gls{IOT} application---home automation---is dissected.
105 Closest to the end-user is the presentation layer.
106 This layer provides the interface between the user and the \gls{IOT} system.
107 In home automation this may be a web interface, an app used on a phone, or wall-mounted tablet to interact with edge devices and view sensor data.
108
109 The application layer is the core of the system.
110 It provides the \glspl{API}, data interfaces, data storage processing, and data processing of \gls{IOT} systems.
111 A cloud server or local server provides this layer in a typical home automation application.
112
113 The perception layer---also called edge layer---collects the data and interacts with the environment.
114 It consists of edge devices such as microcontrollers equipped with various sensors and actuators.
115 In home automation this layer consists of all devices hosting sensors and actuators such as smart light bulbs, actuators to open doors, or temperature and humidity sensors.
116
117 All layers are connected using the network layer.
118 In some applications this is implemented using conventional networking techniques such as \gls{WIFI} or Ethernet.
119 However, network technology that is tailored to the needs of the specific interconnection between two layers is increasingly popular.
120 Examples of this are BLE, LoRa, ZigBee, and LTE-M as a communication protocol for connecting the perception layer to the application layer using \gls{IOT} transport protocols such as \gls{MQTT}.
121 Protocols such as HTTP, AJAX, and WebSocket connecting the presentation layer to the application layer that are designed for the use in web applications.
122
123 \todo[inline]{Hier enkele zinnen over maintainability}
124 Across the layers, the devices are a large heterogeneous collection of different platforms, protocols, paradigms, and programming languages often resulting in impedance problems or semantic friction between layers when programming \citep{ireland_classification_2009}.
125 Even more so, the perception layer itself is often a heterogeneous collection of microcontrollers in itself, each having their own peculiarities, programming language of choice, and hardware interfaces.
126 As edge hardware needs to be cheap, small scale, and energy efficient, the microcontrollers used to power them do not have a lot of computational power, only a smidge of memory, and little communication bandwidth.
127 Typically, these devices are unable to run a full-fledged general-purpose \gls{OS}.
128 Rather they employ compiled firmware written in imperative languages that combines all tasks on the device in a single program.
129 While devices are getting a bit faster, smaller, and cheaper, they keep these properties to an extent.
130 For example, more powerful microcontrollers are capable of running \glspl{RTOS}, but this still requires a lot of resources and fixes the programs at compile time.
131 As a consequence, the flexibility is greatly reduced for dynamic systems in which tasks are created on the fly, executed on demand, require parallel execution, or have dynamic scheduling behaviour.
132 As program memory is mostly flash-based and only lasts a couple of thousands of writes before it wears out, it is not suitable for repeated reconfiguring and reprogramming.
133
134 Memory wear problems can be mitigated by dynamically sending code to be interpreted to the microcontroller.
135 With interpretation, a specialised interpreter is flashed in the program memory once it receives the program code to execute at run time.
136 Therefore, as the programs are not stored in the flash memory, it does not wear out.
137 It is challenging to create interpreters for small edge devices due to the severe hardware restrictions.
138 This dissertation describes a \gls{DSL} that includes the high-level programming concepts of \gls{TOP}, while it can be executed on edge devices with very limited hardware requirements.
139 It does so by compiling the \gls{DSL} to byte code that is executed in a feather-light domain-specific \gls{OS}.
140
141 \section{Domain-specific languages}%
142 \label{sec:back_dsl}
143 % General
144 Programming languages can be divided up into two categories: \glspl{DSL} and \glspl{GPL} \citep{fowler_domain_2010}.
145 Where \glspl{GPL} are not made with a demarcated area in mind, \glspl{DSL} are tailor-made for a specific domain.
146 Writing idiomatic domain-specific code in a \gls{DSL} is easier and requires less \gls{GPL} knowledge for a domain expert.
147 This does come at the cost of the \gls{DSL} being sometimes less expressive to an extent that it may not even be Turing complete.
148 \Glspl{DSL} come in two main flavours: standalone and embedded (\cref{sec:standalone_embedded})\footnote{Standalone and embedded are also called external and internal respectively.}.
149 Standalone languages are languages for which the complete toolchain has been developed, just as for any other \gls{GPL}.
150 Embedded languages piggyback on an existing language, they are defined in terms of their host language.
151 \Glspl{EDSL} can further be classified into heterogeneous and homogeneous languages (\cref{sec:hetero_homo}).
152 In homogeneous languages all components are integrated whereas in heterogeneous \glspl{DSL}, some parts are agnostic of the other systems, e.g.\ a \gls{DSL} that generates code for execution on a totally different system.
153 This hyponymy is shown in \cref{fig:hyponymy_of_dsls}.
154
155 \begin{figure}
156 \centering
157 \includestandalone{hyponymy_of_dsls}
158 \caption{A hyponymy of \glspl{DSL} (adapted from \citet[\citepage{2}]{mernik_extensible_2013}).}%
159 \label{fig:hyponymy_of_dsls}
160 \end{figure}
161
162 \subsection{Standalone and embedded}%
163 \label{sec:standalone_embedded}
164 \glspl{DSL} were historically created as standalone languages, meaning that all machinery is developed solely for the language.
165 The advantage of this approach is that the language designer is free to define the syntax and type system of the language as they wish, not being restricted by any constraint.
166 Unfortunately it also means that they need to develop a compiler or interpreter, and all the scaffolding for the language, making standalone \glspl{DSL} costly to create.
167 Examples of standalone \glspl{DSL} are \TeX, make, yacc, XML, SQL, \etc.
168
169 The dichotomous approach to standalone \glspl{DSL} is embedding the \gls{DSL} in a host language, i.e.\ \glspl{EDSL} \citep{hudak_modular_1998}.
170 By defining the language as constructs in the host language, much of the machinery is inherited \citep{krishnamurthi_linguistic_2001}.
171 This greatly reduces the cost of creating embedded languages and shields the user from having to learn the host language and toolchain.
172 However, there are two sides to this coin.
173 If the syntax of the host language is not very flexible, the syntax of the \gls{DSL} can become clumsy.
174 Furthermore, \gls{DSL} errors shown to the programmer may be larded with host language errors, making it difficult for a non-expert of the host language to work with the \gls{DSL}.
175 \Gls{FP} languages are especially suitable for hosting embedded \glspl{DSL}.
176 They offer tooling for building abstraction levels by a strong and versatile type system, minimal but flexible syntax, and referential transparency.
177
178 \subsection{Heterogeneity and homogeneity}%
179 \label{sec:hetero_homo}
180 \Citet{tratt_domain_2008} applies a notion from metaprogramming \citep{sheard_accomplishments_2001} to \glspl{EDSL} to define homogeneity and heterogeneity of \glspl{EDSL} as follows:
181
182 \begin{quote}
183 \emph{A homogeneous system is one where all the components are specifically designed to work with each other, whereas in heterogeneous systems at least one of the components is largely, or completely, ignorant of the existence of the other parts of the system.
184 }
185 \end{quote}
186
187 Homogeneous \glspl{EDSL} are languages that are solely defined as an extension to their host language.
188 They often restrict features of the host language to provide a safer interface or capture an idiomatic pattern in the host language for reuse.
189 The difference between a library and a homogeneous \glspl{EDSL} is not always clear.
190 Examples of homogeneous \glspl{EDSL} are libraries such as ones for sets, regions, but also more complex tasks such as \glspl{GUI}.
191
192 On the other hand, heterogeneous \glspl{EDSL} are languages that are not executed in the host language.
193 For example, \citet{elliott_compiling_2003} describe the language Pan, for which the final representation in the host language is a compiler that will, when executed, generate code for a completely different target platform.
194
195 Both \gls{ITASK} and \gls{MTASK} are \glspl{EDSL}.
196 Programs written in \gls{ITASK} run in the host language, and it is a homogeneous \gls{DSL}.
197 Tasks written using \gls{MTASK} are dynamically compiled to byte code for an edge device, making it a heterogeneous \gls{DSL}.
198 The interpreter running on the edge device has no knowledge of the higher level task specification.
199 It just interprets the byte code it was sent and takes care of the communication.
200
201 \section{Task-oriented programming}%
202 \label{sec:back_top}
203 \Gls{TOP} is a declarative programming paradigm for modelling interactive systems \citep{plasmeijer_task-oriented_2012}.
204 Instead of dividing problems into layers, \gls{TOP} deals with separation of concerns in a novel way.
205 This approach to software development is called \gls{TOSD} \citep{wang_maintaining_2018}.
206
207 \begin{figure}
208 \centering
209 \includestandalone{tosd}
210 \caption{Separation of concerns in \gls{TOSD} (adapted from \citep[\citepage{20}]{wang_maintaining_2018}).}%
211 \label{fig:tosd}
212 \end{figure}
213
214 \begin{description}
215 \item[Types:]
216 As can be seen from \cref{fig:tosd}, types are the pivotal component in \gls{TOP}.
217 From the data types, utilising various \emph{type-parametrised} concepts, all other aspects are handled automatically.
218 Hence, all other components arise from and depend on the types in the program.
219 \item[Tasks:]
220 In \gls{TOP} languages, tasks are the basic building blocks.
221 A task is an abstract representation of a piece of work that needs to be done.
222 It provides an abstraction over work in the real world.
223 The nature of tasks makes them observable during execution.
224 It is possible to observe the current task value act upon it, e.g.\ taking a partial result as good enough, or by starting new tasks.
225 Examples of tasks are filling forms, sending emails, reading sensors or even doing physical tasks.
226 Just as with real-life tasks, multiple tasks can be combined in various ways such as in parallel or in sequence to form workflows.
227 Such combination operators are called task combinators.
228 \item[\Glspl{SDS}:]
229 Tasks mainly communicate using their observable task values.
230 However, some collaboration patterns are more easily expressed by tasks that share common data.
231 \Glspl{SDS} fill this gap, they offer a safe abstraction over any data.
232 An \gls{SDS} can represent typed data stored in a file, a chunk of memory, a database, \etc.
233 \Glspl{SDS} can also represent external impure data such as the time, random numbers or sensor data.
234 In many \gls{TOP} languages, combinators are available to filter, combine, transform, and focus \glspl{SDS}.
235 \item[\Gls{UI}:]
236 The \gls{UI} of the system is automatically generated from the structural representation of the types.
237 Though, practical \gls{TOP} systems allow tweaking afterwards to suit the specific needs of the application.
238 \item[\Gls{UOD}:]
239 The \gls{UOD} is explicitly and separately modelled by the data types and relations that exist in the functions of the host language.
240 \end{description}
241
242 \Cref{fig:tosd} differs from the presented \gls{IOT} architecture shown in \cref{fig:iot-layers} because they represent different concepts.
243 The \gls{IOT} architecture is an execution architecture whereas \gls{TOSD} is a software development model.
244 E.g.\ from a software development perspective, a task is a task, whether it is executed on a microcontroller, a server, or a client.
245 Only when a task is executed, the location of the execution becomes important, but this is taken care of by the system.
246 Some concepts from the \gls{TOSD} model can be mapped upon the \gls{IOT} architecture in two ways.
247 Firstly, edge devices can be seen as simple resources, thus accessed through \glspl{SDS}.
248 The second view is that edge devices contain miniature \gls{TOP} systems in itself.
249 The individual components in the miniature systems, the tasks, the \glspl{SDS}, are, in the eventual execution, connected to the main system.
250 \todo{hier plaatje uit 6?: nee}
251
252 \subsection{The iTask system}
253 The concept of \gls{TOP} originated from the \gls{ITASK} framework, a declarative language and \gls{TOP} engine for defining interactive multi-user distributed web applications.
254 The \gls{ITASK} system is implemented as an \gls{EDSL} in the programming language \gls{CLEAN}\footnote{\Cref{chp:clean_for_haskell_programmers} contains a guide for \gls{CLEAN} tailored to \gls{HASKELL} programmers.} \citep{plasmeijer_itasks:_2007,plasmeijer_task-oriented_2012}.
255 It is under development for over fifteen years and has proven itself through use in industry for some time now as well.
256 For example, it is the main language of VIIA, an advanced application for monitoring coasts \citep{top_software_viia_2023}.
257 From the structural properties of the data types and the current status of the work to be done, the entire \gls{UI} is automatically generated.
258 Browsers are powering \gls{ITASK}'s presentation layer.
259 The framework is built on top of standard web techniques such as JavaScript, HTML, and {CSS}.
260 The browser runs the actual \gls{ITASK} code using an interpreter that operates on \gls{CLEAN}'s intermediate language \gls{ABC} \citep{staps_lazy_2019}.
261
262 Tasks in \gls{ITASK} have either \emph{no value}, an \emph{unstable} or a \emph{stable} task value.
263 For example, an editor for filling in a form initially has no value.
264 Once the user entered a complete value, its value becomes an unstable value, it can still be changed or even reverted to no value by emptying the editor again.
265 Only when for example a continue button is pressed, a task value becomes stable, fixing its value.
266 The allowed task value transitions are shown in \cref{fig:taskvalue}.
267
268 \begin{figure}
269 \centering
270 \includestandalone{taskvalue}
271 \caption{Transition diagram for task values in \gls{ITASK}.}%
272 \label{fig:taskvalue}
273 \end{figure}
274
275 As an example, \cref{lst:todo,fig:todo} show the code and \gls{UI} for an interactive to-do list application.
276 The user modifies a shared to-do list through an editor directly or using some predefined actions.
277 Furthermore, in parallel, the length of the list is shown to demonstrate \glspl{SDS}.
278 Using \gls{ITASK}, complex collaborations of users and tasks can be described on a high level.
279
280 From the data type definitions (\cref{lst:todo_dt}), using generic programming (\cref{lst:todo_derive}), the \glspl{UI} for the data types are automatically generated.
281 Then, using the parallel task combinator (\cleaninline{-\|\|}) the task for updating the to-dos (\cref{lst:todo_update}) and the task for viewing the length are combined (\cref{lst:todo_length}, shown as \emph{Length: 2} in the bottom of the image).
282 This particular parallel combinator uses the result of the left-hand side task.
283 Both tasks operate on the to-do \gls{SDS} (\cref{lst:todo_sds}).
284 The task for updating the to-do list is an editor (\cref{lst:todo_editor}) combined using a step combinator (\crefrange{lst:todo_contfro}{lst:todo_contto}).
285 The actions either change the value, sorting or clearing it, or terminate the task by returning the current value of the \gls{SDS}, visualised as three buttons on the bottom right of the \gls{UI}.
286 Special combinators (e.g.\ \cleaninline{@>>} at \cref{lst:todo_ui}) are used to tweak the \gls{UI} to display informative labels.
287 \todo[inline]{Zou je hier niet zeggen dat dit iTask programma de Presentation en Application layer uit Figure 1.1 maakt door dezelfde code in de browser en op de server te runnen en alle netwerkdingen te genereren? Dat is hier wel niet erg nodig. Maar geeft je wel het opstapje om in 1.4.2.\ te zeggen dat de edge devices die wij willen gebruiken dat niet kunnen. Deze paragraaf kan ook in 1.4.2.}
288
289 \cleaninputlisting[float=,firstline=6,lastline=22,tabsize=3,numbers=left,caption={The code for a shared to-do list in \gls{ITASK}.},label={lst:todo}]{lst/sharedlist.icl}
290
291 \begin{figure}
292 \centering
293 \includegraphics[width=\linewidth]{todo0g}
294 \caption{The \gls{UI} for the shared to-do list in \gls{ITASK}.}%
295 \label{fig:todo}
296 \end{figure}
297
298 \subsection{The mTask system}
299 The work for \gls{IOT} edge devices can often be succinctly described by \gls{TOP} programs.
300 Software on microcontrollers is usually composed of smaller basic tasks, are interactive, and share data with other components or the server.
301 The \gls{ITASK} system seems an obvious candidate for bringing \gls{TOP} to \gls{IOT} edge devices.
302 However, an \gls{ITASK} application contains many features that are not needed on \emph{edge devices} such as higher-order tasks, support for a distributed architecture, or a multi-user web server.
303 \todo[inline]{Dat is op zich toch niet zo'n probleem. Een iTAsk server heeft ook geen GUI, maar wel alle iTask code om die te maken.
304 Het feit dat dit niet hoeft op een edge device geeft je wel een van de handvatten om mTask in minder memory te runnen}
305 Furthermore, \gls{IOT} edge devices are in general not powerful enough to run or interpret \gls{CLEAN}\slash\gls{ABC} code, they just lack the processor speed and memory.
306 To bridge this gap, \gls{MTASK} is developed, a domain-specific \gls{TOP} system for \gls{IOT} edge devices that is integrated in \gls{ITASK} \citep{koopman_task-based_2018}.
307 The \gls{ITASK} language abstracts away from details such as user interfaces, data storage, client-side platforms, and persistent workflows.
308 On the other hand, \gls{MTASK} offers abstractions for edge layer-specific details such as the heterogeneity of architectures, platforms, and frameworks; peripheral access; task scheduling; and lowering energy consumption.
309
310 The \gls{MTASK} system is seamlessly integrated with \gls{ITASK}.
311 Tasks in \gls{MTASK} are integrated in such a way that they function as regular \gls{ITASK} tasks.
312 Furthermore, \glspl{SDS} on the device can proxy \gls{ITASK} \glspl{SDS}.
313 Using \gls{MTASK}, the programmer can define all layers of an \gls{IOT} system as a single declarative specification.
314 The \gls{MTASK} language is written in \gls{CLEAN} as a multi-view \gls{EDSL} and hence there are multiple interpretations possible.
315 This thesis mostly discusses the byte code compiler.
316 From an \gls{MTASK} task constructed at run time, a compact binary representation of the work that needs to be done is compiled.
317 And while the byte code for \gls{MTASK} is generated at run time, the type system of the host language \gls{CLEAN} prevents type errors in the generated code.
318 This byte code is then sent to a device that running the \gls{MTASK} \gls{RTS}.
319 This feather-light domain-specific \gls{OS} is written in portable \gls{C} with a minimal device specific interface and it executes the tasks using interpretation and rewriting.
320
321 To illustrate \imtask{}, an example application is shown.
322 The application is an interactive application for blinking \pgls{LED} on the microcontroller at a certain frequency that can be set and updated at run time.
323 \Cref{lst:intro_blink,fig:intro_blink} show the \gls{ITASK} part of the code and a screenshot.
324 Using \cleaninline{enterInformation}, the connection specification of the \gls{TCP} device is queried through a web editor (\cref{lst:intro_enterDevice,fig:intro_blink_dev}).
325 \Cref{lst:intro_withshared} defines \pgls{SDS} to communicate the blinking interval between the server and the edge device.
326 The \gls{MTASK} device is connected using \cleaninline{withDevice} at \cref{lst:intro_withdevice}.
327 Once connected, the \cleaninline{intBlink} task is sent to the device (\cref{lst:intro_liftmtask}) and, in parallel, a web editor is shown that updates the value of the interval \gls{SDS} (\cref{lst:intro_editor,fig:intro_blink_int}).
328 To allow terminating of the task, the \gls{ITASK} task ends with a sequential operation that returns a constant value when the button is pressed, making the task stable.
329 \todo[inline]{foto device+led?}
330 \todo[inline]{enterDevice nieuwe regel, globale func?}
331
332 \cleaninputlisting[float={!ht},firstline=10,lastline=18,numbers=left,caption={The \gls{ITASK} code for the interactive blinking application.},label={lst:intro_blink}]{lst/blink.icl}
333
334 \begin{figure}
335 \centering
336 \begin{subfigure}{.5\textwidth}
337 \centering
338 \includegraphics[width=.9\linewidth]{blink1g}
339 \caption{Device selection.}\label{fig:intro_blink_dev}
340 \end{subfigure}%
341 \begin{subfigure}{.5\textwidth}
342 \centering
343 \includegraphics[width=.9\linewidth]{blink2g}
344 \caption{Changing the interval.}\label{fig:intro_blink_int}
345 \end{subfigure}
346 \caption{The \gls{UI} for the interactive blink application in \gls{MTASK}.}%
347 \label{fig:intro_blink}
348 \end{figure}
349
350 The \cleaninline{intBlink} task (\cref{lst:intro_blink_mtask}) is the \gls{MTASK} part of the application.
351 It blinks \pgls{LED} on the edge device with the delay that is dynamically adjustable by the user via an \gls{ITASK} editor in the browser.
352 It has its own tasks, \glspl{SDS}, and \gls{UOD}.
353 This task first defines \gls{GPIO} pin 13 to be of the output type (\cref{lst:intro:declarePin}).
354 Then the \gls{ITASK} \gls{SDS} is lifted to an \gls{MTASK} \gls{SDS} (\cref{lst:intro:liftsds}), enabling the machinery to keep the \gls{SDS} in sync both on the device and the server.
355 The main expression of the program calls the \cleaninline{blink} function with an initial state.
356 This function on \crefrange{lst:intro:blink_fro}{lst:intro:blink_to} first reads the interval \gls{SDS}, waits the specified delay, writes the state to the \gls{GPIO} pin, and calls itself recursively using the inverse of the state in order to run continuously.
357 The \cleaninline{>>|.} operator denotes the sequencing of tasks in \gls{MTASK}.
358
359 \cleaninputlisting[float={!ht},linerange={23-,25-33},numbers=left,caption={The \gls{MTASK} code for the interactive blinking application.},label={lst:intro_blink_mtask}]{lst/blink.icl} %chktex 8
360 \todo[inline]{Meer wit rondom =jes, doornummeren?}
361
362 \subsection{Other TOP languages}
363 While \gls{ITASK} conceived \gls{TOP}, it is no longer the only \gls{TOP} system.
364 Some \gls{TOP} languages were created to fill a gap encountered in practise.
365 Toppyt \citep{lijnse_toppyt_2022} is a general purpose \gls{TOP} language written in \gls{PYTHON} used to host frameworks for modelling command \& control systems.
366 The hTask system is a \gls{TOP} system written in \gls{HASKELL} used as a vessel for experimenting with asynchronous \glspl{SDS} \citep{lubbers_htask_2022}.
367 Furthermore, some \gls{TOP} systems arose from Master's and Bachelor's thesis projects.
368 For example, \textmu{}Task \citep{piers_task-oriented_2016}, a \gls{TOP} language for modelling non-interruptible embedded systems in \gls{HASKELL}, and LTasks \citep{van_gemert_task_2022}, a \gls{TOP} language written in the dynamically typed programming language Lua.
369 Finally, there are \gls{TOP} languages with strong academic foundations.
370 \Gls{TOPHAT} is a fully formally specified \gls{TOP} language designed to capture the essence of \gls{TOP} \citep{steenvoorden_tophat_2019}.
371 Such a formal specification allows for symbolic execution, hint generation, but also the translation to \gls{ITASK} for actually performing the work \citep{steenvoorden_tophat_2022}.
372 \Citeauthor{steenvoorden_tophat_2022} distinguishes two instruments for \gls{TOP}: \gls{TOP} languages and \gls{TOP} engines.
373 The language is the \emph{formal} language for specifying interactive systems.
374 The engine is the software or hardware that executes these specifications as a ready-for-work application.
375 \todo[inline]{Noemen dat een vergelijkbare semantics voor mTask under construction is met een verwijzing naar de thesis van Elina?}
376
377 \section{Contributions}%
378 \label{sec:contributions}
379 This section provides a thorough overview of the relation between the scientific publications and the contents of this thesis.
380
381 \subsection{\Fullref{prt:dsl}}
382 The \gls{MTASK} system is an \gls{EDSL} and during the development of it, several novel basal techniques for embedding \glspl{DSL} in \gls{FP} languages have been found.
383 This paper-based episode contains the following papers:
384 \todo{papers met bibitem doen? of conferentie noemen.}
385 \begin{enumerate}
386 \item \emph{Deep Embedding with Class} \citep*{lubbers_deep_2022} is the basis for \cref{chp:classy_deep_embedding}.
387 It shows a novel deep embedding technique for \glspl{DSL} where the resulting language is extendible both in constructs and in interpretation just using type classes and existential data types.
388 The related work section is updated with the research found after publication.
389 \Cref{sec:classy_reprise} was added after publication and contains a (yet) unpublished extension of the embedding technique for reducing the required boilerplate at the cost of requiring some advanced type system extensions.
390 \item \emph{First-\kern-1ptClass Data Types in Shallow Embedded Domain-Specific Languages} \citep*{lubbers_first-class_2022}\label{enum:first-class} is the basis for \cref{chp:first-class_datatypes}.
391 It shows how to inherit data types from the host language in \glspl{EDSL} using metaprogramming by providing a proof-of-concept implementation using \gls{HASKELL}'s metaprogramming system: \glsxtrlong{TH}.
392 The chapter also serves as a gentle introduction to, and contains a thorough literature study on \glsxtrlong{TH}.
393 \end{enumerate}
394
395 %\paragraph{In preparation}
396 %Furthermore, there are some papers either in preparation or under review describing methods for creating \glspl{DSL}.
397 %They describe techniques found while developing the \gls{MTASK} \gls{DSL} that have not made it (yet) into the system.
398 %Hence, they are not part of the dissertation.
399 %
400 %\begin{itemize}
401 % \item \emph{Strongly-Typed Multi-\kern-2ptView Stack-\kern-1.25ptBased Computations} shows how to create type-safe \glspl{EDSL} representing stack-based computations.
402 % Instead of encoding the arguments to a function as arguments in the host language, stack-based approaches use a run time stack that contains the arguments.
403 % By encoding the required contents of the stack in the types, such systems can be made type safe.
404 %
405 % \item \emph{Template Metaprogramming using Two-Stage Generic Functions} shows how a sufficiently rich generic programming system can achieve much of the same functionality as template metaprogramming.
406 % The generic programming functionality of \gls{Clean} is built into the compiler.
407 % As a result, metadata of the generic types is added to the generic structure.
408 % From this metadata, we can destill not only type and constructor names but also arities, fixity, kinds, types, \etc{}.
409 % This allows us, by
410 %\end{itemize}
411
412 \paragraph{Contribution:}
413 The papers are written by me, there were weekly meetings with co-authors in which we discussed and refined the ideas.
414
415 \subsection{\crtCref{prt:top}: \hspace{8.28992pt}\nameref{prt:top}}
416 This episode is a monograph that shows the design, properties, implementation and usage of the \gls{MTASK} system and \gls{TOP} for the \gls{IOT}.
417 It is compiled from the following publications:
418
419 \begin{enumerate}[resume]
420 \item \emph{A Task-\kern-1.25ptBased \glsxtrshort{DSL} for Microcomputers} \citep*{koopman_task-based_2018}
421 is the initial \gls{TOP}\slash{}\gls{MTASK} paper.
422 It provides an overview of the initial \gls{TOP} \gls{MTASK} language and shows first versions of some interpretations.
423 \item \emph{Task Oriented Programming for the Internet of Things} \citep*{lubbers_task_2018}\footnote{This work is an extension of my Master's thesis \citep{lubbers_task_2017}.}
424 shows how a simple imperative variant of \gls{MTASK} was integrated with \gls{ITASK}.
425 While the language differs a lot from the current version, the integration mechanism is still used.
426 % \paragraph{Contribution}
427 % The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer in which we discussed and refined the ideas.
428 \item \emph{Multitasking on Microcontrollers using Task Oriented Programming} \citep*{lubbers_multitasking_2019}\footnote{This work acknowledges the support of the \erasmusplus{} project ``Focusing Education on Composability, Comprehensibility and Correctness of Working Software'', no.\ 2017--1--SK01--KA203--035402.}
429 is a short paper on the multitasking capabilities of \gls{MTASK} comparing it to traditional multitasking methods for \gls{ARDUINO}.
430 % \paragraph{Contribution}
431 % The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer.
432 \item \emph{Simulation of a Task-\kern-1.25ptBased Embedded Domain Specific Language for the Internet of Things} \citep*{koopman_simulation_2023}\footnotemark[\value{footnote}]
433 are the revised lecture notes for a course on the \gls{MTASK} simulator provided at the 2018 \gls{3COWS} winter school in Ko\v{s}ice, Slovakia, January 22--26, 2018.
434 % \paragraph{Contribution}
435 % Pieter Koopman wrote and taught it, I helped with the software and research.
436 \item \emph{Writing Internet of Things Applications with Task Oriented Programming} \citep*{lubbers_writing_2023}\footnotemark[\value{footnote}]
437 are the revised lecture notes from a course on programming \gls{IOT} systems using \gls{MTASK} provided at the 2019 \gls{3COWS} summer school in Budapest, Hungary, June 17--21, 2019.
438 % \paragraph{Contribution}
439 % Pieter Koopman prepared and taught half of the lecture and supervised the practical session.
440 % I taught the other half of the lecture, wrote the lecture notes, made the assignments and supervised the practical session.
441 \item \emph{Interpreting Task Oriented Programs on Tiny Computers} \citep*{lubbers_interpreting_2019}
442 shows an implementation of the byte code compiler and \gls{RTS} of \gls{MTASK}.
443 % \paragraph{Contribution}
444 % The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer.
445 \item \emph{Reducing the Power Consumption of IoT with Task-Oriented Programming} \citep*{crooijmans_reducing_2022}
446 shows how to create a scheduler so that devices running \gls{MTASK} tasks can go to sleep more automatically and how interrupts are incorporated in the language.
447 % \paragraph{Contribution}
448 % The research was carried out by \citet{crooijmans_reducing_2021} during his Master's thesis.
449 % I did the daily supervision and helped with the research, Pieter Koopman was the formal supervisor and wrote most of the paper.
450 \item \emph{Green Computing for the Internet of Things} \citep*{lubbers_green_2022}\footnote{This work acknowledges the support of the \erasmusplus{} project ``SusTrainable---Promoting Sustainability as a Fundamental Driver in Software Development Training and Education'', no.\ 2020--1--PT01--KA203--078646.}
451 are the revised lecture notes from a course on sustainable \gls{IOT} programming with \gls{MTASK} provided at the 2022 SusTrainable summer school in Rijeka, Croatia, July 4--8, 2022.
452
453 % \paragraph{Contribution}
454 % These revised lecture notes are from a course on sustainable programming using \gls{MTASK} provided at the 2022 SusTrainable summer school in Rijeka, Croatia.
455 % Pieter prepared and taught a quarter of the lecture and supervised the practical session.
456 % I prepared and taught the other three quarters of the lecture, made the assignments and supervised the practical session
457 \end{enumerate}
458
459 \paragraph{Contribution:}
460 The original \gls{MTASK} language, and their initial interpretations were developed by Pieter Koopman and Rinus Plasmeijer.
461 I extended the language, developed the byte code interpreter, the integration with \gls{ITASK}, and the \gls{RTS}.
462 The papers of which I am first author are solely written by me, there were weekly meetings with the co-authors in which we discussed and refined the ideas.
463
464 \subsection{\Fullref{prt:tvt}}
465 \Cref{prt:tvt} is based on a journal paper that quantitatively and qualitatively compares traditional \gls{IOT} architectures with \gls{TOP} \gls{IOT} architectures.
466 \begin{enumerate}[resume]
467 \item \emph{Could Tierless Programming Reduce IoT Development Grief?} \citep*{lubbers_could_2022}
468 is an extended version of paper~\ref{enum:iot20}.
469 It compares programming traditional tiered architectures to tierless architectures by illustrating a qualitative and a quantitative four-way comparison of a smart-campus application.
470 \item \emph{Tiered versus Tierless \glsxtrshort{IOT} Stacks: Comparing Smart Campus Software Architectures} \citep*{lubbers_tiered_2020}\footnote{This work was partly funded by the 2019 Radboud-Glasgow Collaboration Fund.}\label{enum:iot20} compares traditional tiered programming to tierless architectures by comparing two implementations of a smart-campus application.
471 \end{enumerate}
472
473 \paragraph{Contribution:}
474 Writing the paper was performed by all authors.
475 I created the server application, the \cimtask{} implementation (\glsxtrshort{CWS}), and the \citask{} implementation (\glsxtrshort{CRS});
476 Adrian Ramsingh created the \gls{MICROPYTHON} implementation (\glsxtrshort{PWS}); the original \gls{PYTHON} implementation (\glsxtrshort{PRS}) and the server application were created by \citet{hentschel_supersensors:_2016}.
477
478 \input{subfilepostamble}
479 \end{document}