08597fee272846123974ba74f5e87d4a8bee461c
[phd-thesis.git] / intro / intro.tex
1 \documentclass[../thesis.tex]{subfiles}
2
3 \input{subfilepreamble}
4 \setcounter{chapter}{0}
5
6 \begin{document}
7 \input{subfileprefix}
8 \chapter{Prelude}%
9 \label{chp:introduction}
10 \begin{chapterabstract}
11 This chapter introduces the dissertation by providing:
12 \begin{itemize}
13 \item a general introduction to the topics and research directions;
14 \item a reading guide;
15 \item background material on the \glsxtrlong{IOT}, \glsxtrlongpl{DSL}, \glsxtrlong{TOP}, \gls{ITASK}, and \gls{MTASK};
16 \item and a detailed overview of the scientific contributions of this dissertation.
17 \end{itemize}
18 \end{chapterabstract}
19
20 \todo[inline]{Brackets upright in listings?}
21 This dissertation is about orchestrating \gls{IOT} systems harmlessly and efficiently.
22 \todo{beter?}
23 There are at least 13.4 billion devices connected to the internet at the time of writing \citep{transforma_insights_current_2023}.
24 Each of these devices sense, act, or otherwise, interact with people, computers, and the environment.
25 Despite their immense diversity, they are all computers and they all require software to operate.
26
27 An increasing number of these connected devices are so-called edge devices that operate in the \gls{IOT}.
28 Edge devices are the leaves of the \gls{IOT} systems.
29 They perform the interaction with the physical world.
30 It is not uncommon for edge devices to be physically embedded in the fabric itself.
31 Typically, they reside in hard-to-reach places such as light bulbs, clothing, smart electricity meters, buildings, or even farm animals.
32 The majority of edge devices are powered by microcontrollers.
33 Microcontrollers are equipped with a lot of connectivity for integrating peripherals such as sensors and actuators.
34 The connectivity makes them very suitable to interact with their surroundings.
35 These miniature computers contain integrated circuits that accommodate a microprocessor designed for use in embedded applications.
36 As a consequence, microcontrollers are cheap; tiny; have little memory; and contain a slow, but energy-efficient processor.
37
38 When coordinating an orchestra of edge devices, there is room for little error.
39 Edge devices come and go, perform their own pieces, or are sometimes instructed to perform a certain piece, they might even operate without a central authority.
40 In a traditional setting, an \gls{IOT} engineer has to program each device and their interoperation using different programming paradigms, programming languages, and abstraction levels.
41 This results in semantic friction, which makes programming and maintaining \gls{IOT} systems a complex and error-prone process.
42
43 This dissertation describes the research carried out around orchestrating these complex \gls{IOT} systems using \gls{TOP}.
44 \Gls{TOP} is an innovative tierless programming paradigm for interactive multi-layered systems.
45 By utilising advanced compiler technologies, much of the internals, communication, and interoperation between the tiers or layers of the applications are automatically generated.
46 The compiler makes an application controlling all interconnected components from a single declarative specification of the required work.
47 For example, the \gls{TOP} system \gls{ITASK} is used to program all layers of multi-user distributed web applications from a single source specification.
48 It is implemented in the general-purpose lazy functional programming language \gls{CLEAN}, and therefore requires relatively powerful hardware.
49 The inflated hardware requirements are no problem for regular computers but impractical for the average edge device.
50
51 This is where an additional \glspl{DSL} must play its part.
52 \Glspl{DSL} are programming languages tailored to a specific domain.
53 Consequently, jargon is not expressed in terms of the language itself, but are built-in language features.
54 Furthermore, the \gls{DSL} can eschew language or system features that are irrelevant for the domain.
55 Using \glspl{DSL}, hardware requirements can be drastically lowered, even while maintaining a high abstraction level for the specified domain.
56
57 To incorporate the plethora of edge devices in the orchestra of a \gls{TOP} system, the \gls{MTASK} system is used.
58 The \gls{MTASK} language is a novel programming language for programming \gls{IOT} edge devices using \gls{TOP}.
59 Where \gls{ITASK} abstracts away from the gritty details of multi-tier web applications, \gls{MTASK} has domain-specific abstractions for \gls{IOT} edge devices, maintaining the high abstraction level that \gls{TOP} offers.
60 As it is integrated with \gls{ITASK}, it allows for all layers of an \gls{IOT} application to be programmed from a single source.
61
62 \section{Reading guide}%
63 \label{lst:reading_guide}
64 This work is structured as a purely functional rhapsody.
65 The \citet{wikipedia_contributors_rhapsody_2022} define a musical rhapsody is defined as follows:
66 \begin{quote}\emph{%
67 A \emph{rhapsody} in music is a one-movement work that is episodic yet integrated, free-flowing in structure, featuring a range of highly contrasted moods, colour, and tonality.}
68 \end{quote}
69 This dissertation consists of three episodes.
70 \Cref{prt:dsl} is a paper-based---otherwise known as cumulative---episode containing chapters that provide insight in advanced \gls{DSL} embedding techniques for \gls{FP} languages.
71 The chapters can be read independently of each other.
72 \Cref{prt:top} is a monograph showing \gls{MTASK}, a \gls{TOP} \gls{DSL} for the \gls{IOT}.
73 Hence, the chapters in this episode are best read in order.
74 It introduces \gls{IOT} edge device programming, shows the complete \gls{MTASK} language, provides details on how \gls{MTASK} is integrated with \gls{ITASK}, shows how the byte code compiler is implemented, presents a guide for green computing with \gls{MTASK}, and ends with a conclusion and overview of future and related work.
75 \Cref{prt:tvt} consists of a single chapter that is based on a journal article.
76 The chapter provides a qualitative and quantitative comparison of traditional tiered \gls{IOT} programming and tierless programming using a real-world application.
77 The chapter is readable independently.
78
79 The following sections in this prelude provide background material on the \gls{IOT}, \glspl{DSL}, and \gls{TOP} after which a detailed overview of the contributions is presented.
80
81 \section{Internet of things}%
82 \label{sec:back_iot}
83 The \gls{IOT} is growing rapidly, and it is changing the way people and machines interact with each other and the world.
84 While the term \gls{IOT} briefly gained interest around 1999 to describe the communication of \gls{RFID} devices \citep{ashton_internet_1999,ashton_that_2009}, it probably already popped up halfway the eighties in a company speech by \citet{lewis_speech_1985}:
85
86 \begin{quote}
87 \emph{The \glsxtrlong{IOT}, or \glsxtrshort{IOT}, is the integration of people, processes and technology with connectable devices and sensors to enable remote monitoring, status, manipulation and evaluation of trends of such devices.}
88 \end{quote}
89
90 Much later, CISCO states that the \gls{IOT} started when there were as many connected devices as there were people on the globe, i.e.\ around 2008 \citep{evans_internet_2011}.
91 Today, \gls{IOT} is the term for a system of devices that sense the environment, act upon it, and communicate with each other and the world they operate in.
92 These connected devices are already in households all around us in the form of smart electricity meters, fridges, phones, watches, home automation, \etc.
93
94 When describing \gls{IOT} systems, a tiered---or layered---architecture is often used for compartmentalisation.
95 The number of tiers depends on the required complexity of the model.
96 For the intents and purposes of this thesis, the layered architecture as shown in \cref{fig:iot-layers} is used.
97
98 \begin{figure}
99 \centering
100 \includestandalone{iot-layers}
101 \caption{A layered \gls{IOT} architecture.}%
102 \label{fig:iot-layers}
103 \end{figure}
104
105 To explain the tiers, an example \gls{IOT} application---home automation---is dissected.
106 Closest to the end-user is the presentation layer.
107 This layer provides the interface between the user and the \gls{IOT} system.
108 In home automation this may be a web interface, an app used on a phone, or wall-mounted tablet to interact with edge devices and view sensor data.
109
110 The application layer is the core of the system.
111 It provides the \glspl{API}, data interfaces, data storage processing, and data processing of \gls{IOT} systems.
112 A cloud server or local server provides this layer in a typical home automation application.
113
114 The perception layer---also called edge layer---collects the data and interacts with the environment.
115 It consists of edge devices such as microcontrollers equipped with various sensors and actuators.
116 In home automation this layer consists of all devices hosting sensors and actuators such as smart light bulbs, actuators to open doors, or temperature and humidity sensors.
117
118 All layers are connected using the network layer.
119 In some applications this is implemented using conventional networking techniques such as \gls{WIFI} or Ethernet.
120 However, network technology that is tailored to the needs of the specific interconnection between two layers is increasingly popular.
121 Examples of this are BLE, LoRa, ZigBee, and LTE-M as a communication protocol for connecting the perception layer to the application layer using \gls{IOT} transport protocols such as \gls{MQTT}.
122 Protocols such as HTTP, AJAX, and WebSocket connecting the presentation layer to the application layer that are designed for the use in web applications.
123
124 \todo[inline]{Hier enkele zinnen over maintainability}
125 Across the layers, the devices are a large heterogeneous collection of different platforms, protocols, paradigms, and programming languages often resulting in impedance problems or semantic friction between layers when programming \citep{ireland_classification_2009}.
126 Even more so, the perception layer itself is often a heterogeneous collection of microcontrollers in itself, each having their own peculiarities, programming language of choice, and hardware interfaces.
127 As edge hardware needs to be cheap, small scale, and energy efficient, the microcontrollers used to power them do not have a lot of computational power, only a smidge of memory, and little communication bandwidth.
128 Typically, these devices are unable to run a full-fledged general-purpose \gls{OS}.
129 Rather they employ compiled firmware written in imperative languages that combines all tasks on the device in a single program.
130 While devices are getting a bit faster, smaller, and cheaper, they keep these properties to an extent.
131 For example, more powerful microcontrollers are capable of running \glspl{RTOS}, but this still requires a lot of resources and fixes the programs at compile time.
132 As a consequence, the flexibility is greatly reduced for dynamic systems in which tasks are created on the fly, executed on demand, require parallel execution, or have dynamic scheduling behaviour.
133 As program memory is mostly flash-based and only lasts a couple of thousands of writes before it wears out, it is not suitable for repeated reconfiguring and reprogramming.
134
135 Memory wear problems can be mitigated by dynamically sending code to be interpreted to the microcontroller.
136 With interpretation, a specialised interpreter is flashed in the program memory once it receives the program code to execute at run time.
137 Therefore, as the programs are not stored in the flash memory, it does not wear out.
138 It is challenging to create interpreters for small edge devices due to the severe hardware restrictions.
139 This dissertation describes a \gls{DSL} that includes the high-level programming concepts of \gls{TOP}, while it can be executed on edge devices with very limited hardware requirements.
140 It does so by compiling the \gls{DSL} to byte code that is executed in a feather-light domain-specific \gls{OS}.
141
142 \section{Domain-specific languages}%
143 \label{sec:back_dsl}
144 % General
145 Programming languages can be divided up into two categories: \glspl{DSL} and \glspl{GPL} \citep{fowler_domain_2010}.
146 Where \glspl{GPL} are not made with a demarcated area in mind, \glspl{DSL} are tailor-made for a specific domain.
147 Writing idiomatic domain-specific code in a \gls{DSL} is easier and requires less \gls{GPL} knowledge for a domain expert.
148 This does come at the cost of the \gls{DSL} being sometimes less expressive to an extent that it may not even be Turing complete.
149 \Glspl{DSL} come in two main flavours: standalone and embedded (\cref{sec:standalone_embedded})\footnote{Standalone and embedded are also called external and internal respectively.}.
150 Standalone languages are languages for which the complete toolchain has been developed, just as for any other \gls{GPL}.
151 Embedded languages piggyback on an existing language, they are defined in terms of their host language.
152 \Glspl{EDSL} can further be classified into heterogeneous and homogeneous languages (\cref{sec:hetero_homo}).
153 In homogeneous languages all components are integrated whereas in heterogeneous \glspl{DSL}, some parts are agnostic of the other systems, e.g.\ a \gls{DSL} that generates code for execution on a totally different system.
154 This hyponymy is shown in \cref{fig:hyponymy_of_dsls}.
155
156 \begin{figure}
157 \centering
158 \includestandalone{hyponymy_of_dsls}
159 \caption{A hyponymy of \glspl{DSL} (adapted from \citet[\citepage{2}]{mernik_extensible_2013}).}%
160 \label{fig:hyponymy_of_dsls}
161 \end{figure}
162
163 \subsection{Standalone and embedded}%
164 \label{sec:standalone_embedded}
165 \glspl{DSL} were historically created as standalone languages, meaning that all machinery is developed solely for the language.
166 The advantage of this approach is that the language designer is free to define the syntax and type system of the language as they wish, not being restricted by any constraint.
167 Unfortunately it also means that they need to develop a compiler or interpreter, and all the scaffolding for the language, making standalone \glspl{DSL} costly to create.
168 Examples of standalone \glspl{DSL} are \TeX, make, yacc, XML, SQL, \etc.
169
170 The dichotomous approach to standalone \glspl{DSL} is embedding the \gls{DSL} in a host language, i.e.\ \glspl{EDSL} \citep{hudak_modular_1998}.
171 By defining the language as constructs in the host language, much of the machinery is inherited \citep{krishnamurthi_linguistic_2001}.
172 This greatly reduces the cost of creating embedded languages and shields the user from having to learn the host language and toolchain.
173 However, there are two sides to this coin.
174 If the syntax of the host language is not very flexible, the syntax of the \gls{DSL} can become clumsy.
175 Furthermore, \gls{DSL} errors shown to the programmer may be larded with host language errors, making it difficult for a non-expert of the host language to work with the \gls{DSL}.
176 \Gls{FP} languages are especially suitable for hosting embedded \glspl{DSL}.
177 They offer tooling for building abstraction levels by a strong and versatile type system, minimal but flexible syntax, and referential transparency.
178
179 \subsection{Heterogeneity and homogeneity}%
180 \label{sec:hetero_homo}
181 \Citet{tratt_domain_2008} applies a notion from metaprogramming \citep{sheard_accomplishments_2001} to \glspl{EDSL} to define homogeneity and heterogeneity of \glspl{EDSL} as follows:
182
183 \begin{quote}
184 \emph{A homogeneous system is one where all the components are specifically designed to work with each other, whereas in heterogeneous systems at least one of the components is largely, or completely, ignorant of the existence of the other parts of the system.
185 }
186 \end{quote}
187
188 Homogeneous \glspl{EDSL} are languages that are solely defined as an extension to their host language.
189 They often restrict features of the host language to provide a safer interface or capture an idiomatic pattern in the host language for reuse.
190 The difference between a library and a homogeneous \glspl{EDSL} is not always clear.
191 Examples of homogeneous \glspl{EDSL} are libraries such as ones for sets, regions, but also more complex tasks such as \glspl{GUI}.
192
193 On the other hand, heterogeneous \glspl{EDSL} are languages that are not executed in the host language.
194 For example, \citet{elliott_compiling_2003} describe the language Pan, for which the final representation in the host language is a compiler that will, when executed, generate code for a completely different target platform.
195
196 Both \gls{ITASK} and \gls{MTASK} are \glspl{EDSL}.
197 Programs written in \gls{ITASK} run in the host language, and it is a homogeneous \gls{DSL}.
198 Tasks written using \gls{MTASK} are dynamically compiled to byte code for an edge device, making it a heterogeneous \gls{DSL}.
199 The interpreter running on the edge device has no knowledge of the higher level task specification.
200 It just interprets the byte code it was sent and takes care of the communication.
201
202 \section{Task-oriented programming}%
203 \label{sec:back_top}
204 \Gls{TOP} is a declarative programming paradigm for modelling interactive systems \citep{plasmeijer_task-oriented_2012}.
205 Instead of dividing problems into layers, \gls{TOP} deals with separation of concerns in a novel way.
206 This approach to software development is called \gls{TOSD} \citep{wang_maintaining_2018}.
207
208 \begin{figure}
209 \centering
210 \includestandalone{tosd}
211 \caption{Separation of concerns in \gls{TOSD} (adapted from \citep[\citepage{20}]{wang_maintaining_2018}).}%
212 \label{fig:tosd}
213 \end{figure}
214
215 \begin{description}
216 \item[Types:]
217 As can be seen from \cref{fig:tosd}, types are the pivotal component in \gls{TOP}.
218 From the data types, utilising various \emph{type-parametrised} concepts, all other aspects are handled automatically.
219 Hence, all other components arise from and depend on the types in the program.
220 \item[Tasks:]
221 In \gls{TOP} languages, tasks are the basic building blocks.
222 A task is an abstract representation of a piece of work that needs to be done.
223 It provides an abstraction over work in the real world.
224 The nature of tasks makes them observable during execution.
225 It is possible to observe the current task value act upon it, e.g.\ taking a partial result as good enough, or by starting new tasks.
226 Examples of tasks are filling forms, sending emails, reading sensors or even doing physical tasks.
227 Just as with real-life tasks, multiple tasks can be combined in various ways such as in parallel or in sequence to form workflows.
228 Such combination operators are called task combinators.
229 \item[\Glspl{SDS}:]
230 Tasks mainly communicate using their observable task values.
231 However, some collaboration patterns are more easily expressed by tasks that share common data.
232 \Glspl{SDS} fill this gap, they offer a safe abstraction over any data.
233 An \gls{SDS} can represent typed data stored in a file, a chunk of memory, a database, \etc.
234 \Glspl{SDS} can also represent external impure data such as the time, random numbers or sensor data.
235 In many \gls{TOP} languages, combinators are available to filter, combine, transform, and focus \glspl{SDS}.
236 \item[\Gls{UI}:]
237 The \gls{UI} of the system is automatically generated from the structural representation of the types.
238 Though, practical \gls{TOP} systems allow tweaking afterwards to suit the specific needs of the application.
239 \item[\Gls{UOD}:]
240 The \gls{UOD} is explicitly and separately modelled by the data types and relations that exist in the functions of the host language.
241 \end{description}
242
243 \Cref{fig:tosd} differs from the presented \gls{IOT} architecture shown in \cref{fig:iot-layers} because they represent different concepts.
244 The \gls{IOT} architecture is an execution architecture whereas \gls{TOSD} is a software development model.
245 E.g.\ from a software development perspective, a task is a task, whether it is executed on a microcontroller, a server, or a client.
246 Only when a task is executed, the location of the execution becomes important, but this is taken care of by the system.
247 Some concepts from the \gls{TOSD} model can be mapped upon the \gls{IOT} architecture in two ways.
248 Firstly, edge devices can be seen as simple resources, thus accessed through \glspl{SDS}.
249 The second view is that edge devices contain miniature \gls{TOP} systems in itself.
250 The individual components in the miniature systems, the tasks, the \glspl{SDS}, are, in the eventual execution, connected to the main system.
251 \todo{hier plaatje uit 6?: nee}
252
253 \subsection{The iTask system}
254 The concept of \gls{TOP} originated from the \gls{ITASK} framework, a declarative language and \gls{TOP} engine for defining interactive multi-user distributed web applications.
255 The \gls{ITASK} system is implemented as an \gls{EDSL} in the programming language \gls{CLEAN}\footnote{\Cref{chp:clean_for_haskell_programmers} contains a guide for \gls{CLEAN} tailored to \gls{HASKELL} programmers.} \citep{plasmeijer_itasks:_2007,plasmeijer_task-oriented_2012}.
256 It is under development for over fifteen years and has proven itself through use in industry for some time now as well.
257 For example, it is the main language of VIIA, an advanced application for monitoring coasts \citep{top_software_viia_2023}.
258 From the structural properties of the data types and the current status of the work to be done, the entire \gls{UI} is automatically generated.
259 Browsers are powering \gls{ITASK}'s presentation layer.
260 The framework is built on top of standard web techniques such as JavaScript, HTML, and {CSS}.
261 The browser runs the actual \gls{ITASK} code using an interpreter that operates on \gls{CLEAN}'s intermediate language \gls{ABC} \citep{staps_lazy_2019}.
262
263 Tasks in \gls{ITASK} have either \emph{no value}, an \emph{unstable} or a \emph{stable} task value.
264 For example, an editor for filling in a form initially has no value.
265 Once the user entered a complete value, its value becomes an unstable value, it can still be changed or even reverted to no value by emptying the editor again.
266 Only when for example a continue button is pressed, a task value becomes stable, fixing its value.
267 The allowed task value transitions are shown in \cref{fig:taskvalue}.
268
269 \begin{figure}
270 \centering
271 \includestandalone{taskvalue}
272 \caption{Transition diagram for task values in \gls{ITASK}.}%
273 \label{fig:taskvalue}
274 \end{figure}
275
276 As an example, \cref{lst:todo,fig:todo} show the code and \gls{UI} for an interactive to-do list application.
277 The user modifies a shared to-do list through an editor directly or using some predefined actions.
278 Furthermore, in parallel, the length of the list is shown to demonstrate \glspl{SDS}.
279 Using \gls{ITASK}, complex collaborations of users and tasks can be described on a high level.
280
281 From the data type definitions (\cref{lst:todo_dt}), using generic programming (\cref{lst:todo_derive}), the \glspl{UI} for the data types are automatically generated.
282 Then, using the parallel task combinator (\cleaninline{-\|\|}) the task for updating the to-dos (\cref{lst:todo_update}) and the task for viewing the length are combined (\cref{lst:todo_length}, shown as \emph{Length: 2} in the bottom of the image).
283 This particular parallel combinator uses the result of the left-hand side task.
284 Both tasks operate on the to-do \gls{SDS} (\cref{lst:todo_sds}).
285 The task for updating the to-do list is an editor (\cref{lst:todo_editor}) combined using a step combinator (\crefrange{lst:todo_contfro}{lst:todo_contto}).
286 The actions either change the value, sorting or clearing it, or terminate the task by returning the current value of the \gls{SDS}, visualised as three buttons on the bottom right of the \gls{UI}.
287 Special combinators (e.g.\ \cleaninline{@>>} at \cref{lst:todo_ui}) are used to tweak the \gls{UI} to display informative labels.
288 \todo[inline]{Zou je hier niet zeggen dat dit iTask programma de Presentation en Application layer uit Figure 1.1 maakt door dezelfde code in de browser en op de server te runnen en alle netwerkdingen te genereren? Dat is hier wel niet erg nodig. Maar geeft je wel het opstapje om in 1.4.2.\ te zeggen dat de edge devices die wij willen gebruiken dat niet kunnen. Deze paragraaf kan ook in 1.4.2.}
289
290 \cleaninputlisting[float=,firstline=6,lastline=22,tabsize=3,numbers=left,caption={The code for a shared to-do list in \gls{ITASK}.},label={lst:todo}]{lst/sharedlist.icl}
291
292 \begin{figure}
293 \centering
294 \includegraphics[width=\linewidth]{todo0g}
295 \caption{The \gls{UI} for the shared to-do list in \gls{ITASK}.}%
296 \label{fig:todo}
297 \end{figure}
298
299 \subsection{The mTask system}
300 The work for \gls{IOT} edge devices can often be succinctly described by \gls{TOP} programs.
301 Software on microcontrollers is usually composed of smaller basic tasks, are interactive, and share data with other components or the server.
302 The \gls{ITASK} system seems an obvious candidate for bringing \gls{TOP} to \gls{IOT} edge devices.
303 However, an \gls{ITASK} application contains many features that are not needed on \emph{edge devices} such as higher-order tasks, support for a distributed architecture, or a multi-user web server.
304 \todo[inline]{Dat is op zich toch niet zo'n probleem. Een iTAsk server heeft ook geen GUI, maar wel alle iTask code om die te maken.
305 Het feit dat dit niet hoeft op een edge device geeft je wel een van de handvatten om mTask in minder memory te runnen}
306 Furthermore, \gls{IOT} edge devices are in general not powerful enough to run or interpret \gls{CLEAN}\slash\gls{ABC} code, they just lack the processor speed and memory.
307 To bridge this gap, \gls{MTASK} is developed, a domain-specific \gls{TOP} system for \gls{IOT} edge devices that is integrated in \gls{ITASK} \citep{koopman_task-based_2018}.
308 The \gls{ITASK} language abstracts away from details such as user interfaces, data storage, client-side platforms, and persistent workflows.
309 On the other hand, \gls{MTASK} offers abstractions for edge layer-specific details such as the heterogeneity of architectures, platforms, and frameworks; peripheral access; task scheduling; and lowering energy consumption.
310
311 The \gls{MTASK} system is seamlessly integrated with \gls{ITASK}.
312 Tasks in \gls{MTASK} are integrated in such a way that they function as regular \gls{ITASK} tasks.
313 Furthermore, \glspl{SDS} on the device can proxy \gls{ITASK} \glspl{SDS}.
314 Using \gls{MTASK}, the programmer can define all layers of an \gls{IOT} system as a single declarative specification.
315 The \gls{MTASK} language is written in \gls{CLEAN} as a multi-view \gls{EDSL} and hence there are multiple interpretations possible.
316 This thesis mostly discusses the byte code compiler.
317 From an \gls{MTASK} task constructed at run time, a compact binary representation of the work that needs to be done is compiled.
318 And while the byte code for \gls{MTASK} is generated at run time, the type system of the host language \gls{CLEAN} prevents type errors in the generated code.
319 This byte code is then sent to a device that running the \gls{MTASK} \gls{RTS}.
320 This feather-light domain-specific \gls{OS} is written in portable \gls{C} with a minimal device specific interface and it executes the tasks using interpretation and rewriting.
321
322 To illustrate \imtask{}, an example application is shown.
323 The application is an interactive application for blinking \pgls{LED} on the microcontroller at a certain frequency that can be set and updated at run time.
324 \Cref{lst:intro_blink,fig:intro_blink} show the \gls{ITASK} part of the code and a screenshot.
325 Using \cleaninline{enterInformation}, the connection specification of the \gls{TCP} device is queried through a web editor (\cref{lst:intro_enterDevice,fig:intro_blink_dev}).
326 \Cref{lst:intro_withshared} defines \pgls{SDS} to communicate the blinking interval between the server and the edge device.
327 The \gls{MTASK} device is connected using \cleaninline{withDevice} at \cref{lst:intro_withdevice}.
328 Once connected, the \cleaninline{intBlink} task is sent to the device (\cref{lst:intro_liftmtask}) and, in parallel, a web editor is shown that updates the value of the interval \gls{SDS} (\cref{lst:intro_editor,fig:intro_blink_int}).
329 To allow terminating of the task, the \gls{ITASK} task ends with a sequential operation that returns a constant value when the button is pressed, making the task stable.
330 \todo[inline]{foto device+led?}
331 \todo[inline]{enterDevice nieuwe regel, globale func?}
332
333 \cleaninputlisting[float={!ht},firstline=10,lastline=18,numbers=left,caption={The \gls{ITASK} code for the interactive blinking application.},label={lst:intro_blink}]{lst/blink.icl}
334
335 \begin{figure}
336 \centering
337 \begin{subfigure}{.5\textwidth}
338 \centering
339 \includegraphics[width=.9\linewidth]{blink1g}
340 \caption{Device selection.}\label{fig:intro_blink_dev}
341 \end{subfigure}%
342 \begin{subfigure}{.5\textwidth}
343 \centering
344 \includegraphics[width=.9\linewidth]{blink2g}
345 \caption{Changing the interval.}\label{fig:intro_blink_int}
346 \end{subfigure}
347 \caption{The \gls{UI} for the interactive blink application in \gls{MTASK}.}%
348 \label{fig:intro_blink}
349 \end{figure}
350
351 The \cleaninline{intBlink} task (\cref{lst:intro_blink_mtask}) is the \gls{MTASK} part of the application.
352 It blinks \pgls{LED} on the edge device with the delay that is dynamically adjustable by the user via an \gls{ITASK} editor in the browser.
353 It has its own tasks, \glspl{SDS}, and \gls{UOD}.
354 This task first defines \gls{GPIO} pin 13 to be of the output type (\cref{lst:intro:declarePin}).
355 Then the \gls{ITASK} \gls{SDS} is lifted to an \gls{MTASK} \gls{SDS} (\cref{lst:intro:liftsds}), enabling the machinery to keep the \gls{SDS} in sync both on the device and the server.
356 The main expression of the program calls the \cleaninline{blink} function with an initial state.
357 This function on \crefrange{lst:intro:blink_fro}{lst:intro:blink_to} first reads the interval \gls{SDS}, waits the specified delay, writes the state to the \gls{GPIO} pin, and calls itself recursively using the inverse of the state in order to run continuously.
358 The \cleaninline{>>\|.} operator denotes the sequencing of tasks in \gls{MTASK}.
359
360 \cleaninputlisting[float={!ht},linerange={23-,25-33},numbers=left,caption={The \gls{MTASK} code for the interactive blinking application.},label={lst:intro_blink_mtask}]{lst/blink.icl} %chktex 8
361 \todo[inline]{Meer wit rondom =jes, doornummeren?}
362
363 \subsection{Other TOP languages}
364 While \gls{ITASK} conceived \gls{TOP}, it is no longer the only \gls{TOP} system.
365 Some \gls{TOP} languages were created to fill a gap encountered in practise.
366 Toppyt \citep{lijnse_toppyt_2022} is a general purpose \gls{TOP} language written in \gls{PYTHON} used to host frameworks for modelling command \& control systems.
367 The hTask system is a \gls{TOP} system written in \gls{HASKELL} used as a vessel for experimenting with asynchronous \glspl{SDS} \citep{lubbers_htask_2022}.
368 Furthermore, some \gls{TOP} systems arose from Master's and Bachelor's thesis projects.
369 For example, \textmu{}Task \citep{piers_task-oriented_2016}, a \gls{TOP} language for modelling non-interruptible embedded systems in \gls{HASKELL}, and LTasks \citep{van_gemert_task_2022}, a \gls{TOP} language written in the dynamically typed programming language Lua.
370 Finally, there are \gls{TOP} languages with strong academic foundations.
371 \Gls{TOPHAT} is a fully formally specified \gls{TOP} language designed to capture the essence of \gls{TOP} \citep{steenvoorden_tophat_2019}.
372 Such a formal specification allows for symbolic execution, hint generation, but also the translation to \gls{ITASK} for actually performing the work \citep{steenvoorden_tophat_2022}.
373 \Citeauthor{steenvoorden_tophat_2022} distinguishes two instruments for \gls{TOP}: \gls{TOP} languages and \gls{TOP} engines.
374 The language is the \emph{formal} language for specifying interactive systems.
375 The engine is the software or hardware that executes these specifications as a ready-for-work application.
376 \todo[inline]{Noemen dat een vergelijkbare semantics voor mTask under construction is met een verwijzing naar de thesis van Elina?}
377
378 \section{Contributions}%
379 \label{sec:contributions}
380 This section provides a thorough overview of the relation between the scientific publications and the contents of this thesis.
381
382 \subsection{\Fullref{prt:dsl}}
383 The \gls{MTASK} system is an \gls{EDSL} and during the development of it, several novel basal techniques for embedding \glspl{DSL} in \gls{FP} languages have been found.
384 This paper-based episode contains the following papers:
385 \todo{papers met bibitem doen? of conferentie noemen.}
386 \begin{enumerate}
387 \item \emph{Deep Embedding with Class} \citep*{lubbers_deep_2022} is the basis for \cref{chp:classy_deep_embedding}.
388 It shows a novel deep embedding technique for \glspl{DSL} where the resulting language is extendible both in constructs and in interpretation just using type classes and existential data types.
389 The related work section is updated with the research found after publication.
390 \Cref{sec:classy_reprise} was added after publication and contains a (yet) unpublished extension of the embedding technique for reducing the required boilerplate at the cost of requiring some advanced type system extensions.
391 \item \emph{First-\kern-1ptClass Data Types in Shallow Embedded Domain-Specific Languages} \citep*{lubbers_first-class_2022}\label{enum:first-class} is the basis for \cref{chp:first-class_datatypes}.
392 It shows how to inherit data types from the host language in \glspl{EDSL} using metaprogramming by providing a proof-of-concept implementation using \gls{HASKELL}'s metaprogramming system: \glsxtrlong{TH}.
393 The chapter also serves as a gentle introduction to, and contains a thorough literature study on \glsxtrlong{TH}.
394 \end{enumerate}
395
396 %\paragraph{In preparation}
397 %Furthermore, there are some papers either in preparation or under review describing methods for creating \glspl{DSL}.
398 %They describe techniques found while developing the \gls{MTASK} \gls{DSL} that have not made it (yet) into the system.
399 %Hence, they are not part of the dissertation.
400 %
401 %\begin{itemize}
402 % \item \emph{Strongly-Typed Multi-\kern-2ptView Stack-\kern-1.25ptBased Computations} shows how to create type-safe \glspl{EDSL} representing stack-based computations.
403 % Instead of encoding the arguments to a function as arguments in the host language, stack-based approaches use a run time stack that contains the arguments.
404 % By encoding the required contents of the stack in the types, such systems can be made type safe.
405 %
406 % \item \emph{Template Metaprogramming using Two-Stage Generic Functions} shows how a sufficiently rich generic programming system can achieve much of the same functionality as template metaprogramming.
407 % The generic programming functionality of \gls{Clean} is built into the compiler.
408 % As a result, metadata of the generic types is added to the generic structure.
409 % From this metadata, we can destill not only type and constructor names but also arities, fixity, kinds, types, \etc{}.
410 % This allows us, by
411 %\end{itemize}
412
413 \paragraph{Contribution:}
414 The papers are written by me, there were weekly meetings with co-authors in which we discussed and refined the ideas.
415
416 \subsection{\crtCref{prt:top}: \hspace{8.28992pt}\nameref{prt:top}}
417 This episode is a monograph that shows the design, properties, implementation and usage of the \gls{MTASK} system and \gls{TOP} for the \gls{IOT}.
418 It is compiled from the following publications:
419
420 \begin{enumerate}[resume]
421 \item \emph{A Task-\kern-1.25ptBased \glsxtrshort{DSL} for Microcomputers} \citep*{koopman_task-based_2018}
422 is the initial \gls{TOP}\slash{}\gls{MTASK} paper.
423 It provides an overview of the initial \gls{TOP} \gls{MTASK} language and shows first versions of some interpretations.
424 \item \emph{Task Oriented Programming for the Internet of Things} \citep*{lubbers_task_2018}\footnote{This work is an extension of my Master's thesis \citep{lubbers_task_2017}.}
425 shows how a simple imperative variant of \gls{MTASK} was integrated with \gls{ITASK}.
426 While the language differs a lot from the current version, the integration mechanism is still used.
427 % \paragraph{Contribution}
428 % The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer in which we discussed and refined the ideas.
429 \item \emph{Multitasking on Microcontrollers using Task Oriented Programming} \citep*{lubbers_multitasking_2019}\footnote{This work acknowledges the support of the \erasmusplus{} project ``Focusing Education on Composability, Comprehensibility and Correctness of Working Software'', no.\ 2017--1--SK01--KA203--035402.}
430 is a short paper on the multitasking capabilities of \gls{MTASK} comparing it to traditional multitasking methods for \gls{ARDUINO}.
431 % \paragraph{Contribution}
432 % The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer.
433 \item \emph{Simulation of a Task-\kern-1.25ptBased Embedded Domain Specific Language for the Internet of Things} \citep*{koopman_simulation_2023}\footnotemark[\value{footnote}]
434 are the revised lecture notes for a course on the \gls{MTASK} simulator provided at the 2018 \gls{3COWS} winter school in Ko\v{s}ice, Slovakia, January 22--26, 2018.
435 % \paragraph{Contribution}
436 % Pieter Koopman wrote and taught it, I helped with the software and research.
437 \item \emph{Writing Internet of Things Applications with Task Oriented Programming} \citep*{lubbers_writing_2023}\footnotemark[\value{footnote}]
438 are the revised lecture notes from a course on programming \gls{IOT} systems using \gls{MTASK} provided at the 2019 \gls{3COWS} summer school in Budapest, Hungary, June 17--21, 2019.
439 % \paragraph{Contribution}
440 % Pieter Koopman prepared and taught half of the lecture and supervised the practical session.
441 % I taught the other half of the lecture, wrote the lecture notes, made the assignments and supervised the practical session.
442 \item \emph{Interpreting Task Oriented Programs on Tiny Computers} \citep*{lubbers_interpreting_2019}
443 shows an implementation of the byte code compiler and \gls{RTS} of \gls{MTASK}.
444 % \paragraph{Contribution}
445 % The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer.
446 \item \emph{Reducing the Power Consumption of IoT with Task-Oriented Programming} \citep*{crooijmans_reducing_2022}
447 shows how to create a scheduler so that devices running \gls{MTASK} tasks can go to sleep more automatically and how interrupts are incorporated in the language.
448 % \paragraph{Contribution}
449 % The research was carried out by \citet{crooijmans_reducing_2021} during his Master's thesis.
450 % I did the daily supervision and helped with the research, Pieter Koopman was the formal supervisor and wrote most of the paper.
451 \item \emph{Green Computing for the Internet of Things} \citep*{lubbers_green_2022}\footnote{This work acknowledges the support of the \erasmusplus{} project ``SusTrainable---Promoting Sustainability as a Fundamental Driver in Software Development Training and Education'', no.\ 2020--1--PT01--KA203--078646.}
452 are the revised lecture notes from a course on sustainable \gls{IOT} programming with \gls{MTASK} provided at the 2022 SusTrainable summer school in Rijeka, Croatia, July 4--8, 2022.
453
454 % \paragraph{Contribution}
455 % These revised lecture notes are from a course on sustainable programming using \gls{MTASK} provided at the 2022 SusTrainable summer school in Rijeka, Croatia.
456 % Pieter prepared and taught a quarter of the lecture and supervised the practical session.
457 % I prepared and taught the other three quarters of the lecture, made the assignments and supervised the practical session
458 \end{enumerate}
459
460 \paragraph{Contribution:}
461 The original \gls{MTASK} language, and their initial interpretations were developed by Pieter Koopman and Rinus Plasmeijer.
462 I extended the language, developed the byte code interpreter, the integration with \gls{ITASK}, and the \gls{RTS}.
463 The papers of which I am first author are solely written by me, there were weekly meetings with the co-authors in which we discussed and refined the ideas.
464
465 \subsection{\Fullref{prt:tvt}}
466 \Cref{prt:tvt} is based on a journal paper that quantitatively and qualitatively compares traditional \gls{IOT} architectures with \gls{TOP} \gls{IOT} architectures.
467 \begin{enumerate}[resume]
468 \item \emph{Could Tierless Programming Reduce IoT Development Grief?} \citep*{lubbers_could_2023}
469 is an extended version of paper~\ref{enum:iot20}.
470 It compares programming traditional tiered architectures to tierless architectures by illustrating a qualitative and a quantitative four-way comparison of a smart-campus application.
471 \item \emph{Tiered versus Tierless \glsxtrshort{IOT} Stacks: Comparing Smart Campus Software Architectures} \citep*{lubbers_tiered_2020}\footnote{This work was partly funded by the 2019 Radboud-Glasgow Collaboration Fund.}\label{enum:iot20} compares traditional tiered programming to tierless architectures by comparing two implementations of a smart-campus application.
472 \end{enumerate}
473
474 \paragraph{Contribution:}
475 Writing the paper was performed by all authors.
476 I created the server application, the \cimtask{} implementation (\glsxtrshort{CWS}), and the \citask{} implementation (\glsxtrshort{CRS});
477 Adrian Ramsingh created the \gls{MICROPYTHON} implementation (\glsxtrshort{PWS}); the original \gls{PYTHON} implementation (\glsxtrshort{PRS}) and the server application were created by \citet{hentschel_supersensors:_2016}.
478
479 \input{subfilepostamble}
480 \end{document}