more updates
[phd-thesis.git] / top / 4iot.tex
1 \documentclass[../thesis.tex]{subfiles}
2
3 \input{subfilepreamble}
4
5 \begin{document}
6 \input{subfileprefix}
7 \chapter{\texorpdfstring{\Glsxtrlong{TOP} for the \glsxtrlong{IOT}}{Task-oriented programming for the internet of things}}%
8 \label{chp:top4iot}
9 \begin{chapterabstract}
10 \noindent This chapter:
11 \begin{itemize}
12 \item introduces the problems with \gls{TOP} for the \gls{IOT}.
13 \item shows how to create the \emph{Hello World!} application for microcontrollers using \gls{ARDUINO};
14 \item extends this idea with multithreading, demonstrating the difficulty programming multi-tasking applications;
15 \item describes a comparative variant in \gls{MTASK} and shows that upgrading to a multi-tasking variant is straightforward
16 \item demonstrates that the complexity of running multiple tasks;
17 \item and concludes with the history of \gls{MTASK}'s development.
18 \end{itemize}
19 \end{chapterabstract}
20
21 The edge layer of \gls{IOT} systems predominantly contains of microcontrollers.
22 Microcontrollers are tiny computers designed specifically for embedded applications.
23 They therefore only have a soup\c{c}on of memory, have a slow processor, come with many energy efficient sleep modes and have a lot of peripheral support such as \gls{GPIO} pins.
24 Usually, programming microcontrollers requires an elaborate multi-step toolchain of compilation, linkage, binary image creation, and burning this image onto the flash memory of the microcontroller in order to compile and run a program.
25 The programs are usually cyclic executives instead of tasks running in an operating system, i.e.\ there is only a single task that continuously runs on the bare metal.
26 \Cref{tbl:mcu_laptop} compares the hardware properties of a typical laptop with two very popular microcontrollers.
27
28 \begin{table}
29 \caption{Hardware characteristics of typical microcontrollers compared to laptops.}%
30 \label{tbl:mcu_laptop}
31 \begin{tabular}{llll}
32 \toprule
33 & Laptop & Atmega328P & ESP8266\\
34 \midrule
35 CPU speed & \qtyrange{2}{4}{\giga\hertz} & \qty{16}{\mega\hertz} & \qty{80}{\mega\hertz} or \qty{160}{\mega\hertz}\\
36 \textnumero{} cores & \numrange{4}{8} & 1 & 1\\
37 Storage & \qty{1}{\tebi\byte} & \qty{32}{\kibi\byte} & \qtyrange{0.5}{4}{\mebi\byte}\\
38 \gls{RAM} & \qtyrange{4}{16}{\gibi\byte} & \qty{2}{\kibi\byte} & \qty{160}{\kibi\byte}\\
39 Power & \qtyrange{50}{100}{\watt} & \qtyrange{0.13}{250}{\milli\watt} & \qtyrange{0.1}{350}{\milli\watt}\\
40 Size & $\pm$\qty{1060}{\cubic\cm} & $\pm$\qty{7.5}{\cubic\cm} & $\pm$\qty{1.1}{\cubic\cm}\\
41 Price & \euro{1500} & \euro{3} & \euro{4}\\
42 \bottomrule
43 \end{tabular}
44 \end{table}
45
46 Different models of microcontrollers require their own vendor-provided drivers, hardware abstraction layer, compilers and \glspl{RTS}.
47 There are many platforms that abstract away from this such as \gls{MBED} and \gls{ARDUINO} of which \gls{ARDUINO} is specifically designed for education and prototyping and hence used here.
48 The popular \gls{ARDUINO} \ccpp{} dialect and accompanying libraries provide an abstraction layer for common microcontroller behaviour allowing the programmer to program multiple types of microcontrollers using a single language.
49 Originally it was designed for the in-house developed open-source hardware with the same name but the setup allows porting to many architectures.
50 It provides an \gls{IDE} and toolchain automation to perform all steps of the toolchain with a single command.
51
52 \subsection{\texorpdfstring{\Glsxtrshort{TOP} for the \glsxtrshort{IOT}}{TOP for the IoT}}
53 \Gls{TOP} is a programming paradigm that allows multi-tier systems to be generated from a single declarative source.
54 \Gls{ITASK} is a general-purpose \gls{TOP} system for programming distributed web applications.
55 These distributed web applications often form the core of \gls{IOT} applications as well but integrating these devices in \gls{ITASK} is not straightforward.
56 \Gls{ITASK} targets relatively fast but energy-hungry systems with large amounts of \gls{RAM} and a speedy connections.
57 Edge devices in \gls{IOT} systems are typically slow but energy efficient and do not have the memory to run the naturally heap-heavy functional programs that \gls{ITASK} results in.
58 \Gls{MTASK} bridges this gap by providing a \gls{TOP} \gls{DSL} for \gls{IOT} edge devices that can, because domain-specific knowledge is built in, run on hardware with much less memory and processor speed.
59 The following sections compare traditional microcontroller programming with programming the devices using \gls{MTASK}.
60
61 \section{Hello world!}
62 Traditionally, the first program that one writes when trying a new language is the so-called \emph{Hello World!} program.
63 This program has the single task of printing the text \emph{Hello World!} to the screen and exiting again, useful to become familiarised with the syntax and verify that the toolchain and runtime environment is working.
64 On microcontrollers, there usually is no screen for displaying text.
65 Nevertheless, almost always there is a built-in monochrome $1\times1$ pixel screen, namely \pgls{LED}.
66 The \emph{Hello World!} equivalent on microcontrollers blinks this \gls{LED}.
67
68 \Cref{lst:arduinoBlink} shows how the logic of a blink program might look when using \gls{ARDUINO}'s \ccpp{} dialect.
69 Every \gls{ARDUINO} program contains a \arduinoinline{setup} and a \arduinoinline{loop} function.
70 The \arduinoinline{setup} function is executed only once on boot, the \arduinoinline{loop} function is continuously called afterwards and contains the event loop.
71 After setting the \gls{GPIO} pin to the correct mode, blink's \arduinoinline{loop} function alternates the state of the pin representing the \gls{LED} between \arduinoinline{HIGH} and \arduinoinline{LOW}, turning the \gls{LED} off and on respectively.
72 In between it waits for \qty{500}{\ms} so that the blinking is actually visible for the human eye.
73
74 Translating the traditional blink program to \gls{MTASK} can almost be done by simply substituting some syntax as seen in \cref{lst:blinkImp}.
75 E.g.\ \arduinoinline{digitalWrite} becomes \cleaninline{writeD}, literals are prefixed with \cleaninline{lit} and the pin to blink is changed to represent the actual pin for the builtin \gls{LED} of the device used in the exercises.
76 In contrast to the imperative \gls{CPP} dialect, \gls{MTASK} is a \gls{TOP} language and therefore there is no such thing as a loop, only task combinators to combine tasks.
77 To simulate a loop, the \cleaninline{rpeat} task combinator can be used as this task combinator executes the argument task and, when stable, reinstates it.
78 The body of the \cleaninline{rpeat} contains similarly named tasks to write to the pins and to wait in between.
79 The tasks are connected using the sequential \cleaninline{>>|.} combinator that for all current intents and purposes executes the tasks after each other.
80
81 \begin{figure}[ht]
82 \begin{subfigure}[b]{.5\linewidth}
83 \begin{lstArduino}[caption={Blink program.},label={lst:arduinoBlink}]
84 void setup() {
85 pinMode(D2, OUTPUT);
86 }
87
88 void loop() {
89 digitalWrite(D2, HIGH);
90 delay(500);
91 digitalWrite(D2, LOW);
92 delay(500);
93 }\end{lstArduino}
94 \end{subfigure}%
95 \begin{subfigure}[b]{.5\linewidth}
96 \begin{lstClean}[caption={Blink program.},label={lst:blinkImp}]
97 blink :: Main (MTask v ()) | mtask v
98 blink =
99 declarePin D2 PMOutput \d2->
100 {main = rpeat (
101 writeD d2 true
102 >>|. delay (lit 500)
103 >>|. writeD d2 false
104 >>|. delay (lit 500)
105 )
106 }\end{lstClean}
107 \end{subfigure}
108 \end{figure}
109
110 \section{Multi tasking}
111 Now say that we want to blink multiple blinking patterns on different \glspl{LED} concurrently.
112 For example, blink three \glspl{LED} connected to \gls{GPIO} pins $1,2$ and $3$ at intervals of \qtylist{500;300;800}{\ms}.
113 Intuitively you want to lift the blinking behaviour to a function and call this function three times with different parameters as done in \cref{lst:blinkthreadno}
114
115 \begin{lstArduino}[caption={Naive approach to multiple blinking patterns.},label={lst:blinkthreadno}]
116 void setup () { ... }
117
118 void blink (int pin, int wait) {
119 digitalWrite(pin, HIGH);
120 delay(wait);
121 digitalWrite(pin, LOW);
122 delay(wait);
123 }
124
125 void loop() {
126 blink (D1, 500);
127 blink (D2, 300);
128 blink (D3, 800);
129 }\end{lstArduino}
130
131 Unfortunately, this does not work because the \arduinoinline{delay} function blocks all further execution.
132 The resulting program will blink the \glspl{LED} after each other instead of at the same time.
133 To overcome this, it is necessary to slice up the blinking behaviour in very small fragments so it can be manually interleaved \citep{feijs_multi-tasking_2013}.
134 Listing~\ref{lst:blinkthread} shows how three different blinking patterns might be achieved in \gls{ARDUINO} using the slicing method.
135 If we want the blink function to be a separate parametrizable function we need to explicitly provide all references to the required state.
136 Furthermore, the \arduinoinline{delay} function can not be used and polling \arduinoinline{millis} is required.
137 The \arduinoinline{millis} function returns the number of milliseconds that have passed since the boot of the microcontroller.
138 Some devices use very little energy when in \arduinoinline{delay} or sleep state.
139 Resulting in \arduinoinline{millis} potentially affects power consumption since the processor is basically busy looping all the time.
140 In the simple case of blinking three \glspl{LED} on fixed intervals, it might be possible to calculate the delays in advance using static analysis and generate the appropriate \arduinoinline{delay} code.
141 Unfortunately, this is very hard when for example the blinking patterns are determined at runtime.
142
143 \begin{lstArduino}[label={lst:blinkthread},caption={Threading three blinking patterns.}]
144 long led1 = 0, led2 = 0, led3 = 0;
145 bool st1 = false, st2 = false, st3 = false;
146
147 void blink(int pin, int interval, long *lastrun, bool *st) {
148 if (millis() - *lastrun > interval) {
149 digitalWrite(pin, *st = !*st);
150 *lastrun += interval;
151 }
152 }
153
154 void loop() {
155 blink(D1, 500, &led1, &st1);
156 blink(D2, 300, &led2, &st1);
157 blink(D3, 800, &led3, &st1);
158 }\end{lstArduino}
159
160 This method is very error prone, requires a lot of pointer juggling and generally results into spaghetti code.
161 Furthermore, it is very difficult to represent dependencies between threads, often state machines have to be explicitly programmed by hand to achieve this.
162
163 \subsection{Multi tasking in \texorpdfstring{\gls{MTASK}}{mTask}}
164 The \cleaninline{delay} \emph{task} does not block the execution but \emph{just} emits no value when the target waiting time has not yet passed and emits a stable value when the time is met.
165 In contrast, the \arduinoinline{delay()} \emph{function} on the \gls{ARDUINO} is blocking which prohibits interleaving.
166 To make code reuse possible and make the implementation more intuitive, the blinking behaviour is lifted to a recursive function instead of using the imperative \cleaninline{rpeat} construct.
167 The function is parametrized with the current state, the pin to blink and the waiting time.
168 Creating recursive functions like this is not possible in the \gls{ARDUINO} language because the program would run out of stack in an instant and nothing can be interleaved.
169 With a parallel combinator, tasks can be executed in an interleaved fashion.
170 Therefore, blinking three different blinking patterns is as simple as combining the three calls to the \cleaninline{blink} function with their arguments as seen in \cref{lst:blinkthreadmtask}.
171
172 % VimTeX: SynIgnore on
173 \begin{lstClean}[label={lst:blinkthreadmtask},caption={Threaded blinking.}]
174 blinktask :: MTask v () | mtask v
175 blinktask =
176 declarePin D1 PMOutput \d1->
177 declarePin D2 PMOutput \d2->
178 declarePin D3 PMOutput \d3->
179 fun \blink=(\(st, pin, wait)->
180 delay wait
181 >>|. writeD d13 st
182 >>|. blink (Not st, pin, wait))
183 In {main =
184 blink (true, d1, lit 500)
185 .||. blink (true, d2, lit 300)
186 .||. blink (true, d3, lit 800)
187 }
188 \end{lstClean}
189 % VimTeX: SynIgnore off
190
191 \section{Conclusion}
192 The edge layer of \gls{IOT} systems is powered by microcontrollers.
193 Programming them happens through compiled firmwares using low-level imperative programming languages.
194 Due to the lack of an \gls{OS}, writing applications that perform multiple tasks at the same time is error prone, and complex; and requires a lot of boilerplate and manual scheduling code.
195 With the \gls{MTASK} system, a \gls{TOP} programming language for \gls{IOT} edge devices, this limitation can be overcome.
196 \todo{uit\-breiden}
197
198 \begin{subappendices}
199 \section{History of \texorpdfstring{\gls{MTASK}}{mTask}}
200 The development of \gls{MTASK} or its predecessors has been going on for almost seven years now though it really set off during my master's thesis.
201 This section provides an exhaustive overview of the work on \gls{MTASK} and its predecessors.
202
203 \subsection*{Generating \texorpdfstring{\ccpp{}}{\ccpp{}} code}
204 A first throw at a class-based shallowly \gls{EDSL} for microcontrollers was made by \citet{plasmeijer_shallow_2016}.
205 The language was called \gls{ARDSL} and offered a type safe interface to \gls{ARDUINO} \gls{CPP} dialect.
206 A \gls{CPP} code generation backend was available together with an \gls{ITASK} simulation backend.
207 There was no support for tasks nor even functions.
208 Some time later in the 2015 \gls{CEFP} summer school, an extended version was created that allowed the creation of imperative tasks, local \glspl{SDS} and the usage of functions \citep{koopman_type-safe_2019}.
209 The name then changed from \gls{ARDSL} to \gls{MTASK}.
210
211 \subsection*{Integration with \texorpdfstring{\gls{ITASK}}{iTask}}
212 \Citet{lubbers_task_2017} extended this in his Master's Thesis by adding integration with \gls{ITASK} and a bytecode compiler to the language.
213 \Gls{SDS} in \gls{MTASK} could be accessed on the \gls{ITASK} server.
214 In this way, entire \gls{IOT} systems could be programmed from a single source.
215 However, this version used a simplified version of \gls{MTASK} without functions.
216 This was later improved upon by creating a simplified interface where \glspl{SDS} from \gls{ITASK} could be used in \gls{MTASK} and the other way around \citep{lubbers_task_2018}.
217 It was shown by \citet{amazonas_cabral_de_andrade_developing_2018} that it was possible to build real-life \gls{IOT} systems with this integration.
218 Moreover, a course on the \gls{MTASK} simulator was provided at the 2018 \gls{CEFP}\slash\gls{3COWS} winter school in Ko\v{s}ice, Slovakia \citep{koopman_simulation_2018}.
219
220 \subsection*{Transition to \texorpdfstring{\gls{TOP}}{TOP}}
221 The \gls{MTASK} language as it is now was introduced in 2018 \citep{koopman_task-based_2018}.
222 This paper updated the language to support functions, simple tasks, and \glspl{SDS} but still compiled to \gls{ARDUINO} \gls{CPP} code.
223 Later the byte code compiler and \gls{ITASK} integration was added to the language \citep{lubbers_interpreting_2019}.
224 Moreover, it was shown that it is very intuitive to write microcontroller applications in a \gls{TOP} language \citep{lubbers_multitasking_2019}.
225 One reason for this is that a lot of design patterns that are difficult using standard means are for free in \gls{TOP} (e.g.\ multithreading).
226 In 2019, the \gls{CEFP}\slash\gls{3COWS} summer school in Budapest, Hungary hosted a course on developing \gls{IOT} applications with \gls{MTASK} as well \citep{lubbers_writing_2019}.
227
228 \subsection*{\texorpdfstring{\Glsxtrshort{TOP}}{TOP}}
229 In 2022, the SusTrainable summer school in Rijeka, Croatia hosted a course on developing greener \gls{IOT} applications using \gls{MTASK} as well \citep{lubbers_green_2022}.
230 Several students worked on extending \gls{MTASK} with many useful features:
231 \Citet{van_der_veen_mutable_2020} did preliminary work on a green computing analysis, built a simulator, and explored the possibilities for adding bounded datatypes; \citet{de_boer_secure_2020} investigated the possibilities for secure communication channels; \citeauthor{crooijmans_reducing_2021} \citeyearpar{crooijmans_reducing_2021,crooijmans_reducing_2022} added abstractions for low-power operation to \gls{MTASK} such as hardware interrupts and power efficient scheduling; and \citet{antonova_mtask_2022} defined a preliminary formal semantics for a subset of \gls{MTASK}.
232
233 \subsection*{\texorpdfstring{\gls{MTASK}}{mTask} in practise}
234 Funded by the Radboud-Glasgow Collaboration Fund, collaborative work was executed with Phil Trinder, Jeremy Singer, and Adrian Ravi Kishore Ramsingh.
235 An existing smart campus application was developed using \gls{MTASK} and quantitively and qualitatively compared to the original application that was developed using a traditional \gls{IOT} stack \citep{lubbers_tiered_2020}.
236 This research was later extended to include a four-way comparison: \gls{PYTHON}, \gls{MICROPYTHON}, \gls{ITASK}, and \gls{MTASK} \citep{lubbers_could_2022}.
237 Currently, power efficiency behaviour of traditional versus \gls{TOP} \gls{IOT} stacks is being compared as well adding a \gls{FREERTOS} implementation to the mix as well.
238
239 \subsection*{Future work}
240 Plans for extensions and improvements include exploring integrating \gls{TINYML} into \gls{MTASK}; adding intermittent computing support to \gls{MTASK}; and extending the formal semantics to cover the entirety of the language.
241 In 2023, the SusTrainable summer school in Coimbra, Portugal will host a course on \gls{MTASK} as well.
242
243 \end{subappendices}
244
245 \input{subfilepostamble}
246 \end{document}