1 \documentclass[../thesis.tex
]{subfiles
}
4 \ifSubfilesClassLoaded{
7 \chapter{Introduction
}%
8 %\setlength{\epigraphwidth}{.5\textwidth}%
10 % A \textbf{rhapsody} in music is a one-movement work that is episodic yet integrated, free-flowing in structure, featuring a range of highly contrasted moods, colour, and tonality. An air of spontaneous inspiration and a sense of improvisation make it freer in form than a set of variations.
12 % Wikipedia~\cite{wikipedia_contributors_rhapsody_2022}
14 \label{chp:introduction
}
15 The sheer number of connected devices around us is increasing exponentially.
16 First and foremost, these devices are driven by software.
17 This thesis is about
\ldots
18 \todo[inline
]{introduction
}
20 \section{Internet of Things
}
21 \todo[inline
]{add more citations and rewrite to make modern
}
22 The
\gls{IOT
} is growing rapidly and it is changing the way people and machines interact with the world.
23 While the term
\gls{IOT
} briefly gained interest around
1999 to describe the communication of
\gls{RFID
} devices~
\todo{cite
}, it probably already popped up halfway the eigthies in a speech by Peter T. Lewis~
\cite{peter_t_lewis_speech_1985
}.
26 The
\acrlong{IOT
}, or
\acrshort{IOT
}, is the integration of people, processes and technology with connectable devices and sensors to enable remote monitoring, status, manipulation and evaluation of trends of such devices.
29 CISCO states that the
\gls{IOT
} only started when there where as many connected devices as there were people on the globe, i.e.\ around
2008~
\cite{evans_internet_2011
}.
30 Today, the
\gls{IOT
} is the term for a system of devices that sense the environment, act upon it and communicate with each other and the world.
31 These connected devices are already in everyone's household in the form of smart electricity meters, smart fridges, smartphones, smart watches, home automation,
\etc.
33 When describing
\gls{IOT
} systems, a layered, or tiered architecture is often used to compartmentalize the technology.
34 The number of tiers heavily depends on the complexity of the model but for the intents and purposes of the thesis, the four layer architecture shown in
\cref{fig:iot-layers
} is used.
38 \includestandalone{iot-layers
}
39 \caption{The four layered
\gls{IOT
} architecture.
}%
40 \label{fig:iot-layers
}
44 \item[Presentation layer
] This presentation layer provides the interface between the user and the
\gls{IOT
} application.
45 For example, in home automation, this is often implemented as a web interface or a mobile app.
46 \item[Application layer
]
47 Servers often power the application layer, by providing the data storage,
48 One of its goals is to provide the
\gls{API
}, interfaces and data storage
49 \item[Network layer
] connects all layers together.
50 In many applications this may be implemented using conventional networking techniques such as WiFi or wire networks.
51 However, recently, networks tailored to the needs of
\gls{IOT
} applications have been increasingly popular such as
\gls{BLE
}, LoRa, ZigBee or LTE-M.
52 \item[Perception layer
], also called edge layer, collects the data, interacts with the environment and consists of (edge) devices equipped with various sensors and actuators.
53 As a special type of device, it may also contain a
\gls{SN
}.
54 A
\gls{SN
} is a collection of sensors connected by a mesh network or central hub.
57 While the number of devices seems to be growing exponentially fast, programming
\gls{IOT
} systems remains difficult as there is a lot of semantic friction~
\cite{ireland_classification_2009
}.
59 The devices are a large heterogeneous collection of different platforms, protocols and languages resulting in impedance problems or semantic friction between layers~
\cite{ireland_classification_2009
}.
61 Additionaly, the perception layer often is a heterogeneous collections of microcontrollers as well, each having their own peculiarities, language of choice and hardware interfaces.
62 The hardware needs to be cheap, small-scale and energy efficient.
63 As a result, the
\glspl{MCU
} used to power these devices do not have a lot of computational power, a soup
\c{c
}on of memory, and little communication bandwidth.
64 Typically the devices do not run a full fledged
\gls{OS
} but a compiled firmware.
65 This firmware is often written in an imperative language that needs to be flashed to the program memory.
66 It is possible to dynamically send the program to the program memory using
\gls{OTA
} programming~
\cite{baccelli_scripting_2018,baccelli_reprogramming_2018
}.
67 Program memory typically is flash based and only lasts a couple of thousand writes before it wears out.
68 While devices are getting a bit faster, smaller, and cheaper, they keep these properties to an extent.
69 The properties of the device greatly reduce the flexibility for dynamic systems where tasks are created on the fly, executed on demand and require parallel execution.
70 These problems can be mitigated by dynamically sending code to be interpreted to the
\gls{MCU
}.
71 With interpretation, a specialized interpreter is flashed in the program memory once that receives the program code to execute at runtime.
74 \section{Domain-specific languages
}
76 Programming languages can be divided up into two categories:
\glspl{DSL
} and
\glspl{GPL
}~
\cite{fowler_domain_2010
}.
77 Where
\glspl{GPL
} are not made with a demarcated area in mind,
\glspl{DSL
} are tailor-made for a specific domain.
78 Writing idiomatic domain-specific code in an
\gls{DSL
} is easy but this may come at the cost of the
\gls{DSL
} being less expressive to an extent that it may not even be Turing complete.
79 \Glspl{DSL
} come in two main flavours: standalone and embedded
\footnote{Also called external and internal respectively.
} of which
\glspl{EDSL
} can again be classified into heterogeneous and homogeneous languages (see
\cref{fig:hyponymy_of_dsls
} for this hyponymy).
83 \includestandalone{hyponymy_of_dsls
}
84 \caption{Hyponymy of
\glspl{DSL
} (adapted from~
\cite[pg.\
2]{mernik_extensible_2013
})
}%
85 \label{fig:hyponymy_of_dsls
}
88 \glspl{DSL
} where historically created as standalone languages which means all the machinery is developed solely for the language.
89 The advantage of this approach is that the language designer is free to define the syntax and type system of the language as they wish, not being restricted by any constraint.
90 Unfortunately it also means that they need to develop a compiler or interpreter for the language to be usable making standalone
\glspl{DSL
} costly to create.
91 Examples of standalone
\glspl{DSL
} are regular expressions, make, yacc, XML, SQL,
\etc.
93 A radically different approach is embeddding the
\gls{DSL
} in a host language, i.e.\
\glspl{EDSL
}~
\cite{hudak_modular_1998
}.
94 By defining the language as constructs in the host language, much of the machinery is inherited and the cost of creating embedded languages is very low.
95 There are however two sides to the this coin.
96 If the syntax of the host language is not very flexible, the syntax of the
\gls{DSL
} may become clumsy.
97 Furthermore, errors shown to the programmer may be larded with host language errors, making it difficult for a non-expert of the host language to work with the
\gls{DSL
}.
99 Tratt applied a notion from metaprogramming~
\cite{sheard_accomplishments_2001
} to
\glspl{EDSL
} to define homogeneity and heterogeneity of
\glspl{EDSL
} as follows~
\cite{tratt_domain_2008
}:
101 a homogeneous system is one where all the components are specifically designed to work with each other, whereas in heterogeneous systems at least one of the components is largely, or completely, ignorant of the existence of the other parts of the system.
103 Homogeneous
\glspl{EDSL
} are therefore languages that are solely defined as an extension to their host language.
104 They often restrict features of the host language to provide a safer interface or capture an idiomatic pattern in the host language for reuse.
105 The difference between a library and a homogeneous
\glspl{EDSL
} is not always clear.
106 Examples of homogeneous
\glspl{EDSL
} are libraries such as ones for
\glspl{GUI
} creation, LISP's macro system,
\etc.
108 On the other hand, heterogeneous
\glspl{EDSL
} are languages that are not executed in the host language.
109 For example, Elliott et al.\ describe the language Pan, for which the final representation in the host language is a compiler that will, when executed, generate code for a completely different target platform~
\cite{elliott_compiling_2003
}.
110 In fact,
\gls{ITASK
} and
\gls{MTASK
} are both heterogeneous
\glspl{EDSL
}.
112 \section{Functional programming
}\label{ssec:functional programming
}
114 \Gls{FP
} languages are naturally suitable as a host language for
\gls{DSL
} embedding because of their rich type systems and minimal and extensible syntax~
\cite{gibbons_functional_2015
}.
116 \section{Task-oriented programming
}
117 \Gls{TOP
} is a declarative programming paradigm designed to model interactive systems~
\cite{plasmeijer_task-oriented_2012
}.
118 Instead of dividing problems into layers or tiers, as is done in
\gls{IOT
} architectures as well, it deals with separation of concerns in a novel way.
119 From the data types, utilising various
\emph{type-parametrised
} concepts, all other aspects are handled (see
\cref{fig:tosd
}).
120 This approach to software development is also called
\gls{TOSD
}~
\cite{wang_maintaining_2018
}.
124 \begin{subfigure
}[t
]{.5\textwidth}
126 \includestandalone{traditional
}
127 \caption{Traditional layered approach.
}
129 \begin{subfigure
}[t
]{.5\textwidth}
131 \includestandalone{tosd
}
132 \caption{\Gls{TOSD
} approach.
}
134 \caption{Separation of concerns in a traditional setting and in
\gls{TOSD
} (adapted from~
\cite[pg.\
20]{wang_maintaining_2018
}).
}%
139 \item[Presentation layer: UI
]
140 The
\gls{UI
} of the system is automatically generated from the representation of the type.
141 For instance,
\gls{TOP
} languages implemented in an
\gls{FP
} language often use generic programming or template metaprogramming to automatically achieve this.
142 \Gls{TOP
} languages embedded in imperative programming languages may use introspection
\todo{Do I want this sentence here?
}.
143 Even though the
\gls{UI
} is generated from the structure of the datatypes, in many practical
\gls{TOP
} systems it can be tweaked afterwards to suit the specific needs of the application.
144 \item[Business layer: Tasks
]
145 A task is an abstract representation of a piece of work that needs to be done.
146 It provides an intuitive abstraction over work in the real world.
147 Just as with real-life tasks and workflow, tasks can be combined in various ways such as in parallel or in sequence.
148 Furthermore, tasks are observable which means it is possible to observe a --- partial --- result during execution and act upon it by for example starting new tasks.
149 Examples of tasks are filling in a form, sending an email, reading a sensor or even doing a physical task.
150 \item[Resource access:
\glspl{SDS
}]
151 Tasks can communicate using task values but this imposes a problem in many collaboration patterns where tasks that are not necessarily related need to share data.
152 Tasks can also share data using
\glspl{SDS
}.
153 \Glspl{SDS
} are an abstraction over any data.
154 An
\gls{SDS
} can represent typed data stored in a file, a chunk of memory, a database
\etc.
155 \Glspl{SDS
} can also represent external impure data such as the time, random numbers or sensory data.
156 Similar to tasks, transformation and combination of
\glspl{SDS
} is possible.
158 The
\gls{UOD
} from the business layer is explicitly and separately modelled by the relations that exist in the functions of the host language.
159 \gls{TOP
} languages are usually embedded in
\gls{FP
} languages but this not necessarily the case.
160 Some host languages also provide the implementations for the tasks and
\glspl{SDS
}.
161 \todo{dit moet beter
}
165 \todo[inline
]{uitbreiden
}
167 % \textbf{rhapsody} /\textipa{['r\ae{}ps@di]}/ \emph{noun} (pl.\ \textbf{-ies}) a piece of music that is full of feeling and is not regular in form: Liszt's Hungarian Rhapsodies.
169 % Oxford Advanced Learners Dictionary~\cite{margaret_deuter_rhapsody_2015}.
171 This thesis is structured as a purely functional rhapsody.
172 On Wikipedia, a rhapsody is defined as follows~
\cite{wikipedia_contributors_rhapsody_2022
}:
174 A
\textbf{rhapsody
} in music is a one-movement work that is episodic yet integrated, free-flowing in structure, featuring a range of highly contrasted moods, colour, and tonality. An air of spontaneous inspiration and a sense of improvisation make it freer in form than a set of variations.
177 This thesis follows the tradition and consists of three movements that are episodic yet integrated.
178 \Cref{prt:dsl
} is about
\gls{EDSL
} techniques,
\cref{prt:top
} elaborates on
\gls{TOP
} for the
\gls{IOT
} and
\cref{prt:tvt
} compares traditional tiered
\gls{IOT
} architectures to a tierless architectures such as
\gls{TOP
}.
179 The movements are readable independently if the reader is familiarised with the background material provided in
\cref{chp:introduction
}.
180 The thesis wraps up with
\cref{chp:conclusion
} that provides a conclusion and an outlook on future work.
182 \subsection{\Cref{prt:dsl
}: Domain-specific languages
}
183 This movement is a cumulative or paper-based movement that focusses on techniques for embedding
\glspl{DSL
} in functional programming lanugages.
184 After reading the first chapter, subsequent chapters in this movement are readable as independently.
186 \subsubsection{\Cref{chp:dsl_embedding_techniques
}}
187 This chapter shows all the basic techniques and compares the properties of several embedding methods.
188 This chapter is not based on a paper and written as a background for the subsequent chapters in the movement.
190 \subsubsection{\Cref{chp:classy_deep_embedding
}}
191 This chapter is based on the paper:
\emph{Deep Embedding with Class
}~
\todo{cite when published
}.
193 During a Master's thesis supervision~
\cite{amazonas_cabral_de_andrade_developing_2018
}, focussing on an early version of
\gls{MTASK
}, a seed was planted for a novel deep embedding technique for
\glspl{DSL
} where the resulting language is extendible both in constructs and in interpretation using type classes and existential data types.
194 Slowly the ideas organically grew to form the technique shown in the paper.
196 The research from this paper and writing the paper was solely performed by me.
198 \subsubsection{\Cref{chp:first-class_datatypes
}} shows how to inherit data types in
\glspl{EDSL
} using metaprogramming.
199 This chapter is based on the paper:
\emph{First-Class Data Types in Shallow Embedded Domain-Specific Languages using Metaprogramming
}~
\todo{cite when accepted
}.
201 The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer in which we discussed and refined the ideas.
203 \subsubsection{\Cref{chp:strongly-typed_multi-view_stack-based_computations
}} shows how to use advanced
\gls{DSL
} techniques to embed type safe stack-based computations in a host language.
204 This chapter is based on the paper:
\emph{Strongly-Typed Multi-View Stack-Based Computations
}~
\todo{cite when accepted
}.
205 \todo{Zal ik dit paper wel opnemen? Aangezien Pieter het grotendeels gedaan heeft?
}
207 I supported Pieter Koopman in performing the research in this paper by writing some of the software.
208 The paper was mostly written by Pieter Koopman
\todo{probably will be
}.
210 \subsection{\Cref{prt:top
}: Task-oriented
\texorpdfstring{\acrlong{IOT
}}{internet of things
} programming
}
211 This part is a monograph focussing on
\glspl{TOP
} for the
\gls{IOT
}.
212 Therefore, the chapters depend on eachother and are best read in order.
213 The monograph is compiled from the following papers and revised lecture notes.
216 \item \bibentry{koopman_task-based_2018
}.
218 This was the initial
\gls{TOP
}/
\gls{MTASK
} paper.
219 Pieter Koopman wrote it but I helped with the software and research.
220 \item \bibentry{lubbers_task_2018
}.
222 This paper was an extension of my Master's thesis~
\cite{lubbers_task_2017
}.
223 It shows how a simple imperative variant of
\gls{MTASK
} was integrated with
\gls{ITASK
}.
224 While the language was a lot different than later versions, the integration mechanism is still used in
\gls{MTASK
} today.
226 The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer in which we discussed and refined the ideas.
227 \item \bibentry{lubbers_multitasking_2019
}.
229 This paper was a short paper on the multitasking capabilities of
\gls{MTASK
} in contrast to traditional multitasking methods for
\gls{ARDUINO
}.
230 \item \emph{Simulation of a Task-Based Embedded Domain Specific Language for the Internet of Things
}~
\todo{cite when published
}
232 These revised lecture notes are from a course on the
\gls{MTASK
} simulator was provided at the
2018 CEFP/
3COWS winter school in Ko
\v{s
}ice, Slovakia.
234 Pieter Koopman wrote and taught it though I helped with the software and research.
235 \item \emph{Writing Internet of Things applications with Task Oriented Programming
}~
\todo{cite when published
}
237 These revised lecture notes are from a course on programming in
\gls{MTASK
} provided at the
2019 CEFP/
3COWS summer school in Budapest, Hungary.
239 Pieter prepared half of the lecture. I wrote the lecture notes, prepared the other half of the lecture, the assignments and practical session.
240 \item \bibentry{lubbers_interpreting_2019
}.
242 This paper showed an implementation for
\gls{MTASK
} for microcontrollers in the form of a compilation scheme and informal semantics description.
244 The research in this paper and writing the paper was performed by me, though there were weekly meetings with Pieter Koopman and Rinus Plasmeijer in which we discussed and refined the ideas.
245 \item \emph{Reducing the Power Consumption of IoT with Task-Oriented Programming
}~
\todo{cite when published
}
247 This paper shows how to create a scheduler so that devices running
\gls{MTASK
} tasks can go to sleep more automatically.
248 Furthermore, it shows how to integrate hardware interrupts into
\gls{MTASK
}.
249 The research was carried out by Sjoerd Crooijmans during his Master's thesis~
\cite{crooijmans_reducing_2021
}.
250 I did the daily supervision and helped with the research, Pieter Koopman was the formal supervisor and wrote most of the paper.
251 \item \emph{Asynchronous Shared Data Sources
}~
\todo{cite when accepted
}
253 \todo[inline
]{This paper could in theory be dropped in favour of being done sooner with the thesis
}
255 Asynchronous
\glspl{SDS
} are used in the current
\gls{ITASK
} system and allow bigger
\gls{IOT
} devices such as raspberry pi's to be used in a tierless
\gls{ITASK
} system.
256 The example application shown in
\cref{prt:tvt
} heavily uses asynchronous
\glspl{SDS
}.
257 This paper shows how to lift
\glspl{SDS
} to operate asynchronously independent of
\gls{ITASK
} or another
\gls{TOP
} implementation.
259 The initial research was carried out by Haye B\"ohm during his Master's thesis~
\cite{bohm_asynchronous_2019
}.
260 I did the daily supervision and helped with the research, Pieter Koopman and Rinus Plasmeijer were the formal supervisors.
261 I extended and generalised the research and wrote the paper.
262 \item \emph{Green Computing for the Internet of Things
}~
\todo[inline
]{cite when done
}
264 These revised lecture notes are from a course on sustainable programming using
\gls{MTASK
} provided at the
2022 Sustrainable summer school in Rijeka, Croatia.
266 Pieter prepared half of the lecture. I wrote the lecture notes, prepared the other half of the lecture, the assignments and the practical session.
269 The movement is made up out of the following chapters
270 \todo[inline
]{preliminary
}
273 \item The mTask language (includes informal semantics)
281 \item Interpretations/views/backends
\todo{decide on terminology
}
282 \item Green computing
283 \item Integration with iTask
284 \item Implementation (based on IFL19 paper)
285 \item TOP for IoT beyond microprocessors
288 \subsection{\Cref{prt:tvt
}: Tiered versus tierless programming
}
289 These chapters focus on comparing traditional tiered architectures to tierless architectures and are based on a single journal paper that extended on a conference paper.
290 The conference paper was partly funded by the Radboud-Glasgow Collaboration Fund.
291 It does both a qualitative and a quantitative four-way comparison of a smart campus application.
293 The research in these papers and writing them was performed by all authors.
294 I created the server application, the
\gls{CLEAN
}/
\gls{ITASK
}/
\gls{MTASK
} implementation (
\acrshort{CWS
}) and the
\gls{CLEAN
}/
\gls{ITASK
} implementation (
\acrshort{CRS
})
295 Adrian Ramsingh created the micropython implementation (
\acrshort{PWS
}), the original python implementation (
\acrshort{PRS
}) and the server application were created by Jeremy Singer, Dejice Jacob and Kristian Hentschel~
\cite{hentschel_supersensors:_2016
}.
298 \item \bibentry{lubbers_tiered_2020
}.
299 \item \emph{Could Tierless Languages Reduce IoT Development Grief?
}~
\todo[inline
]{cite when accepted
}
302 \newcounter{secondauthorcnt
}
303 \newcounter{underreviewcnt
}
304 \newcounter{plannedcnt
}
305 \newcounter{publicationscnt
}
306 \newcommand{\secondauthor}{\textsuperscript{$
\ast$
}\stepcounter{secondauthorcnt
}}
307 \newcommand{\underreview}{\textsuperscript{$
\dagger$
}\stepcounter{underreviewcnt
}}
308 \newcommand{\planned}{\textsuperscript{$
\ddagger$
}\stepcounter{plannedcnt
}}
310 \subsection{List of publications
}
312 \item \secondauthor{}
313 A Task-Based DSL for Microcomputers
315 P. Koopman
\footnote{\orcid{0000-
0002-
3688-
0957}}, M. Lubbers
\footnote{\orcid{0000-
0002-
4015-
4878}}, and R. Plasmeijer (RWDSL
2018)~
\cite{koopman_task-based_2018
}.
316 \item Task Oriented Programming and the Internet of Things
318 M. Lubbers, P. Koopman, and R. Plasmeijer (IFL
2018)~
\cite{lubbers_task_2017
} (extension of Master's thesis~
\cite{lubbers_task_2018
}).
319 \item Multitasking on Microcontrollers using Task Oriented Programming
321 M. Lubbers, P. Koopman, and R. Plasmeijer (MIPRO/
4COWS
2019)~
\cite{lubbers_multitasking_2019
}.
322 \item \secondauthor{}
323 Simulation of a Task-Based Embedded Domain Specific Language for the Internet of Things
325 P. Koopman, M. Lubbers, and R. Plasmeijer (CEFP/
3COWS
2018).
326 \item Writing Internet of Things applications with Task Oriented Programming
328 M. Lubbers, P. Koopman, and R. Plasmeijer (CEFP/
3COWS
2019).
329 \item Interpreting Task Oriented Programs on Tiny Computers
331 M. Lubbers, P. Koopman, and R. Plasmeijer (IFL
2019)~
\cite{lubbers_interpreting_2019
}.
332 \item Tiered versus Tierless IoT Stacks: Comparing Smart Campus Software Architectures
334 M. Lubbers, P. Koopman, A. Ramsingh
\footnote{\orcid{0000-
0003-
3501-
902X
}}, J. Singer
\footnote{\orcid{0000-
0001-
9462-
6802}}, and P. Trinder
\footnote{\orcid{0000-
0003-
0190-
7010}} (IoT
2020)~
\cite{lubbers_tiered_2020
}.
337 \item Deep Embedding with Class
339 M. Lubbers (TFP
2022).
340 \item \secondauthor{}
341 Reducing the Power Consumption of IoT with Task-Oriented Programming
343 S. Crooijmans, M. Lubbers, and P. Koopman (TFP
2022).
346 \item \underreview{} Could Tierless Languages Reduce IoT Development Grief?
348 M. Lubbers, P. Koopman, A. Ramsingh, J. Singer, and P. Trinder (ACM TIOT) (extension of~
\cite{lubbers_tiered_2020
}).
349 \item \secondauthor\underreview{}
350 Strongly-Typed Multi-View Stack-Based Computations
352 M. Lubbers and P. Koopman (IFL
2022 under review).
353 \item \underreview{} First-Class Data Types in Shallow Embedded Domain-Specific Languages using Metaprogramming
355 M. Lubbers, P. Koopman, and R. Plasmeijer (IFL
2022 under review).
356 \item \underreview{} Asynchronous Shared Data Sources
358 M. Lubbers, H. Böhm, P. Koopman, and R. Plasmeijer (IFL
2022 under review).
361 \item \planned{} Green Computing for the Internet of Things
363 M. Lubbers, P. Koopman (Sustrainable
2022 planned).
365 \setcounter{publicationscnt
}{\value{enumi
}}
368 There are
\thepublicationscnt{} publications of which
\thesecondauthorcnt{} I'm second author,
\theunderreviewcnt{} are under review and
\theplannedcnt{} are planned.
370 \input{subfilepostamble
}