X-Git-Url: https://git.martlubbers.net/?a=blobdiff_plain;f=a2%2F2results.tex;h=cfde7c7b60d03939c82c097d8d110b9115aa35ed;hb=f87f25c3a2e71e0287490ef7d0adaef92ff58ee0;hp=871ab785eb6951733a11a8d3030ea88f29eeb0c5;hpb=77f330957957adaaa9bef237609c6d81e9c3bda7;p=tt2015.git diff --git a/a2/2results.tex b/a2/2results.tex index 871ab78..cfde7c7 100644 --- a/a2/2results.tex +++ b/a2/2results.tex @@ -1,38 +1,81 @@ \subsection{Preflight checklist} -Execution of the preflight checklist of Table~\red{tbl:preflight} +Execution of the preflight checklist of Table~\ref{tbl:preflight} yields the +following results: +\begin{table}[H] + \centering + \begin{tabular}{|l|l|} + \hline + Check \# & result \\ \hline \hline + 1 & Passed\\ \hline + 2 & Passed\\ \hline + 3 & Passed\\ \hline + 4 & Passed\\ \hline + 5 & Passed\\ \hline + \end{tabular} +\caption{Results of the preflight checks} +\label{tbl:preflightresults} +\end{table} \subsection{Test cases} +Comparing the results of the execution of the test cases of +Table~\ref{tbl:testpairs} with the expected results of those test cases specified in +Table~\ref{tbl:testcases} yields the following results: -% -%\textbf{TODO: DEZE TABEL WEL UPDATEN!!} -% -%\begin{table} -%\begin{tabularx}{\linewidth}{| l | X|} -% \hline -%Check 1 & Get the SUT in a workable state. \\\hline -%Course of action & \begin{enumerate} -% \item Import the VirtualBox image into VirtualBox. -% \item Boot the vm. -% \item Verify the SUT booted succesfully and the network module(s) are loaded. -%\end{enumerate} \\\hline -%Passed & \textit{\st{Yes}/No} \\\hline \hline -%Check 2 & Verify the SUT is complete. \\\hline -%Course of action & \begin{enumerate} -% \item Use the course of action for \emph{Check 1} in order to boot the SUT. -% \item Verify the loopback device exists using \emph{ifconfig} -% \item Verify the \emph{echo-server} is present on the system. -% \item Verify \emph{Scrappy} is present on the system. -% \item Verify all scripts used for testing are present on the system. -%\end{enumerate} \\\hline -%Passed & \textit{\st{Yes}/No} \\\hline \hline -%Check 3 & Initialize the testing environment. \\\hline -%Course of action & \begin{enumerate} -% \item Boot the SUT (see \emph{Check 1}). -% \item Setup iptables by executing \emph{./scripts/setup/iptables.sh} -% \item Setup ... by executing \emph{./scripts/setup/...} -%\end{enumerate} \\\hline -%Passed & \textit{\st{Yes}/No} \\\hline -%\end{tabularx} -%\end{table} +\setcounter{TCC}{1} +\begin{table}[H] + \centering + \begin{tabular}{|l|l|} + \hline + Test case \# & result \\ \hline \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \end{tabular} +\caption{Results of the test cases} +\label{tbl:testcasesresults} +\end{table} + +\subsection{Result} +To pass the test the SUT has to pass all the specified test cases ( +Table~\ref{tbl:preflight} and Table~\ref{tbl:testpairs}). As can be seen in +Table~\ref{tbl:preflightresults} and Table~\ref{tbl:testcasesresults} this is +%not %remove first % in case of any failure +the case. Therefore the SUT has Passed this test suite. +%This failure is due to the failure of the test case(s) 1,2,3,n as specified +%where the SUT failed to behave in the expected way by... %behavior dat SUT wel +%%liet zien + +\subsection{Notes on results} +Due to severe difficulties with implementing the corruption of a checksum any +tests which mention corruption of the checksum, that is, all tests testing +the different partitions 4a, 4b, 4c, 5a and 5b as mentioned in +Section~\ref{sec:testingofsut}, are always done with a valid checksum. These +tests always fall in partition 4a and 5a. + +These difficulties arise because TCP-checksum computation is something which is +done +on the hardware level or somewhere otherwise quite far from the software +implementation of anything calling the TCP-stack. Due to this, changing the +checksum of the segments send from the test script to the SUT is not possible +without writing raw data to the network sockets, which would result +in high changes of manual errors. + +Because of this these partitions are not tested and the SUT is not tested for +the requirement that it should disregard segments with invalid checksums. \ No newline at end of file