X-Git-Url: https://git.martlubbers.net/?a=blobdiff_plain;f=a2%2F2results.tex;h=cfde7c7b60d03939c82c097d8d110b9115aa35ed;hb=92ded11e5cc8e03df27e440d1d12cfaebb59e726;hp=e69de29bb2d1d6434b8b29ae775ad8c2e48c5391;hpb=9c2840b95f2dfe78bf76b72b303f375d22641bee;p=tt2015.git diff --git a/a2/2results.tex b/a2/2results.tex index e69de29..cfde7c7 100644 --- a/a2/2results.tex +++ b/a2/2results.tex @@ -0,0 +1,81 @@ + +\subsection{Preflight checklist} +Execution of the preflight checklist of Table~\ref{tbl:preflight} yields the +following results: + +\begin{table}[H] + \centering + \begin{tabular}{|l|l|} + \hline + Check \# & result \\ \hline \hline + 1 & Passed\\ \hline + 2 & Passed\\ \hline + 3 & Passed\\ \hline + 4 & Passed\\ \hline + 5 & Passed\\ \hline + \end{tabular} +\caption{Results of the preflight checks} +\label{tbl:preflightresults} +\end{table} + +\subsection{Test cases} +Comparing the results of the execution of the test cases of +Table~\ref{tbl:testpairs} with the expected results of those test cases specified in +Table~\ref{tbl:testcases} yields the following results: + +\setcounter{TCC}{1} +\begin{table}[H] + \centering + \begin{tabular}{|l|l|} + \hline + Test case \# & result \\ \hline \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \doTCC & Passed\\ \hline + \end{tabular} +\caption{Results of the test cases} +\label{tbl:testcasesresults} +\end{table} + +\subsection{Result} +To pass the test the SUT has to pass all the specified test cases ( +Table~\ref{tbl:preflight} and Table~\ref{tbl:testpairs}). As can be seen in +Table~\ref{tbl:preflightresults} and Table~\ref{tbl:testcasesresults} this is +%not %remove first % in case of any failure +the case. Therefore the SUT has Passed this test suite. +%This failure is due to the failure of the test case(s) 1,2,3,n as specified +%where the SUT failed to behave in the expected way by... %behavior dat SUT wel +%%liet zien + +\subsection{Notes on results} +Due to severe difficulties with implementing the corruption of a checksum any +tests which mention corruption of the checksum, that is, all tests testing +the different partitions 4a, 4b, 4c, 5a and 5b as mentioned in +Section~\ref{sec:testingofsut}, are always done with a valid checksum. These +tests always fall in partition 4a and 5a. + +These difficulties arise because TCP-checksum computation is something which is +done +on the hardware level or somewhere otherwise quite far from the software +implementation of anything calling the TCP-stack. Due to this, changing the +checksum of the segments send from the test script to the SUT is not possible +without writing raw data to the network sockets, which would result +in high changes of manual errors. + +Because of this these partitions are not tested and the SUT is not tested for +the requirement that it should disregard segments with invalid checksums. \ No newline at end of file