a2/2results.tex

   1
   2 \subsection{Preflight checklist}
   3 Execution of the preflight checklist of Table~\ref{tbl:preflight} yields the
   4 following results:
   5
   6 \begin{table}[H]
   7         \centering
   8     \begin{tabular}{|l|l|}
   9     \hline
  10     Check \# & result \\  \hline \hline
  11     1 & Passed\\  \hline
  12     2 & Passed\\  \hline
  13     3 & Passed\\  \hline
  14     4 & Passed\\  \hline
  15     5 & Passed\\  \hline
  16     \end{tabular}
  17 \caption{Results of the preflight checks}
  18 \label{tbl:preflightresults}
  19 \end{table}
  20
  21 \subsection{Test cases}
  22 Comparing the results of the execution of the test cases of
  23 Table~\ref{tbl:testpairs} with the expected results of those test cases specified in
  24 Table~\ref{tbl:testcases} yields the following results:
  25
  26 \setcounter{TCC}{1}
  27 \begin{table}[H]
  28         \centering
  29     \begin{tabular}{|l|l|}
  30     \hline
  31     Test case \# & result \\  \hline \hline
  32     \doTCC & Passed\\  \hline
  33     \doTCC & Passed\\  \hline
  34     \doTCC & Passed\\  \hline
  35     \doTCC & Passed\\  \hline
  36     \doTCC & Passed\\  \hline
  37     \doTCC & Passed\\  \hline
  38     \doTCC & Passed\\  \hline
  39     \doTCC & Passed\\  \hline
  40     \doTCC & Passed\\  \hline
  41     \doTCC & Passed\\  \hline
  42     \doTCC & Passed\\  \hline
  43     \doTCC & Passed\\  \hline
  44     \doTCC & Passed\\  \hline
  45     \doTCC & Passed\\  \hline
  46     \doTCC & Passed\\  \hline
  47     \doTCC & Passed\\  \hline
  48     \doTCC & Passed\\  \hline
  49     \doTCC & Passed\\  \hline
  50     \end{tabular}
  51 \caption{Results of the test cases}
  52 \label{tbl:testcasesresults}
  53 \end{table}
  54
  55 \subsection{Result}
  56 To pass the test the SUT has to pass all the specified test cases (
  57 Table~\ref{tbl:preflight} and Table~\ref{tbl:testpairs}). As can be seen in
  58 Table~\ref{tbl:preflightresults} and Table~\ref{tbl:testcasesresults} this is
  59 %not %remove first % in case of any failure
  60 the case. Therefore the SUT has Passed this test suite.
  61 %This failure is due to the failure of the test case(s) 1,2,3,n as specified
  62 %where the SUT failed to behave in the expected way by... %behavior dat SUT wel
  63 %%liet zien
  64
  65 \subsection{Notes on results}
  66 Due to severe difficulties with implementing the corruption of a checksum any
  67 tests which mention corruption of the checksum, that is, all tests testing
  68 the different partitions 4a, 4b, 4c, 5a and 5b as mentioned in
  69 Section~\ref{sec:testingofsut}, are always done with a valid checksum. These
  70 tests always fall in partition 4a and 5a.
  71
  72 These difficulties arise because TCP-checksum computation is something which is
  73 done
  74 on the hardware level or somewhere otherwise quite far from the software
  75 implementation of anything calling the TCP-stack. Due to this, changing the
  76 checksum of the segments send from the test script to the SUT is not possible
  77 without writing raw data to the network sockets, which would result
  78 in high changes of manual errors.
  79
  80 Because of this these partitions are not tested and the SUT is not tested for
  81 the requirement that it should disregard segments with invalid checksums.