Difference between revisions of "Testing:2.1"

From TinyOS Wiki
Jump to: navigation, search
(→‎micaZ (Phil + David G.))
(Shimmer Platform results (part 1))
Line 333: Line 333:
 
- Changed AM id to comply with TEP4.
 
- Changed AM id to comply with TEP4.
 
- README.txt is present and adequately describes the operation.
 
- README.txt is present and adequately describes the operation.
 +
 +
 +
=== shimmer (Konrad Lorincz & Vlado Handziski) ===
 +
 +
<table border=1 cellpadding=2>
 +
<tr>
 +
  <td>App</td>
 +
  <td>Standard</td>
 +
  <td>Safe</td>
 +
  <td>Notes</td>
 +
</tr>
 +
<tr><td>AntiTheft</td>          <td bgcolor=red>FAIL</td> <td bgcolor=red>FAIL</td> <td>platform not supported</td>
 +
<tr><td>BaseStation</td>        <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>Blink</td>              <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>Oscilloscope</td>      <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>Powerup</td>            <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>RadioCountToLeds</td>  <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>RadioSenseToLeds</td>  <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/cc2420/LplBroadcastCountToLeds</td>      <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/cc2420/LplBroadcastPeriodicDelivery</td>  <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/cc2420/LplUnicastPeriodicDelivery</td>    <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/cc2420/RssiToSerial</td>    <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/cc2420/TestAcks</td>        <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/cc2420/TestPacketLink</td>  <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/cc2420/TxThroughput</td>    <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/deluge</td>                  <td bgcolor=red>FAIL</td> <td bgcolor=red>FAIL</td> <td>N/A (currently not supported on shimmer which uses SD with another interface)</td>
 +
<tr><td>tests/storage</td>                <td bgcolor=red>FAIL</td> <td bgcolor=red>FAIL</td> <td>N/A (currently not supported on shimmer which uses SD with another interface)</td>
 +
<tr><td>tests/TestAdc</td>                <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/arbiters/TestFcfsArbiter</td>  <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/arbiters/TestRoundRobinArbiter</td>  <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/TestFTSP</td>                <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/TestLPL</td>                <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/TestPrintf</td>              <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/TestSerial</td>              <td bgcolor=green>PASS</td> <td bgcolor=green>PASS</td> <td></td>
 +
<tr><td>tests/TestSimComm</td>            <td bgcolor=red>FAIL</td> <td bgcolor=red>FAIL</td> <td>platform not supported</td>
 +
<tr><td>tests/TestSimTimer</td>            <td bgcolor=red>FAIL</td> <td bgcolor=red>FAIL</td> <td>platform not supported</td>
 +
<tr><td>tosthreads</td>                    <td bgcolor=red>FAIL</td> <td bgcolor=red>FAIL</td> <td>platform not supported</td>
 +
</table>

Revision as of 16:07, 1 July 2008

Testing results for 2.1.

RC2

  • micaZ: Phil L./David Gay
  • telos: Kevin/David Moss
  • intelmote2: Brano/?
  • tinynode: Maxime
  • eyesIFX: Jan H.
  • iris: Janos/Miklos
  • shimmer: Konrad/Vlado

The applications and their owners are as follows. This table denotes whether the application has been checked for its README and compliance with TEP 3 and TEP 4.

App Owner Status Notes
AntiTheft Phil PASS
BaseStation Phil PASS
Blink Vlado ?
Null Phil PASS
Oscilloscope Konrad ?
Powerup Janos ?
RadioCountToLeds Jan H. PASS
RadioSenseToLeds Jan H. PASS
tests/cc2420 David G. ?
tests/deluge Vlado ?
tests/storage Konrad ?
tests/TestAdc Phil PASS
tests/TestArbiter Kevin ?
tests/TestFTSP Phil FAIL Violates TEP 3: FTSP -> Ftsp
tests/TestLPL David G. ?
tests/TestPrintf Janos ?
tests/TestSerial Miklos ?
tests/TestSimComm Razvan PASS
tests/TestSimTimer Mike ?
tests/tosthreads/apps Mike ?
tests/tosthreads/capps Razvan PASS
tests/tkn154 Om ?
MViz Phil FAIL Violates TEP 3: uartlen, sendbuf, uartbuf, sendbusy, uartbusy, fatal_problem, report_problem, report_sent, report_received, suppress_count_change
MultihopOscilloscope Om ?
MultihopOscilloscopeLqi Om ?
TestNetwork Om ?
TestTymo Romain ?
tests/TestDissemination Om ?
tests/TestDIP Phil FAIL Violates TEP 3: DIP -> Dip, Hardcoded AM type (0xAB), m_test, testmsg, okbit,

Platforms

micaZ (Phil + David G.)

App Standard Safe Notes
AntiTheft PASS PASS
BaseStation PASS PASS
Blink PASS PASS
Null PASS PASS
Oscilloscope PASS PASS
Powerup PASS PASS
RadioCountToLeds PASS PASS
RadioSenseToLeds PASS PASS
tests/cc2420 PASSPASS

tests/cc2420/LplUnicastPeriodicDelivery:

transmission very unreliable (few receptions)


tests/cc2420/TestPacketLink

tests/deluge PASS PASS Safe has these warnings:
/home/pal/src/tinyos-2.x/tos/lib/net/Deluge/FlashVolumeManager/FlashVolumeManagerP.nc:45: Warning: Type "struct __anonstruct_nx_uint8_t_5 []" in field "data" contains an open array.

/home/pal/src/tinyos-2.x/tos/lib/net/Deluge/FlashVolumeManager/FlashVolumeManagerP.nc:53: Warning: Type "struct __anonstruct_nx_uint8_t_5 []" in field "data" contains an open array.

/home/pal/src/tinyos-2.x/tos/lib/net/drip/DisseminationEngine.h:46: Warning: Type "struct __anonstruct_nx_uint8_t_5 []" in field "data" contains an open array.

/home/pal/src/tinyos-2.x/tos/system/SchedulerBasicP.nc: In function 'SchedulerBasicP$Scheduler$init':
/home/pal/src/tinyos-2.x/tos/system/SchedulerBasicP.nc:117: warning: passing argument 1 of 'memset' discards qualifiers from pointer target type
/home/pal/src/tinyos-2.x/tos/chips/atm128/adc/HplAtm128AdcP.nc: In function '__vector_21':
/home/pal/src/tinyos-2.x/tos/chips/atm128/adc/HplAtm128AdcP.nc:110: warning: 'newSr.adfr' is used uninitialized in this function
/home/pal/src/tinyos-2.x/tos/chips/atm128/adc/HplAtm128AdcP.nc:110: warning: 'newSr.adps' is used uninitialized in this function
/home/pal/src/tinyos-2.x/tos/chips/atm128/adc/HplAtm128AdcP.nc:110: warning: 'newSr.adsc' is used uninitialized in this function

Not clear why the ADC is pulled in.

tests/storage PASS PASS
tests/TestAdc PASS PASS
tests/TestArbiter PASS PASS
tests/TestFTSP PASS PASS
tests/TestLPL PASS PASS
tests/TestPrintf PASS FAIL Safe fails on 
/home/pal/src/tinyos-2.x/tos/lib/printf/avr_stdio.h:408: Warning: Type "struct __file *[0]" in global "__iob" contains an open array.

/home/pal/src/tinyos-2.x/tos/lib/printf/PrintfP.nc:79: Error: Type mismatch in coercion:
  from: int ( __attribute__((__noinline__)) (* BND(...)  ))(char c , struct __file * SAFE  stream )
    to: int (* BND(...)  )(char arg_0x403687c8 , struct __file * SAFE  arg_0x403689b0 )
   exp: & uart_putchar

/home/pal/src/tinyos-2.x/tos/lib/printf/avr_stdio.h:408: Error: Global array __iob needs a length annotation (e.g. COUNT or NTS)
tests/TestSerial PASS NA
tests/TestSimComm PASS NA
tests/TestSimTimer PASS NA
tests/tosthreads/apps FAIL FAIL No unsafe apps work. Safe fails on 
/tmp/ccchqUUK.o: In function `ThreadSleepP$ThreadSleep$sleep':
cil-eXmx1N94.cil.c:(.text+0x8bc): undefined reference to `__deputy_memset'
cil-eXmx1N94.cil.c:(.text+0x8cc): undefined reference to `__deputy_memset'
tests/tosthreads/capps FAIL FAIL All apps except TestCollection and TestLogStorage work in unsafe. Safe fails on 
/tmp/ccSQd3PE.o: In function `tosthread_sleep':
cil-VrbO6t7r.cil.c:(.text+0xc20): undefined reference to `__deputy_memset'
cil-VrbO6t7r.cil.c:(.text+0xc30): undefined reference to `__deputy_memset'

eyesIFX

App Standard Safe Notes
AntiTheft FAIL FAIL platform not supported
BaseStation PASS PASS too many bad packets over the serial line
Blink PASS PASS
Null PASS PASS
Oscilloscope PASS FAILsafe: starts toggling LED0 after a few seconds
Powerup PASS PASS
RadioCountToLeds PASS FAIL "safe": leds stay off (packets are not sent?)
RadioSenseToLeds PASS FAIL "safe": leds stay off (packets are not sent?)
tests/cc2420 FAILFAIL not applicable
tests/deluge FAIL FAIL platform not supported
tests/storage PASS FAIL

tests/storage/CircularLog:

"safe": FAIL (seems to cycle after ~ 60sec with LED1 toggling)


tests/storage/Config

warnings:

  /home/hanjo/tos/tinyos-2.x/tos/chips/at45db/ConfigStorageP.nc: In

  function `ConfigStorageP$ConfigStorage$commit':

  /home/hanjo/tos/tinyos-2.x/tos/chips/at45db/ConfigStorageP.nc:285:

  warning: assignment from incompatible pointer type
tests/TestAdc PASS FAIL "safe": LED2 is not turned on
tests/TestArbiter PASS PASS
tests/TestFTSP FAIL FAIL platform not supported
tests/TestLPL FAIL FAIL platform not supported
tests/TestPrintf PASS PASS

warnings:

      /home/hanjo/tos/tinyos-2.x/tos/interfaces/Queue.nc: In

      function `PrintfP$Queue$dequeue':

     /home/hanjo/tos/tinyos-2.x/tos/interfaces/Queue.nc:81: warning:

      passing arg 1 of `CNonNull' makes pointer from integer without a cast
tests/TestSerial FAIL FAIL The SF reports to have sent the packets from the host to the mote, but no LEDs are toggled
tests/TestSimComm FAIL FAIL platform not supported
tests/TestSimTimer FAIL FAIL platform not supported
tests/tosthreads/apps FAIL FAIL error: BlinkC.nc:39: interface Thread not found
tests/tosthreads/capps FAIL FAIL error: msp430-gcc: .nc: No such file or directory

telos (Kevin Klues & David Moss)

App Standard Safe Notes
AntiTheft FAIL FAIL platform not supported
BaseStation PASS ?
Blink PASS ?
Oscilloscope ? ?
Powerup ? ?
RadioCountToLeds ? ?
RadioSenseToLeds ? ?
tests/cc2420/LplBroadcastCountToLeds ? ?
tests/cc2420/LplBroadcastPeriodicDelivery ? ?
tests/cc2420/LplUnicastPeriodicDelivery ? ?
tests/cc2420/RssiToSerial ? ?
tests/cc2420/TestAcks ? ?
tests/cc2420/TestPacketLink ? ?
tests/cc2420/TxThroughput ? ?
tests/deluge/SerialBlink ? ?
tests/deluge/GoldenImage ? ?
tests/deluge/Blink ? ?
tests/storage/SyncLog ? ?
tests/storage/Log ? ?
tests/storage/Config ? ?
tests/storage/CircularLog ? ?
tests/storage/Block ? ?
tests/TestAdc ? ?
tests/arbiters/TestFcfsArbiter ? ?
tests/arbiters/TestRoundRobinArbiter ? ?
tests/TestFTSP ? ?
tests/TestLPL ? ?
tests/TestPrintf ? ?
tests/TestSerial ? ?
tests/TestSimComm ? ?
tests/TestSimTimer ? ?
tosthreads/apps/Blink Pass ?
tosthreads/apps/BaseStation PASS ?
tosthreads/apps/Bounce PASS ?
tosthreads/apps/RadioStress PASS ?
tosthreads/apps/TestBlockStorage PASS ?
tosthreads/apps/TestCollection PASS ? README needs to be fixed for the correct serialforwarder rate (57600 for telosb with threads)
tosthreads/apps/TestPrintf PASS ?
tosthreads/apps/TestSineSensor PASS ?

apps/tests/tkn154/TestASSOCIATE

Pass

apps/tests/tkn154/TestDATA

Pass

apps/tests/tkn154/TestINDIRECT

Pass

apps/tests/tkn154/TestPROMISCUOUS

Pass README needs fixing: In README: the following lines: 

  $ cd $TOSDIR/../apps/tests/TestPrintf
  $ make telosb
  $ java PrintfClient -comm serial@/dev/ttyUSBXXX:telosb

should be replaced with: 

  $ java net.tinyos.tools.PrintfClient -comm serial@/dev/ttyUSB0:telosb

apps/tests/tkn154/TestSTARTSYNC

Pass

tosthreads/capps/Blink

Pass

tosthreads/capps/BaseStation

Pass

tosthreads/capps/Bounce

Pass

tosthreads/capps/Null

Pass

tosthreads/capps/RadioStress

Pass

tosthreads/capps/SenseAndSend

Pass

tosthreads/capps/SenseStoreAndForward

Pass

tosthreads/capps/TestCollection

Pass README needs to be fixed for the correct serialforwarder rate (57600 for telosb with threads)

tosthreads/capps/TestLogStorage

Pass

tosthreads/capps/TestPrintf

Pass

tosthreads/capps/TestSineSensor

Pass

tosthreads/capps/ThreadStress

Pass


TestNetwork

The simulation script (test.py) is not working - the nodes never find a route. You might want to customize this if TestNetwork is a part of the upcoming Collection simulation tutorial.

MultihopOscilloscope

When I try to run it, I am getting this error: receive error for OscilloscopeMsg (AM type 147): invalid length message received (too short). I poked around a bit but not being too familiar with the java toolchain I was not able to debug it in 15 mins. I am thinking this might be something similar for someone familiar with Java.

App Code

RadioCountToLeds: PASS RadioSenseToLeds: PASS TestSimComm: PASS, added script

TestPowerup - Complies with the naming conventions in TEP3. - Added a README.txt

TestPrintf - Complies with the naming conventions in TEP3. - Added a README.txt, updated source code documentation.

TestSerial - Complies with the naming conventions in TEP3. - Changed AM id to comply with TEP4. - README.txt is present and adequately describes the operation.


shimmer (Konrad Lorincz & Vlado Handziski)

App Standard Safe Notes
AntiTheft FAIL FAIL platform not supported
BaseStation PASS PASS
Blink PASS PASS
Oscilloscope PASS PASS
Powerup PASS PASS
RadioCountToLeds PASS PASS
RadioSenseToLeds PASS PASS
tests/cc2420/LplBroadcastCountToLeds PASS PASS
tests/cc2420/LplBroadcastPeriodicDelivery PASS PASS
tests/cc2420/LplUnicastPeriodicDelivery PASS PASS
tests/cc2420/RssiToSerial PASS PASS
tests/cc2420/TestAcks PASS PASS
tests/cc2420/TestPacketLink PASS PASS
tests/cc2420/TxThroughput PASS PASS
tests/deluge FAIL FAIL N/A (currently not supported on shimmer which uses SD with another interface)
tests/storage FAIL FAIL N/A (currently not supported on shimmer which uses SD with another interface)
tests/TestAdc PASS PASS
tests/arbiters/TestFcfsArbiter PASS PASS
tests/arbiters/TestRoundRobinArbiter PASS PASS
tests/TestFTSP PASS PASS
tests/TestLPL PASS PASS
tests/TestPrintf PASS PASS
tests/TestSerial PASS PASS
tests/TestSimComm FAIL FAIL platform not supported
tests/TestSimTimer FAIL FAIL platform not supported
tosthreads FAIL FAIL platform not supported
Retrieved from "http://tinyos.stanford.edu/tinyos-wiki/index.php?title=Testing:2.1&oldid=1396"