• kappa is 0.668457920080161
  • PA is 0.784275184275184
  • PE is 0.349329002891657
        3 HELLO
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said 
      annotator # 5 said 
      annotator # 6 said 
      annotator # 7 said 
      annotator # 8 said utt1 utt2
      annotator # 9 said 
      annotator # 10 said 
      
        4 Hi
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt3
      annotator # 4 said 
      annotator # 5 said 
      annotator # 6 said utt3
      annotator # 7 said 
      annotator # 8 said utt3
      annotator # 9 said 
      annotator # 10 said 
      
        6 Ok
      
      annotator # 0 said utt5
      annotator # 1 said utt5
      annotator # 2 said utt5
      annotator # 3 said utt5
      annotator # 4 said utt5
      annotator # 5 said utt5
      annotator # 6 said utt5
      annotator # 7 said utt5
      annotator # 8 said utt5
      annotator # 9 said 
      annotator # 10 said utt5
      
        8 I'm afraid I didn't understand you.
      
      annotator # 0 said utt7
      annotator # 1 said utt7
      annotator # 2 said utt7
      annotator # 3 said utt7
      annotator # 4 said utt7
      annotator # 5 said utt7
      annotator # 6 said utt7
      annotator # 7 said utt7
      annotator # 8 said utt7
      annotator # 9 said 
      annotator # 10 said utt7
      
        9 WHERE ARE THE PEOPLE
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt8
      annotator # 4 said 
      annotator # 5 said 
      annotator # 6 said utt8
      annotator # 7 said utt8
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       10 There are 2 groups-of-people at Exodus, 2 at Calypso, 2 at
      Barnacle and 1 at Abyss
      
      annotator # 0 said utt9
      annotator # 1 said utt9
      annotator # 2 said utt9
      annotator # 3 said utt9
      annotator # 4 said utt9
      annotator # 5 said utt9
      annotator # 6 said utt9
      annotator # 7 said utt9
      annotator # 8 said utt9
      annotator # 9 said 
      annotator # 10 said utt9
      
       12 There are 2 trucks and 1 helicopter at Delta
      
      annotator # 0 said utt11
      annotator # 1 said utt11
      annotator # 2 said utt11
      annotator # 3 said utt11
      annotator # 4 said utt11
      annotator # 5 said utt11
      annotator # 6 said utt11
      annotator # 7 said utt11
      annotator # 8 said utt11
      annotator # 9 said 
      annotator # 10 said utt11
      
       13 USE A TRUCK [missed: TO] GET THE PEOPLE FROM CALYPSO
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt12
      annotator # 5 said 
      annotator # 6 said 
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       15 Ok
      
      annotator # 0 said utt13 utt14
      annotator # 1 said utt13 utt14
      annotator # 2 said utt13 utt14
      annotator # 3 said utt13 utt14
      annotator # 4 said utt13 utt14
      annotator # 5 said utt13 utt14
      annotator # 6 said utt13 utt14
      annotator # 7 said 
      annotator # 8 said utt13 utt14
      annotator # 9 said 
      annotator # 10 said utt13 utt14
      
       17 I'm afraid I didn't understand you.
      
      annotator # 0 said utt16
      annotator # 1 said utt16
      annotator # 2 said utt16
      annotator # 3 said utt16
      annotator # 4 said utt16
      annotator # 5 said utt16
      annotator # 6 said utt16
      annotator # 7 said utt16
      annotator # 8 said utt16
      annotator # 9 said 
      annotator # 10 said utt16
      
       18 HOW_LONG
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt17
      annotator # 4 said utt17
      annotator # 5 said 
      annotator # 6 said utt17
      annotator # 7 said utt17
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       19 WILL THAT TAKE
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt17
      annotator # 4 said 
      annotator # 5 said 
      annotator # 6 said utt17
      annotator # 7 said utt17
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       20 It will take 6 hours and 54 minutes
      
      annotator # 0 said utt18 utt19
      annotator # 1 said utt18 utt19
      annotator # 2 said utt18 utt19
      annotator # 3 said utt18 utt19
      annotator # 4 said 
      annotator # 5 said utt18 utt19
      annotator # 6 said utt18 utt19
      annotator # 7 said utt18 utt19
      annotator # 8 said utt18 utt19
      annotator # 9 said 
      annotator # 10 said utt18 utt19
      
       22 I'm sorry, but that input didn't make sense to me.
      
      annotator # 0 said utt21
      annotator # 1 said utt21
      annotator # 2 said utt21
      annotator # 3 said utt21
      annotator # 4 said utt21
      annotator # 5 said utt21
      annotator # 6 said utt21
      annotator # 7 said utt21
      annotator # 8 said utt21
      annotator # 9 said 
      annotator # 10 said utt21
      
       23 WHAT IF WE WENT ALONG THE COAST INSTEAD
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt22
      annotator # 4 said utt22
      annotator # 5 said 
      annotator # 6 said utt22
      annotator # 7 said utt22
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       24 That option would take 8 hours and 52 minutes
      
      annotator # 0 said utt23
      annotator # 1 said utt23
      annotator # 2 said utt23
      annotator # 3 said utt23
      annotator # 4 said utt24
      annotator # 5 said utt23
      annotator # 6 said utt23
      annotator # 7 said utt23
      annotator # 8 said utt23
      annotator # 9 said 
      annotator # 10 said utt23
      
       25 I [I mistakenly inserted] FORGET IT
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt24
      annotator # 5 said utt23
      annotator # 6 said utt23
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       26 Ok
      
      annotator # 0 said utt25
      annotator # 1 said utt25
      annotator # 2 said utt25
      annotator # 3 said utt25
      annotator # 4 said utt25
      annotator # 5 said utt25
      annotator # 6 said utt25
      annotator # 7 said utt25
      annotator # 8 said utt25
      annotator # 9 said 
      annotator # 10 said utt25
      
       28 Ok
      
      annotator # 0 said utt27
      annotator # 1 said utt27
      annotator # 2 said utt27
      annotator # 3 said utt27
      annotator # 4 said utt27
      annotator # 5 said utt27
      annotator # 6 said utt27
      annotator # 7 said utt27
      annotator # 8 said utt27
      annotator # 9 said 
      annotator # 10 said utt27
      
       29 LET'S USE A HELICOPTER INSTEAD
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said 
      annotator # 5 said 
      annotator # 6 said utt27
      annotator # 7 said 
      annotator # 8 said utt27
      annotator # 9 said 
      annotator # 10 said 
      
       30 Alright
      
      annotator # 0 said utt29
      annotator # 1 said utt29
      annotator # 2 said utt29
      annotator # 3 said utt29
      annotator # 4 said utt29
      annotator # 5 said utt29
      annotator # 6 said utt29
      annotator # 7 said utt29
      annotator # 8 said utt29
      annotator # 9 said 
      annotator # 10 said utt29
      
       33 I'll get right on it
      
      annotator # 0 said utt31
      annotator # 1 said utt31 utt32
      annotator # 2 said utt31 utt32
      annotator # 3 said utt31 utt32
      annotator # 4 said utt31 utt32
      annotator # 5 said utt31 utt32
      annotator # 6 said utt31 utt32
      annotator # 7 said utt31 utt32
      annotator # 8 said utt31 utt32
      annotator # 9 said 
      annotator # 10 said utt31 utt32
      
       35 Ok
      
      annotator # 0 said utt34
      annotator # 1 said utt34
      annotator # 2 said utt34
      annotator # 3 said utt34
      annotator # 4 said utt34
      annotator # 5 said utt34
      annotator # 6 said utt34
      annotator # 7 said utt34
      annotator # 8 said utt34
      annotator # 9 said 
      annotator # 10 said utt34
      
       37 Your wish is my command
      
      annotator # 0 said utt36
      annotator # 1 said utt36
      annotator # 2 said utt36
      annotator # 3 said utt36
      annotator # 4 said utt37
      annotator # 5 said utt36
      annotator # 6 said utt36
      annotator # 7 said utt36
      annotator # 8 said utt36
      annotator # 9 said 
      annotator # 10 said utt36
      
       39 Alright
      
      annotator # 0 said utt38
      annotator # 1 said utt38
      annotator # 2 said utt38
      annotator # 3 said utt38
      annotator # 4 said utt38
      annotator # 5 said utt38
      annotator # 6 said utt38
      annotator # 7 said utt38
      annotator # 8 said utt38
      annotator # 9 said 
      annotator # 10 said utt38
      
       40 THAT LOOKS GOOD
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt39
      annotator # 5 said 
      annotator # 6 said 
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       41 No problem
      
      annotator # 0 said utt40
      annotator # 1 said utt40
      annotator # 2 said utt40
      annotator # 3 said utt40
      annotator # 4 said utt40
      annotator # 5 said utt40
      annotator # 6 said utt40
      annotator # 7 said utt40
      annotator # 8 said utt40
      annotator # 9 said 
      annotator # 10 said utt40
      
       43 The highlighted actions may need to be revised.
      
      annotator # 0 said utt42
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt42
      annotator # 4 said utt42
      annotator # 5 said 
      annotator # 6 said utt42
      annotator # 7 said 
      annotator # 8 said utt42
      annotator # 9 said 
      annotator # 10 said 
      
       44 Ok
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt43
      annotator # 5 said utt42
      annotator # 6 said utt42
      annotator # 7 said utt42
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said utt42
      
       45 SEND_A [A mistakenly inserted] TRUCK TWO
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt38
      annotator # 5 said 
      annotator # 6 said 
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       46 ALONG THE COAST INSTEAD
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt38
      annotator # 5 said 
      annotator # 6 said 
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       47 Sorry, I don't know how to do that.
      
      annotator # 0 said utt45 utt46
      annotator # 1 said utt45 utt46
      annotator # 2 said utt45 utt46
      annotator # 3 said utt45 utt46
      annotator # 4 said utt45 utt46
      annotator # 5 said utt45 utt46
      annotator # 6 said utt45 utt46
      annotator # 7 said utt45 utt46
      annotator # 8 said utt45 utt46
      annotator # 9 said 
      annotator # 10 said utt45 utt46
      
       48 SEND TRUCK TWO
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt47
      annotator # 4 said utt47
      annotator # 5 said 
      annotator # 6 said utt47
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       49 ALONG THE COAST INSTEAD
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt47
      annotator # 4 said utt47
      annotator # 5 said 
      annotator # 6 said utt47
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       50 Done
      
      annotator # 0 said utt48 utt49
      annotator # 1 said utt48 utt49
      annotator # 2 said utt48 utt49
      annotator # 3 said utt48 utt49
      annotator # 4 said utt48 utt49
      annotator # 5 said utt48 utt49
      annotator # 6 said 
      annotator # 7 said utt48 utt49
      annotator # 8 said utt48 utt49
      annotator # 9 said 
      annotator # 10 said utt48 utt49
      
       51 HAVE THE OTHER TRUCK STOP AT SOUTH_DELTA INSTEAD
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt47
      annotator # 5 said 
      annotator # 6 said 
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       52 Alright
      
      annotator # 0 said utt51
      annotator # 1 said utt51
      annotator # 2 said utt51
      annotator # 3 said utt51
      annotator # 4 said utt51
      annotator # 5 said utt51
      annotator # 6 said utt51
      annotator # 7 said utt51
      annotator # 8 said utt51
      annotator # 9 said 
      annotator # 10 said utt51
      
       54 Pardon me?
      
      annotator # 0 said utt53
      annotator # 1 said utt53
      annotator # 2 said utt53
      annotator # 3 said utt53
      annotator # 4 said utt53
      annotator # 5 said utt53
      annotator # 6 said utt53
      annotator # 7 said utt53
      annotator # 8 said utt53
      annotator # 9 said 
      annotator # 10 said utt53
      
       55 UNLOAD
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt54
      annotator # 4 said utt54
      annotator # 5 said 
      annotator # 6 said utt54
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       56 THE PEOPLE
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt54
      annotator # 4 said 
      annotator # 5 said 
      annotator # 6 said utt54
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       57 Fine
      
      annotator # 0 said utt56
      annotator # 1 said utt55 utt56
      annotator # 2 said utt55 utt56
      annotator # 3 said utt55 utt56
      annotator # 4 said utt55 utt56
      annotator # 5 said utt55 utt56
      annotator # 6 said utt55 utt56
      annotator # 7 said utt55 utt56
      annotator # 8 said utt55 utt56
      annotator # 9 said 
      annotator # 10 said utt55 utt56
      
       59 Alright
      
      annotator # 0 said utt58
      annotator # 1 said utt58
      annotator # 2 said utt58
      annotator # 3 said utt58
      annotator # 4 said utt58
      annotator # 5 said utt58
      annotator # 6 said utt58
      annotator # 7 said utt59
      annotator # 8 said utt58
      annotator # 9 said 
      annotator # 10 said utt58
      
       62 I don't understand your reference to the people left
      
      annotator # 0 said utt60
      annotator # 1 said utt60 utt61
      annotator # 2 said utt60 utt61
      annotator # 3 said utt60 utt61
      annotator # 4 said utt60 utt61
      annotator # 5 said utt60 utt61
      annotator # 6 said utt60 utt61
      annotator # 7 said utt60 utt61
      annotator # 8 said utt61
      annotator # 9 said 
      annotator # 10 said utt60 utt61
      
       63 WHERE ARE THE PEOPLE
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt62
      annotator # 4 said utt62
      annotator # 5 said 
      annotator # 6 said utt62
      annotator # 7 said utt62
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       64 There are 2 groups-of-people at Delta
      
      annotator # 0 said utt63
      annotator # 1 said utt63
      annotator # 2 said utt63
      annotator # 3 said utt63
      annotator # 4 said utt63
      annotator # 5 said utt63
      annotator # 6 said utt63
      annotator # 7 said utt63
      annotator # 8 said utt63
      annotator # 9 said 
      annotator # 10 said utt63
      
       65 WHERE ARE ALL THE PEOPLE
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt64
      annotator # 5 said 
      annotator # 6 said 
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       66 There are 6 groups-of-people at Delta and 1 at South Delta
      
      annotator # 0 said utt65
      annotator # 1 said utt65
      annotator # 2 said utt65
      annotator # 3 said utt65
      annotator # 4 said utt65
      annotator # 5 said utt65
      annotator # 6 said utt65
      annotator # 7 said utt65
      annotator # 8 said utt65
      annotator # 9 said 
      annotator # 10 said utt65
      
       69 There are no people at South Delta
      
      annotator # 0 said utt68
      annotator # 1 said utt67 utt68
      annotator # 2 said utt68
      annotator # 3 said utt67 utt68
      annotator # 4 said 
      annotator # 5 said utt67 utt68
      annotator # 6 said utt67 utt68
      annotator # 7 said utt67 utt68
      annotator # 8 said utt67 utt68
      annotator # 9 said 
      annotator # 10 said utt67 utt68
      
       70 USE THE HELICOPTER TO GET THE PEOPLE AT SOUTH_DELTA TO DELTA
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said 
      annotator # 4 said utt69
      annotator # 5 said 
      annotator # 6 said 
      annotator # 7 said 
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       71 Your wish is my command
      
      annotator # 0 said utt70
      annotator # 1 said utt70
      annotator # 2 said utt70
      annotator # 3 said utt70
      annotator # 4 said 
      annotator # 5 said utt70
      annotator # 6 said utt70
      annotator # 7 said utt70
      annotator # 8 said utt70
      annotator # 9 said 
      annotator # 10 said utt70
      
       73 Simulation succeeded in 94 percent of 250 runs.
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt72
      annotator # 4 said 
      annotator # 5 said 
      annotator # 6 said utt72
      annotator # 7 said utt72
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
       74 7 percent of the plan failure points were a move action with truck
      two resulting in a breakdown.
      
      annotator # 0 said 
      annotator # 1 said 
      annotator # 2 said 
      annotator # 3 said utt72
      annotator # 4 said 
      annotator # 5 said 
      annotator # 6 said utt72
      annotator # 7 said utt72
      annotator # 8 said 
      annotator # 9 said 
      annotator # 10 said 
      
      k 11 and N 74
      PJ^3 is 4.0047972724898e-07 vark is -0.00114283392466578 z is 19.7734527931327
      sig is .000005 or greater
      kappa is 0.668457920080161
      PA is 0.784275184275184
      PE is 0.349329002891657