• Influence on Listener Kappa 0.35, PA 0.66
  • Influence on Speaker Kappa 0.42, PA 0.68
  • Abandoned Kappa 0.39, PA 0.97, Kappa significance .1
  • Agreement Kappa 0.46, PA 0.72
  • Answer Kappa 0.37, PA 0.78
  • Conventional Kappa 0.47, PA 0.96, Kappa significance .025
  • Exclamation Kappa 0.55, PA 0.98, Kappa significance .05
  • Performative Kappa insignificant
  • Info-level Kappa 0.49, PA 0.87
  • Other Forward Function Kappa 0.26, PA 0.94, Kappa significance .1
  • Response-to Kappa 0.48, PA 0.68
  • Self-talk Kappa Insignificant
  • Statement Kappa 0.34, PA 0.67
  • Understanding Kappa 0.15, PA 0.80
  • Unintelligible perfect
  • Info-request Kappa 0.584, PA 0.85

    Comments on Verbmobil Dialog R148C

    General Comments

    email mcore@cs.rochester.edu to add your comments.

    E's comments: do commits to AD for joint actions ("shall we meet then" "OK") count as AD again. I'm really confused about OO and AD, I think I'm going by surface form. also, problems with influence-on-L in question form . are they all IR?

    Editor's comments: I'd say that commits to AD for joint actions do not count as AD again. In general, we expect AD to be addressed since they are a command/ suggestion and it would be rude not to at least reject them somehow. But a dialog such as the one below is perfectly ok even though A doesn't accept the acceptance. utt4 doesn't even address the painting topic at all making it hard to claim it is an implicit accept. If I responded to a command such as "let's paint" by "is it my turn to cook tonight" it would be odd.

      utt1 A: shall we do the painting tommorrow?
      utt2 B: sure 
      utt3    I'll be around tommorrow
      utt4 A: is it my turn to cook tonight?

    All non-rhetorical questions should be information-requests since the speaker expects an answer ("information"). I can't think of an example otherwise but maybe someone can come up with one.

    Comments on Individual Utterances

      1     A: so 
      2        we should meet again 
      E - assert, not influence-on-L/S, because of  intonation and context
      A - would ordinarily call joint offer/open-option, except this is 
             experimental setting, so really just an opener.
      B - Picked open option and not assert because "I can't do that" sounds like 
            an ok response and "That's not true" sounds strange as a response.
      3       how 'bout 
      4       how 'bout next week 
      E - AD as per manual p 12
      A -jointly offering and asking commitment for that week
      5       what day are good for you 
      6       what days are good for you 
      E - tagged correct-missp. even if it's same speaker. what else can it be?
      A - assuming accept idea of meeting, asks a question
      7     B: actually next week I am on vacation 
      E - should it be tagged as indirect answer to utt6? btw, no way in dat to 
            specify two backward functions with different antecedents
      C - This utterance also provides an implicit answer to utt6
      8     A: gosh 
      9       I guess we will have to meet the week after that 
      E - does it count as an assert? seems to pass 'that's not true ' test. OO or AD?
      10       how 'bout Monday 
      E - as in utt4, AD, not OO. distinction between AD and OO difficult 
             to draw
      11     B: Monday the tenth 
      F - SNU (p 21 "Dansville, NY") Other-statement because check question.  
            I didn't want to mark Hold, (i thought SNUs weren't HOLDs)  
            but DAT required that i mark agreement. (bug?)
      E - SNU like 'Dansville, NY' in manual. could be 'Hold'?
      A -more signal need for confirmation than real nonunderstanding
      12     A: aha 
      B - answers are usually asserts
      A - not an assertion since it's a clarification of the offer/open-option
      13     B: well unfortunately my vacation runs through the fourteenth and I have 
               nonrefundable plane tickets 
      E - don't see why antecedent should be utt10 to 12, but really similar to ex p. 25
      14       I was planning on being on a beach in Acapulco about that 
      E - utt13-14 could be a segment that rejects utt10
      B - Should some of this be other level? Details are irrelevant to the task.
      15     A: well 
      16          when are you getting back 
      17     B: I get back on the fifteenth rest up on the sixteenth 
      18        which is a Sunday and I am back at work on the seventeenth 
      E - initially included 19-20 as part of answer to 15+16 but instead they
           address an indirect goal expressed by 16
      19       but I have a seminar all day 
      E - not captured that utt19 explains why utt18 doesn't count as proposal. 
             need info rel for that
      A -helpful answer (not strictly asked by question)
      20       I think the first day that is really good for me 
      E - utt20-utt21 together. def of AD and OO not really clear
      21         is the eighteenth that is a Tuesday 
      22     A: okay 
      E - AD because it's like "let's meet then". see comments on dialogue
      23       want to have lunch 
      E - not sure about IR. note difference from 'Can you pass me the salt', 
             where a verbal response is inappropriate, while here is required
      24     B: that sounds pretty good 
      E - again, problems with agreements to joint actions: does it count 
              as AD?
      25       are you available just before noon 
      26     A: we can meet at noon 
      A -reject "just before noon", propose "noon"
      M - previous proposal is for just before noon however I labeled it
      27     B: sounds good 
      E - usual problem with acceptances and AD
      28       on campus or off 
      A -=asking them to make an offer of one or the other
      29     A: your choice 
      B - answer but not assert
      M - not hold  just an answer
      30     B: I say if I have got enough money to go to Acapulco 
              I have got enough money to go to one of those silly places 
              on Craig street 
      B - Sounds off topic, but is actually choosing off campus.   The dia
      logue was recorded at CMU. Craig street is off campus.
      31       how about Great Scott 
      32     A: sounds great except they have been out of business for a while 
      B - Acknowledgements that are not accepts are usually communication 
      33       how about some other place 
      M - directive - we have to go somewhere else
      34       let us just wander up Craig 
      35       and pick one we like that day 
      36     B: that sounds pretty good 
      37       okay 
      B - If you listen to this, it sounds like a cue phrase, not like an 
            acknowledge or accept.
      A - filler trying to get him not to interrupt.
      38       I will meet you outside Cyert Hall
      E - utt38-39 together. is it AD? yes, if "meet"  is joint action. is
            it an assert? probably not
      39        at noon
      40       does that sound alright for you 
      E - it is not a check question, is it?
      41     A: see you then 
      E - usual problem with acceptance and AD
      B - Is this a closing?
      M - treat like "I will see you then" , constrained to answer
           and accept same thing. so can't answer 40 and accept 38+39.
           But maybe 38-40 is like a big check question.
      42     B: roger over and out 
      B - SU-Acknowledge for "roger" and Conventional Closing for "over and out".
      43     A: thought it was roger wilco 
      Z - Joke
      E - don't think 43-44 are task-man
      A - joke?  correcting B, not asking for info.
      M - correct misspeaking?
      44     B: oh no it is what we always say when we are talking 
              on screen 

    Last change: 05 May 98 by mcore

    Click here to send in comments or questions.

    Back to the Dialog Annotation Page