| Question | First Sentence | Second Sentence |
| r001 | DATE: NUM1 are killed and around NUM2 injured when suicide bomber blows up his explosive-packed belt at X1 in X2. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 and wounding NUM2 police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | s2 can replace s1 if we assume all suicide bombers are palestinian |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r002 | - DATE: bombing at X1 in X2 kills NUM1 israelis and leaves NUM2. | suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 and wounding more than NUM2, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s1 can replace s2 (if 'leaves' means 'injures') |
| Judge2 | n | n | probably a typo in sentence 1 |
| Judge3 | n | y | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r003 | X1, militia group linked to X2 movement, claimed responsibility for attack. | X1, group linked to X2 movement, claimed responsibility for attack and said it was in revenge for assaults by israeli forces. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | y | "Group" in s2 not necessarily a militia group |
| Judge2 | y | n | |
| Judge3 | n | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r004 | - DATE: bombing at X1 in X2 kills NUM1 israelis and leaves NUM2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding NUM2, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | "leaves NUM2" is a bit obscure: could be interpreted as NUM2 uninjured. I assume it means injured because otherwise they wouldn't have been mentioned. |
| Judge2 | y | y | I think the first sentence should say "... and leaves NUM2 wounded/injured" |
| Judge3 | n | y | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r005 | militant group X1 claims responsibility for attack. | militant Islamic group X1 claimed responsibility for attack. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s1 replaces s2 |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r006 | - DATE: NUM1 people are killed, including bomber, in attack in X1. | police spokeswoman said NUM1 people were killed by bomber at X1 attack on DATE |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | n | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r007 | suicide bomber blew himself up DATE at X1 in X2, killing NUM1 people and injuring NUM2, police said. | suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding more than NUM2, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s1 can replace s2 |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r008 | DATE - palestinian suicide bomber killed NUM1 people and injured NUM2 people when he blew himself up at X1 in northern X2. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 people and wounding NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r009 | - DATE: bomb in X1 kills NUM1 people. | police spokeswoman said NUM1 people were killed by bomber at X1 attack on DATE |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r010 | NUM1 people were injured. | NUM1 people were wounded. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r011 | - DATE: suicide bomb on X1 kills NUM1 people. | police spokeswoman said NUM1 people were killed by bomber at X1 attack on DATE |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | y | My previous answers didn't worry about the "spokeswoman" specificity, but maybe I'll have to go back and correct that |
| Judge2 | y | n | |
| Judge3 | y | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r012 | X1 condemned bombing attacks. | X1 condemned suicide bombing. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r013 | DATE - palestinian suicide bomber killed NUM1 people and injured NUM2 people when he blew himself up at X1 in northern X2. | palestinian suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r014 | X1 identified bomber as X2, NUM1, from West Bank town of X3. | X1 named bomber as NUM1-year-old X2 from West Bank refugee camp near X3. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | y | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r015 | X1, militia linked to X2 movement, claimed responsibility. | X1, group linked to X2 movement, claimed responsibility for attack and said it was in revenge for assaults by israeli forces on palestinian cities. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | y | s2's 'group' might not have been a militia so s1 can't replace s2 |
| Judge2 | y | y | |
| Judge3 | n | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r016 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, including NUM2 palestinians and NUM3 israelis. | At least NUM1 israelis and NUM2 palestinians have been killed since palestinian uprising against israeli occupation in the West Bank and Gaza Strip began in September 2000. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | Num1, NUM2 not consistent in s1 and s2 |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r017 | X1 said it condemned attacks. | X1 condemned suicide bombing. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r018 | X1 identified suicide bomber as X2, NUM1, from West Bank town of X3. | X1 named bomber as NUM1-year-old X2 from West Bank refugee camp near X3. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | s1 can't replace s2 because not all bombers are suicide bombers, and s2 can't replace s1 because not all people from West Bank town of X3 live in the refugee camp there |
| Judge2 | y | n | |
| Judge3 | y | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r019 | DATE: NUM1 are killed and NUM2 wounded when suicide bomber blows up his explosive-packed belt at X1 in X2. | suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r020 | X1 claims responsibility for attack. | militant Islamic group X1 claimed responsibility for attack saying it was " a slap in the faces of the criminals of the Zionist war. " |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | n | n | |
| Judge4 | y | y |
| Question | First Sentence | Second Sentence |
| r021 | - DATE: suicide bomb in X1 kills NUM1 people. | police spokeswoman said NUM1 people were killed by bomber at X1 attack on DATE |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | y | problem with replacing s1 by s2 if spokeswoman is too specific |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r022 | - DATE: bombing at X1 in X2 kills NUM1 people and wounds NUM2. | palestinian suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r023 | latest violence bring to NUM1 number of people killed as a direct result of the palestinian, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed since palestinian uprising against israeli occupation began in September 2000 after peace talks stalled. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | NUM1, NUM2 used inconsistently in s1 and s2 |
| Judge2 | n | n | |
| Judge3 | n | y | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r024 | - DATE: bombing at X1 in X2 kills NUM1 israelis and wounds NUM2 others. | suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | s1 can replace s2 if we assume victims of suicide bombings are always Israeli |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r025 | More than NUM1 people were injured. | NUM1 people were wounded. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s2 can replace s1 |
| Judge2 | y | n | |
| Judge3 | y | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r026 | - DATE: bomb attack at X1 in X2 kills NUM1 israelis and wounds NUM2. | suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 and wounding NUM2, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | s1 can repace s2 if we assume victims of suicide bombing are always Israeli |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r027 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 people when he blew himself up at X1 in northern X2. | suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r028 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have died since after peace talks froze. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | NUM1, NUM2 not used consistently across s1,s2 |
| Judge2 | y | n | |
| Judge3 | n | y | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r029 | - DATE: suicide bomber blows himself up and kills NUM1 others on bus in northern israeli town of X1. | DATE: police spokeswoman put death toll of X1 attack at NUM1. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | y | |
| Judge3 | n | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r030 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, or uprising, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed since palestinian uprising against israeli occupation erupted in September 2000. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | variables NUM1, NUM2 don't agree across s1 and s2 |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r031 | DATE: NUM1 are killed and NUM2 injured when suicide bomber blows up his explosive-packed belt at X1 in X2. | suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r032 | latest violence bring to NUM1 number of people killed as a direct result of the palestinian intifada, or uprising, including NUM2 palestinians and NUM3 israelis. | At least NUM1 israelis and NUM2 palestinians have been killed since palestinian uprising began in September 2000 after peace talks stalled. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | NUM1, NUM2 not consistent across s1 and s2 |
| Judge2 | y | y | |
| Judge3 | y | y | should be "latest violence brings" not "bring" in sentence 1, but I'm assuming, rightly or wrongly, that you don't care |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r033 | At least NUM1 people were injured. | NUM1 people were hurt. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r034 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 people when he blew himself up at X1 in northern X2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 people and wounding NUM2, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s2 can replace s1 |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r035 | - DATE: bomb attack at X1 in X2 kills NUM1 people and wounds NUM2. | palestinian suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 on DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r036 | NUM1 people were wounded. | NUM1 people were injured. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r037 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed since palestinian uprising against israeli occupation erupted in September 2000. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | NUM1, NUM2 not consistent across s1,s2 |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r038 | More than NUM1 people were injured. | NUM1 people were injured. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s2 can replace s1 |
| Judge2 | y | n | |
| Judge3 | y | y | |
| Judge4 | y | y | not sure - this sounds like the second guideline, the "at least" case |
| Question | First Sentence | Second Sentence |
| r039 | X1, linked to X2 movement, claimed responsibility. | X1, group linked to X2 movement, claimed responsibility for attack and said it was in revenge army raids on Palestinian refugee camps and other targets in the West Bank and Gaza Strip. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | Had to decide if motive was criticial to meaning |
| Judge2 | y | n | |
| Judge3 | n | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r040 | NUM1 people were injured, NUM2 seriously. | Officials said at least NUM1 were wounded, NUM2 of them seriously. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r041 | palestinian suicide bomber blew himself up DATE at X1 in X2, killing NUM1 people and injuring NUM2, police said. | suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | 'ddd' is probably a typo for DATE |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r042 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, or uprising, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed since palestinian uprising against israeli occupation began in September 2000. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | NUM1, NUM2 not consistent across s1,s2 |
| Judge2 | y | n | |
| Judge3 | y | n | I'm assuming that the value of NUM1 is not constant between the two sentence pairs; rather, each first number mentioned in the sentence will be designated as NUM1; if this is not the case, my answer would be no for this one. |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r043 | More than NUM1 people were injured. | NUM1 people were hurt. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s2 can replace s1 |
| Judge2 | y | n | |
| Judge3 | y | y | Generally, I've been noticing, that the shorter the sentence, the more salient differences in information become, so that for this example, I put Yes, Yes, but for the long sentences in which there is a whole narrative about Israelis blowing up Palestinians or vice-versa, even where one says NUM1 people were wounded and the other says more than NUM1 people were wounded, I've been putting Yes, No, because the difference is slight in comparison with the overall meaning of the sentences. |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r044 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 when he blew himself up at X1 in northern X2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 people and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | y | s1 could replace s2 if it didn't say 'northern'; s2 could replace s1 if it didn't say 'more than' |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r045 | DATE: NUM1 are killed and NUM2 wounded when suicide bomber blows up his explosive-packed belt at X1 in X2. | palestinian suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 on DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | s1 can't replace s2 because too specific, so have to allow s2 to replace s1, and that means we have to assume that suicide bomber is synonymous with Palestinian suicide bomber |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r046 | X1, armed group linked to X2 movement, claimed responsibility. | X1, group linked to X2 movement, claimed responsibility for attack and said it was in revenge for army raids on Palestinian refugee camps and other targets in the West Bank and Gaza Strip. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | Had to decide if motive was critical to meaning; I accepted 'armed' as reasonable because the group did carry out an attack so they must have been armed |
| Judge2 | y | n | |
| Judge3 | n | y | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r047 | suicide bomber blew himself up on DATE at X1 in X2, killing NUM1 people and injuring NUM2, police said. | suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r048 | latest violence bring to NUM1 number of people killed as a direct result of the palestinian, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed since palestinian uprising against israeli occupation began in September 2000. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | |
| Judge2 | y | n | |
| Judge3 | n | y | I'm not sure whether this is deliberate or not, but in some of the previous examples, sentence one said "palestinian intifada"; if that had been the case here, I would have said that the sentences are the same; however, as sentence 1 stands, it does not even make sense grammatically (i.e., as a direct result of the palestinian what?) |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r049 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, including NUM2 palestinians and NUM3 israelis. | At least NUM1 israelis and NUM2 palestinians have been killed since palestinian uprising began in September 2000. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | NUM1, NUM2 not consistent across s1,s2 |
| Judge2 | y | n | |
| Judge3 | y | n | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r050 | latest violence bring to NUM1 number of people killed as a direct result of the palestinian, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed since palestinian uprising against israeli occupation erupted in September 2000. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | NUM1, NUM2 not used consistently across s1,s2 |
| Judge2 | y | y | I think the first sentence should say "... the palestinian uprising, ...", not "... the palestinian, ..." |
| Judge3 | n | y | |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r051 | DATE - palestinian suicide bomber killed NUM1 people and injured NUM2 people when he blew himself up at X1 in northern X2. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 people and wounding NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r052 | - DATE: NUM1 people are killed, including bomber, in attack in X1. | DATE: police spokeswoman put death toll of X1 attack at NUM1. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r053 | DATE: NUM1 are killed and NUM2 wounded when suicide bomber blows up himself at X1 in X2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | n |
| Question | First Sentence | Second Sentence |
| r054 | palestinian suicide bomber blew himself up DATE at X1 in X2, killing NUM1 people and injuring NUM2, police said. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s1 can replace s2 |
| Question | First Sentence | Second Sentence |
| r055 | X1, militia group linked to X2 movement, claimed responsibility. | armed group linked to X2 faction, X1, said it carried out X3 attack. |
| Question | First Sentence | Second Sentence |
| r056 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 people when he blew himself up at X1 in northern X2. | palestinian suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r057 | At least NUM1 people were wounded. | NUM1 people were injured. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r058 | - DATE: bombing at X1 in X2 kills NUM1 people and leaves NUM2. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 people and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | n | y |
| Question | First Sentence | Second Sentence |
| r059 | attack was claimed by radical offshoot of X1. | militant Islamic group X1 claimed responsibility for attack saying it was " a slap in the faces of the criminals of the Zionist war. " |
| Name | Matching? | Difficult? | Comment |
| Judge1 | n | n | s2 details too specific to allow replacing s1; s1 'radical offshoot' too specific for replacing s2 |
| Question | First Sentence | Second Sentence |
| r060 | X1 identified assailant as X2, NUM1, from West Bank town of X3. | X1 named bomber as NUM1-year-old X2 from West Bank refugee camp in X3. |
| Question | First Sentence | Second Sentence |
| r061 | attack was claimed by armed wing of X1. | militant Islamic group X1 claimed responsibility for attack. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r062 | DATE: NUM1 are killed and NUM2 injured when suicide bomber blows up his explosive-packed belt at X1 in X2. | suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 on DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r063 | X1, armed group linked to X2 movement, claimed responsibility for attack. | X1, group linked to X2 movement, claimed responsibility for attack and said it was in revenge army raids on Palestinian refugee camps and other targets in the West Bank and Gaza Strip. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | n | n |
| Question | First Sentence | Second Sentence |
| r064 | NUM1 people were injured, NUM2 of them seriously. | Officials said more than NUM1 were wounded, NUM2 seriously. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n | s1 can replace s2 |
| Question | First Sentence | Second Sentence |
| r065 | NUM1 were hurt, NUM2 seriously. | Officials said at least NUM1 were wounded, NUM2 of them seriously. |
| Question | First Sentence | Second Sentence |
| r066 | suicide bomber blew himself up on DATE at X1 in X2, killing NUM1 people and injuring NUM2, police said. | suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 on DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r067 | - DATE: suicide bomb attack at X1 in X2 kills NUM1 people and injures NUM2 others. | suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 on DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r068 | - DATE: bomb attack at X1 in X2 kills NUM1 israelis and wounds NUM2. | suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | n |
| Question | First Sentence | Second Sentence |
| r069 | suicide bomber blew himself up on DATE at X1 in X2, killing NUM1 people and wounding NUM2, police said. | palestinian suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n |
| Question | First Sentence | Second Sentence |
| r070 | latest violence bring to NUM1 number of people killed as a direct result of the palestinian, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed in uprising since peace talks stalled. |
| Question | First Sentence | Second Sentence |
| r071 | palestinian suicide bomber blew himself up on DATE at X1 in X2, killing NUM1 people and wounding NUM2, police said. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 people and wounding NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r072 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 people when he blew himself up at X1 in northern X2. | palestinian suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 on DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r073 | attack was claimed by radical offshoot of X1. | militant Islamic group X1 claimed responsibility for attack. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | y |
| Question | First Sentence | Second Sentence |
| r074 | - DATE: bomb in X1 kills NUM1 israelis. | police spokeswoman said NUM1 people were killed by bomber at X1 attack on DATE |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n |
| Question | First Sentence | Second Sentence |
| r075 | More than NUM1 people were wounded. | NUM1 people were wounded. |
| Question | First Sentence | Second Sentence |
| r076 | militant group X1 claimed responsibility for attack. | militant Islamic group X1 claimed responsibility for attack. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r077 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed since palestinian uprising against israeli occupation erupted in September 2000 after peace talks stalled. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r078 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 when he blew himself up at X1 in northern X2. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 and wounding NUM2 police said. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | n |
| Question | First Sentence | Second Sentence |
| r079 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 when he blew himself up at X1 in northern X2. | suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 and wounding NUM2, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n |
| Question | First Sentence | Second Sentence |
| r080 | NUM1 people were hurt, NUM2 of them were in serious conditions. | Officials said at least NUM1 were wounded, NUM2 of them seriously. |
| Question | First Sentence | Second Sentence |
| r081 | X1 condemned bombing attacks. | X1 condemned bombing. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r082 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, or uprising, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have been killed since palestinian uprising against israeli occupation erupted in September 2000 after peace talks stalled. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r083 | X1, militia linked to X2 movement, claimed responsibility. | armed group linked to X2 faction, X1, said it carried out X3 attack. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | y |
| Question | First Sentence | Second Sentence |
| r084 | DATE: NUM1 are killed and NUM2 injured when suicide bomber blows up himself at X1 in X2. | suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n |
| Question | First Sentence | Second Sentence |
| r085 | DATE: NUM1 are killed and around NUM2 injured when suicide bomber blows up his explosive-packed belt at X1 in X2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 people and wounding more than NUM2, police said. |
| Question | First Sentence | Second Sentence |
| r086 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 when he blew himself up at X1 in northern X2. | suicide bomber killed at least NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r087 | X1 condemned attacks. | X1 condemned bombing. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r088 | attack was claimed by armed wing of X1. | militant Islamic group X1 claimed responsibility for attack saying it was " a slap in the faces of the criminals of the Zionist war. " |
| Name | Matching? | Difficult? | Comment |
| Judge3 | n | n |
| Question | First Sentence | Second Sentence |
| r089 | militant group X1 claims responsibility for attack. | militant Islamic group X1 claimed responsibility for attack saying it was " a slap in the faces of the criminals of the Zionist war. " |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | Had to decide if motive was critical to meaning |
| Question | First Sentence | Second Sentence |
| r090 | - DATE: suicide bomb on X kills NUM1 people. | DATE: police spokeswoman put death toll of X1 attack at NUM1. |
| Question | First Sentence | Second Sentence |
| r091 | palestinian suicide bomber blew himself up DATE at X1 in X2, killing NUM1 people and wounding NUM2, police said. | suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 people and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r092 | - DATE: suicide bomb attack at X1 in X2 kills NUM1 israelis and wounds NUM2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r093 | DATE: NUM1 are killed and NUM2 wounded when suicide bomber blows up himself at X1 in X2. | suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | n |
| Question | First Sentence | Second Sentence |
| r094 | militant group X1 claimed responsibility for attack. | militant Islamic group X1 claimed responsibility for attack saying it was " a slap in the faces of the criminals of the Zionist war. " |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n |
| Question | First Sentence | Second Sentence |
| r095 | DATE: NUM1 are killed and around NUM2 wounded when suicide bomber blows up his explosive-packed belt at X1 in X2. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 people and wounding more than NUM2, police said. |
| Question | First Sentence | Second Sentence |
| r096 | X1, linked to X2 movement, claimed responsibility for attack. | X1, group linked to X2 movement, claimed responsibility for attack and said it was in revenge for army raids on Palestinian refugee camps and other targets in the West Bank and Gaza Strip. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r097 | - DATE: bomb on X1 kills NUM1 israelis. | DATE: police spokeswoman put death toll of X1 attack at NUM1. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r098 | DATE: NUM1 are killed and NUM2 injured when suicide bomber blows up his explosive-packed belt at X1 in X2. | suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | n |
| Question | First Sentence | Second Sentence |
| r099 | - DATE: bombing on X1 kills NUM1 people. | police spokeswoman said NUM1 people were killed by bomber at X1 attack on DATE |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n |
| Question | First Sentence | Second Sentence |
| r100 | X1 identified suicide bomber as X2, NUM1, from West Bank town of X3. | X1 named bomber as NUM1-year-old X2 from West Bank refugee camp in X3 area. |
| Question | First Sentence | Second Sentence |
| r101 | - DATE: suicide bomber blows himself up and kills NUM1 others on bus in northern israeli town of X1. | police spokeswoman said NUM1 people were killed by bomber at X1 attack on DATE |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r102 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, including NUM2 palestinians and NUM3 israelis. | At least NUM1 israelis and NUM2 palestinians have been killed since palestinian uprising against israeli occupation in the West Bank and Gaza Strip began in September 2000 after peace talks stalled. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | n | n |
| Question | First Sentence | Second Sentence |
| r103 | latest deaths bring to NUM1 number of people killed as a direct result of the palestinian intifada, or uprising, including NUM2 palestinians and NUM3 israelis. | At least NUM1 palestinians and NUM2 israelis have died in uprising since after peace talks stalled. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | n | y |
| Question | First Sentence | Second Sentence |
| r104 | - DATE: bombing at X1 in X2 kills NUM1 israelis and leaves NUM2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding more than NUM2, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | Use of "leaves" is uncomfortable, but implication is not killed but involved |
| Question | First Sentence | Second Sentence |
| r105 | DATE - palestinian suicide bomber killed NUM1 people and injured NUM2 when he blew himself up at X1 in northern X2. | suicide bomber killed NUM1 people and wounded NUM2 others at X1 in X2 DATE. |
| Question | First Sentence | Second Sentence |
| r106 | suicide bomber blew himself up DATE at X1 in X2, killing NUM1 people and wounding NUM2, police said. | suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r107 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 when he blew himself up at X1 in northern X2. | suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding more than NUM2, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r108 | DATE: NUM1 are killed and around NUM2 wounded when suicide bomber blows up his explosive-packed belt at X1 in X2. | palestinian suicide bomber blew himself up at X1 in X2 DATE, killing NUM1 people and wounding NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | n |
| Question | First Sentence | Second Sentence |
| r109 | - DATE: suicide bomb attack in X1 kills NUM1 israelis. | police spokeswoman said NUM1 people were killed by bomber at X1 attack on DATE |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | n |
| Question | First Sentence | Second Sentence |
| r110 | - DATE: bombing at X1 in X2 kills NUM1 israelis and wounds NUM2. | suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding NUM2 others, police said. |
| Question | First Sentence | Second Sentence |
| r111 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 when he blew himself up at X1 in northern X2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding more than NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge2 | y | n |
| Question | First Sentence | Second Sentence |
| r112 | X1 identified suicide assailant as X2, NUM1, from West Bank town of X3. | X1 identified bomber as NUM1-year-old X2 from West Bank refugee camp near X3. |
| Name | Matching? | Difficult? | Comment |
| Judge4 | y | n |
| Question | First Sentence | Second Sentence |
| r113 | DATE - palestinian suicide bomber killed NUM1 israelis and injured NUM2 people when he blew himself up at X1 in northern X2. | palestinian suicide bomber blew himself up at X1 in X2 on DATE, killing NUM1 and wounding NUM2 others, police said. |
| Name | Matching? | Difficult? | Comment |
| Judge3 | y | n |
| Question | First Sentence | Second Sentence |
| r114 | X1, militia group linked to X2 movement, claimed responsibility. | X1, armed group linked to X2 movement, claimed responsibility for attack and said it was in revenge for assaults by israeli forces. |
| Name | Matching? | Difficult? | Comment |
| Judge1 | y | y | Had to decide if motive was critical to meaning. |
| Question | First Sentence | Second Sentence |
| r115 | DATE: NUM1 are killed |