Martha

Information about Martha

Published on November 20, 2007

Author: Heather

Source: authorstream.com

Content

Lexical Resources for Kindle:  Lexical Resources for Kindle Martha Palmer with Olga Babko-Malaya, Edward Loper, Jinying Chen, Szuting Yi and Ben Snyder University of Pennsylvania September 10, 2004 ARDA Site Visit - UIUC Outline:  Outline VerbNet Proposition Bank NomBank Semantic Role Labeling Comparison to FrameNet Comparison to WordNet Levin classes (Levin, 1993) :  Levin classes (Levin, 1993) 3100 verbs, 47 top level classes, 193 second and third level Each class has a syntactic signature based on alternations. John broke the jar. / The jar broke. / Jars break easily. John cut the bread. / *The bread cut. / Bread cuts easily. John hit the wall. / *The wall hit. / *Walls hit easily. Levin classes (Levin, 1993) :  Levin classes (Levin, 1993) Verb class hierarchy: 3100 verbs, 47 top level classes, 193 Each class has a syntactic signature based on alternations. John broke the jar. / The jar broke. / Jars break easily. change-of-state John cut the bread. / *The bread cut. / Bread cuts easily. change-of-state, recognizable action, sharp instrument John hit the wall. / *The wall hit. / *Walls hit easily. contact, exertion of force Limitations to Levin Classes:  Limitations to Levin Classes Coverage of only half of the verbs (types) in the Penn Treebank (1M words,WSJ) Usually only one or two basic senses are covered for each verb Confusing sets of alternations Different classes have almost identical “syntactic signatures” or worse, contradictory signatures Dang, Kipper & Palmer, ACL98 Multiple class listings:  Multiple class listings Homonymy or polysemy? draw a picture, draw water from the well Conflicting alternations? Carry verbs disallow the Conative, (*she carried at the ball), but include {push,pull,shove,kick,yank,tug} also in Push/pull class, does take the Conative (she kicked at the ball) Intersective Levin Classes:  Intersective Levin Classes “at” ¬CH-LOC “across the room” CH-LOC “apart” CH-STATE Dang, Kipper & Palmer, ACL98 Intersective Levin Classes:  Intersective Levin Classes More syntactically and semantically coherent sets of syntactic patterns explicit semantic components relations between senses VERBNET www.cis.upenn.edu/verbnet VerbNet – Karin Kipper:  VerbNet – Karin Kipper Class entries: Capture generalizations about verb behavior Organized hierarchically Members have common semantic elements, semantic roles and syntactic frames Verb entries: Refer to a set of classes (different senses) each class member linked to WN synset(s) (not all WN senses are covered) Dang, Kipper & Palmer, IJCAI00, Coling00 Semantic role labels::  Semantic role labels: Grace broke the LCD projector. break (agent(Grace), patient(LCD-projector)) cause(agent(Grace), change-of-state(LCD-projector)) (broken(LCD-projector)) agent(A) -> intentional(A), sentient(A), causer(A), affector(A) patient(P) -> affected(P), change(P),… VerbNet entry for leave Levin class: future_having-13.3:  VerbNet entry for leave Levin class: future_having-13.3 WordNet Senses: leave, (WN 2,10,13), promise, offer, …. Thematic Roles: Agent[+animate OR +organization] Recipient[+animate OR +organization] Theme[] Frames with Semantic Roles "I promised somebody my time" Agent V Recipient Theme “I left my fortune to Esmerelda" Agent V Theme Prep(to) Recipient ) "I offered my services" Agent V Theme Handmade resources vs. Real data:  Handmade resources vs. Real data VerbNet is based on linguistic theory – how useful is it? How well does it correspond to syntactic variations found in naturally occurring text? Proposition Bank: From Sentences to Propositions (Predicates!):  Proposition Bank: From Sentences to Propositions (Predicates!) . . . When Powell met Zhu Rongji on Thursday they discussed the return of the spy plane. meet(Powell, Zhu) discuss([Powell, Zhu], return(X, plane)) meet(Somebody1, Somebody2) Capturing semantic roles:  Capturing semantic roles John broke [ PATIENT the laser pointer.] [PATIENT The windows] were broken by the hurricane. [PATIENT The vase] broke into pieces when it toppled over SUBJ SUBJ SUBJ Capturing “neutral” roles:  Capturing “neutral” roles John broke [ Arg1 the laser pointer.] [Arg1 The windows] were broken by the hurricane. [Arg1 The vase] broke into pieces when it toppled over A TreeBanked phrase 1M words WSJ – Penn TreeBank II:  A TreeBanked phrase 1M words WSJ – Penn TreeBank II S VP would VP give NP PP-LOC A GM-Jaguar pact would give the U.S. car maker an eventual 30% stake in the British company. Marcus, et al, 93 The same phrase, PropBanked Same data – released, March’04:  The same phrase, PropBanked Same data – released, March’04 would give the US car maker an eventual 30% stake in the British company Arg0 Arg2 Arg1 A GM-Jaguar pact would give the U.S. car maker an eventual 30% stake in the British company. Frames File example: give < 4000 Frames for PropBank:  Frames File example: give < 4000 Frames for PropBank Roles: Arg0: giver Arg1: thing given Arg2: entity given to Example: double object The executives gave the chefs a standing ovation. Arg0: The executives REL: gave Arg2: the chefs Arg1: a standing ovation NomBank Frames File example: gift (nominalizations, noun predicates, partitives, etc.:  NomBank Frames File example: gift (nominalizations, noun predicates, partitives, etc. Roles: Arg0: giver Arg1: thing given Arg2: entity given to Example: double object Nancy’s gift from her cousin was a complete surprise. Arg0: her cousin REL: gave Arg2: her Arg1: gift Frames File example: give w/ Thematic Role Labels:  Frames File example: give w/ Thematic Role Labels Roles: Arg0: giver Arg1: thing given Arg2: entity given to Example: double object The executives gave the chefs a standing ovation. Arg0: Agent The executives REL: gave Arg2: Recipient the chefs Arg1: Theme a standing ovation VerbNet – based on Levin classes Annotation procedure – Released March, 2004 (LDC):  Annotation procedure – Released March, 2004 (LDC) PTB II – Extract all sentences of a verb Create Frame File for that verb Paul Kingsbury (3100+ lemmas, 4700 framesets,120K predicates) 1st pass: Automatic tagging Joseph Rosenzweig 2nd pass: Double blind hand correction by verb Inter-annotator agreement 84% 3rd pass: Adjudication Olga Babko-Malaya 4th pass: Train automatic semantic role labellers Dan Gildea, Sameer Pradhan, Nianwen Xue, Szuting Yi, …. CoNLL-04 shared task. Mapping from PropBank to VerbNet:  Mapping from PropBank to VerbNet Overlap with PropBank framesets 50,000 PropBank instances < 50% VN entries, > 85% VN classes Results MATCH - 78.63%. (80.90% relaxed) (VerbNet isn’t just linguistic theory!) Benefits Thematic role labels and semantic predicates Can extend PropBank coverage with VerbNet classes WordNet sense tags Kingsbury & Kipper, NAACL03, Text Meaning Workshop http://www.cs.rochester.edu/~gildea/VerbNet/ Outline:  Outline VerbNet Proposition Banks (PropBanks) Semantic Role Labeling Comparison to FrameNet Comparison to WordNet Automatic Semantic Role Labeling:  Automatic Semantic Role Labeling Objective correctly detecting and characterizing semantic relations within text is the heart of successful natural language processing applications Problem Formalization Problem: Machine Learning Classification based statistical approach Training & Testing Data: PropBank annotations both 2004 release & 2002 release (for comparison) Approach:  Approach Pre-processing: A heuristic which filters out unwanted constituents with significant confidence Argument Identification A binary SVM classifier which identifies arguments Argument Classification A multi-class SVM classifier which tags arguments as ARG0-5, ARGA, and ARGM Automatic Semantic Role Labeling:  Automatic Semantic Role Labeling Stochastic Model Basic Features: Predicate, (verb) Phrase Type, (NP or S-BAR) Parse Tree Path Position (Before/after predicate) Voice (active/passive) Head Word of constituent Subcategorization Gildea & Jurafsky, CL02, Gildea & Palmer, ACL02 Discussion Part I – Szuting Yi:  Discussion Part I – Szuting Yi Comparisons between Pradhan and Penn (SVM) Both systems are SVM-based Kernel: Pradhan uses a degree 2 polynomial kernel; Penn uses a degree 3 RGB kernel Multi-classification: Pradhan uses a one-versus-others approach; Penn uses a pairwise approach Features: Pradhan includes rich features including NE, head word POS, partial path, verb classes, verb sense, head word of PP, first or last word/pos in the constituent, constituent tree distance, constituent relative features, temporal cue words, dynamic class context (Pradhan et al, 2004) Discussion Part II :  Discussion Part II Different features for different subtasks Basic features analysis Xue & Palmer, EMNLP04 Discussion Part III (New Features – Bert Xue):  Discussion Part III (New Features – Bert Xue) Syntactic frame use NPs as “pivots” varying with position within the frame lexicalization with predicate Predicate + head word phrase type head word of PP parent Position + voice Results :  Results Outline:  Outline VerbNet Proposition Banks (PropBanks) Semantic Role Labeling Comparison to FrameNet Comparison to WordNet PropBank/FrameNet:  PropBank/FrameNet Buy Arg0: buyer Arg1: goods Arg2: seller Arg3: rate Arg4: payment Sell Arg0: seller Arg1: goods Arg2: buyer Arg3: rate Arg4: payment More syntactic and generic, – maps readily to VN,TR NSF funding to map PropBank to FrameNet Rambow, et al., PBML03 Word Senses in PropBank:  Word Senses in PropBank Orders to ignore word sense not feasible for 700+ verbs Mary left the room Mary left her daughter-in-law her pearls in her will Frameset leave.01 "move away from": Arg0: entity leaving Arg1: place left Frameset leave.02 "give": Arg0: giver Arg1: thing given Arg2: beneficiary How do these relate to traditional word senses in VerbNet and WordNet? WordNet – Princeton Miller 1985, Fellbaum 1998:  WordNet – Princeton Miller 1985, Fellbaum 1998 On-line lexical reference (dictionary) Nouns, verbs, adjectives, and adverbs grouped into synonym sets; also hypernyms (ISA), antonyms, meronyms Limitations as a sense inventory for creating training data for supervised Machine Learning No explicit ties to syntactic structure or # of participants Definitions fine-grained and vague SENSEVAL2 29 Verbs > 16 senses (including call) Inter-annotator Agreement ITA 73%, Automatic Word Sense Disambiguation, WSD 62.5% Slow annotation speed – 60 tokens per hour Dang & Palmer, SIGLEX02 WordNet – call, 28 senses:  WordNet – call, 28 senses name, call -- (assign a specified, proper name to; "They named their son David"; …) -> LABEL 2. call, telephone, call up, phone, ring -- (get or try to get into communication (with someone) by telephone; "I tried to call you all night"; …) ->TELECOMMUNICATE 3. call -- (ascribe a quality to or give a name of a common noun that reflects a quality; "He called me a bastard"; …) -> LABEL 4. call, send for -- (order, request, or command to come; "She was called into the director's office"; "Call the police!") -> ORDER WordNet: - call, 28 senses:  WordNet: - call, 28 senses WN2 , WN13,WN28 WN15 WN26 WN3 WN19 WN4 WN 7 WN8 WN9 WN1 WN22 WN20 WN25 WN18 WN27 WN5 WN 16 WN6 WN23 WN12 WN17 , WN 11 WN10, WN14, WN21, WN24 WordNet: - call, 28 senses, Senseval2 groups:  WordNet: - call, 28 senses, Senseval2 groups WN5, WN16,WN12 WN15 WN26 WN3 WN19 WN4 WN 7 WN8 WN9 WN1 WN22 WN20 WN25 WN18 WN27 WN2 WN 13 WN6 WN23 WN28 WN17 , WN 11 WN10, WN14, WN21, WN24, Loud cry Label Phone/radio Bird or animal cry Request Call a loan/bond Visit Challenge Bid Overlap with PropBank Framesets:  Overlap with PropBank Framesets WN5, WN16,WN12 WN15 WN26 WN3 WN19 WN4 WN 7 WN8 WN9 WN1 WN22 WN20 WN25 WN18 WN27 WN2 WN 13 WN6 WN23 WN28 WN17 , WN 11 WN10, WN14, WN21, WN24, Loud cry Label Phone/radio Bird or animal cry Request Call a loan/bond Visit Challenge Bid Overlap between Senseval2 Groups and Framesets – 95% :  Overlap between Senseval2 Groups and Framesets – 95% WN1 WN2 WN3 WN4 WN6 WN7 WN8 WN5 WN 9 WN10 WN11 WN12 WN13 WN 14 WN19 WN20 Frameset1 Frameset2 develop Sense Hierarchy (Palmer, et al, SNLU04 - NAACL04):  Sense Hierarchy (Palmer, et al, SNLU04 - NAACL04) PropBank Framesets – ITA >90% coarse grained distinctions 20 Senseval2 verbs w/ > 1 Frameset Maxent WSD system, 73.5% baseline, 90% accuracy Sense Groups (Senseval-2) - ITA 82% Intermediate level (includes Levin classes) – 69% WordNet – ITA 71% fine grained distinctions, 60.2% Tagging w/groups, ITA 89%, [email protected] PropBank I :  PropBank I Also, [Arg0substantially lower Dutch corporate tax rates] helped [Arg1[Arg0 the company] keep [Arg1 its tax outlay] [Arg3-PRD flat] [ArgM-ADV relative to earnings growth]]. relative to earnings… flat its tax outlay the company keep the company keep its tax outlay flat tax rates help ArgM-ADV Arg3-PRD Arg1 Arg0 REL Event variables; nominal reference; I Summary of Needed KINDLE Resources:  Summary of Needed KINDLE Resources

Related presentations


Other presentations created by Heather

nanotechnology presentation
13. 10. 2007
0 views

nanotechnology presentation

MMLA group ppt 11 28 05
08. 10. 2008
0 views

MMLA group ppt 11 28 05

Sadiq
08. 05. 2008
0 views

Sadiq

Mun101806
08. 05. 2008
0 views

Mun101806

ch09r
08. 05. 2008
0 views

ch09r

louise baur
08. 05. 2008
0 views

louise baur

Obesity
07. 05. 2008
0 views

Obesity

radev
07. 05. 2008
0 views

radev

pp pres sptconfrday
06. 05. 2008
0 views

pp pres sptconfrday

pp pres sptconfrday
06. 05. 2008
0 views

pp pres sptconfrday

Communication skills notes
26. 11. 2007
0 views

Communication skills notes

L12 Superconductivity
12. 10. 2007
0 views

L12 Superconductivity

Development of behavior
11. 10. 2007
0 views

Development of behavior

Silver Sword Review
19. 10. 2007
0 views

Silver Sword Review

Notes Russia
27. 09. 2007
0 views

Notes Russia

thesis
30. 09. 2007
0 views

thesis

spiritual warefare combined2
01. 10. 2007
0 views

spiritual warefare combined2

ASAPJan06 Presentation Millonig
03. 10. 2007
0 views

ASAPJan06 Presentation Millonig

symp04 pp liming e
10. 10. 2007
0 views

symp04 pp liming e

China India Web FINAL POST
10. 10. 2007
0 views

China India Web FINAL POST

reptile powerpoint
12. 10. 2007
0 views

reptile powerpoint

Heatsub
12. 10. 2007
0 views

Heatsub

Notes Europe
15. 10. 2007
0 views

Notes Europe

Funding Biomedical Research
16. 10. 2007
0 views

Funding Biomedical Research

NEW chpt 4
17. 10. 2007
0 views

NEW chpt 4

ATUG power point presentation
17. 10. 2007
0 views

ATUG power point presentation

ANT3141 20 Peru
19. 10. 2007
0 views

ANT3141 20 Peru

Implication du Personnel
24. 10. 2007
0 views

Implication du Personnel

lecture 45
02. 10. 2007
0 views

lecture 45

McK CIT 05 PC2A
15. 10. 2007
0 views

McK CIT 05 PC2A

chapter2 notes
15. 10. 2007
0 views

chapter2 notes

brun
28. 10. 2007
0 views

brun

Branson HIV and Privacy 2
29. 10. 2007
0 views

Branson HIV and Privacy 2

Oracle OTC
05. 11. 2007
0 views

Oracle OTC

Darwinismo
06. 11. 2007
0 views

Darwinismo

WRITING unit 3 summaries 95
18. 10. 2007
0 views

WRITING unit 3 summaries 95

lecture28
16. 11. 2007
0 views

lecture28

VirologyReview2005
19. 11. 2007
0 views

VirologyReview2005

gender selection
21. 11. 2007
0 views

gender selection

ulrich 120203
30. 10. 2007
0 views

ulrich 120203

LPP600 ch5 rev
06. 11. 2007
0 views

LPP600 ch5 rev

dance
23. 11. 2007
0 views

dance

rutas de putaendo
24. 10. 2007
0 views

rutas de putaendo

Insomnia 2
28. 11. 2007
0 views

Insomnia 2

marktoberdorf
30. 10. 2007
0 views

marktoberdorf

PacketSwitching1
30. 12. 2007
0 views

PacketSwitching1

Manshadi impact
03. 01. 2008
0 views

Manshadi impact

Ionizing Radiation 2
04. 01. 2008
0 views

Ionizing Radiation 2

egov ma
23. 10. 2007
0 views

egov ma

chap15a
05. 01. 2008
0 views

chap15a

lecture hazard individual choice
04. 10. 2007
0 views

lecture hazard individual choice

Spanish presentation
22. 10. 2007
0 views

Spanish presentation

presentazione estetismo
01. 10. 2007
0 views

presentazione estetismo

BVS Panama
22. 10. 2007
0 views

BVS Panama

Hollywood
25. 10. 2007
0 views

Hollywood

astro12Summer11
13. 11. 2007
0 views

astro12Summer11

ryud
09. 10. 2007
0 views

ryud

MetaphorsWeLiveBy
24. 10. 2007
0 views

MetaphorsWeLiveBy

AMMA briefing
06. 11. 2007
0 views

AMMA briefing

west africa down
03. 01. 2008
0 views

west africa down

zhping PHD
04. 10. 2007
0 views

zhping PHD

Ch02
15. 10. 2007
0 views

Ch02

02Coelho Review
16. 10. 2007
0 views

02Coelho Review

RUSSIA transition
26. 10. 2007
0 views

RUSSIA transition

39124236 GEOMORPHOLOGY RIVERS
19. 10. 2007
0 views

39124236 GEOMORPHOLOGY RIVERS

AFlood2005
03. 01. 2008
0 views

AFlood2005

26 Beautiful One liners 09 12 06
07. 10. 2007
0 views

26 Beautiful One liners 09 12 06

milia v10
21. 02. 2008
0 views

milia v10

BRT LA Metro
29. 10. 2007
0 views

BRT LA Metro

18531
24. 02. 2008
0 views

18531

gulf war 2 desert storm
26. 02. 2008
0 views

gulf war 2 desert storm

NDBs MSC SA Mondi
27. 02. 2008
0 views

NDBs MSC SA Mondi

t2nd edn
16. 03. 2008
0 views

t2nd edn

AsiaPacificUpdate
25. 03. 2008
0 views

AsiaPacificUpdate

Lecture23 SmallSats
15. 11. 2007
0 views

Lecture23 SmallSats

BU NSF06 kannan
31. 10. 2007
0 views

BU NSF06 kannan

Macro Chapter 4
10. 04. 2008
0 views

Macro Chapter 4

mini supercells jmm final
03. 10. 2007
0 views

mini supercells jmm final

SPS CM Seminar
14. 04. 2008
0 views

SPS CM Seminar

lecture13 Online Games
22. 04. 2008
0 views

lecture13 Online Games

IDN Gold WebEx BSE
22. 04. 2008
0 views

IDN Gold WebEx BSE

NIV oncall
01. 05. 2008
0 views

NIV oncall

history stuff
14. 12. 2007
0 views

history stuff

abadinsky08 ppt ch03
07. 01. 2008
0 views

abadinsky08 ppt ch03

The BioArtificial Liver2
02. 05. 2008
0 views

The BioArtificial Liver2

Katrina RRC
02. 05. 2008
0 views

Katrina RRC

angusallyouneed tcm4 123635
02. 10. 2007
0 views

angusallyouneed tcm4 123635

ladeau
21. 10. 2007
0 views

ladeau

Presentation10
09. 04. 2008
0 views

Presentation10

Food web of the Arctic
10. 10. 2007
0 views

Food web of the Arctic

Barbara 01
26. 09. 2007
0 views

Barbara 01

Befmod Dog Pony Big
17. 04. 2008
0 views

Befmod Dog Pony Big

TC
09. 10. 2007
0 views

TC

EHaro Presentacion Casablanca
24. 10. 2007
0 views

EHaro Presentacion Casablanca

Turner Powerpoint
31. 12. 2007
0 views

Turner Powerpoint

Feb27
07. 10. 2007
0 views

Feb27

2005 Kobe
09. 10. 2007
0 views

2005 Kobe

liberal jun2000 tapia
15. 10. 2007
0 views

liberal jun2000 tapia

hiv and smoking
29. 10. 2007
0 views

hiv and smoking

157 4s1 10p35 voloshin
26. 10. 2007
0 views

157 4s1 10p35 voloshin

cicognani
11. 10. 2007
0 views

cicognani

paper55
29. 10. 2007
0 views

paper55

Mission and Vision
07. 01. 2008
0 views

Mission and Vision

2004 07 01 rochoa
15. 11. 2007
0 views

2004 07 01 rochoa

Seva activities at Bridgewater
10. 12. 2007
0 views

Seva activities at Bridgewater

African lag
05. 10. 2007
0 views

African lag

8 Barbra Morgante RFI
15. 10. 2007
0 views

8 Barbra Morgante RFI

Vajente GWDAW11 StatusOfVirgo
01. 12. 2007
0 views

Vajente GWDAW11 StatusOfVirgo

papineni
15. 10. 2007
0 views

papineni

housemtg 20040907
16. 10. 2007
0 views

housemtg 20040907

ClevelandStateF2005
02. 11. 2007
0 views

ClevelandStateF2005

IDC prezentace LinuxWorld
24. 10. 2007
0 views

IDC prezentace LinuxWorld

stassun
01. 01. 2008
0 views

stassun

Models User Guide
05. 10. 2007
0 views

Models User Guide

Suite Sensation General
07. 12. 2007
0 views

Suite Sensation General

Suchman Virology 2005
16. 10. 2007
0 views

Suchman Virology 2005

jd graz
18. 03. 2008
0 views

jd graz

veronarda
03. 10. 2007
0 views

veronarda

RHIC spin talk
15. 11. 2007
0 views

RHIC spin talk

Nian Cai Liu presentation
15. 10. 2007
0 views

Nian Cai Liu presentation