Question Answering

Information about Question Answering

Published on November 16, 2007

Author: Barbara

Source: authorstream.com

Content

Question Answering:  Question Answering Zhikun Meng Overview:  Overview What is Question Answering? Why Question Answering? How Question Answering? What is the current status of Question Answering? How to evaluate Question Answering? What is the future of Question Answering? What is Question Answering?:  What is Question Answering? What is question answering system? Question answer clear What is Question Answering?:  What is Question Answering? Answer: Question answering systems are designed to find answers to open domain questions in a large collection of documents. Why Question Answering?:  Why Question Answering? How Question Answering?:  How Question Answering? General architecture question Question Classification Information Retrieval Answer Extraction Answer answer e.g. What is Calvados? /Q is /A where:/Q=“(Calvados)” Query=“Calvados is” Text retrieva l=“…Calvados is often used in cooking…Calvados is a dry apple brandy made in… /A is : a dry apple brandy Answer: /Q is /A: “Calvados” is ”a dry apple brandy” Question Classification:  Question Classification e.g. “How much could you rent a Volkswagen bug for in 1966?” Key word preprocessing (split/spell check/normalize) Volkswagen-Volkswagen; “Rotary engine cars were made by what company?” - “What company were rotary engine cars made by?” Question Classification:  Question Classification 2. Construction of question representation How much: Question stem rent: Answer type term 1966:Data constraint Volkswagen bug Question Classification:  Question Classification 3.Derivation of answer type “How much”+ “rent” ->Money Question Classification:  Question Classification 4.Key word selection Volkswagen AND bug AND rent Question Classification:  Question Classification 5.Key word expansion rent-rented Information Retrieval:  Information Retrieval Retrieval documents and passages: query: Volkswagen AND bug AND rent The retrieval engine returns the documents containing all keywords (e.g.60 document passages from 1,000,000 documents collection) Information Retrieval:  Information Retrieval 2. Passage filtering date constraint 1966. Out of the 60 passages returned by the retrieval engine for Q013, two passages are retained after passage post filtering. Answer Extraction:  Answer Extraction Identification of candidate answers Answer type: Money Identified candidates include $1 and USD 520. Answer Extraction:  Answer Extraction 2. Answer Ranking score: $1 USD 520 Answer Extraction:  Answer Extraction 3. Answer formulation rent a Volkswagen bug for $1 a day What is the current status of Question Answering?:  What is the current status of Question Answering? Text REtrieval Conference (TREC) http://trec.nist.gov/ Cross Language Evaluation Forum (CLEF) http://clef.isti.cnr.it/ NII-NACSIS Test Collection for IR Systems Project (NTCIR) http://research.nii.ac.jp/ntcir/index-en.html TREC-8:  TREC-8 In 1999, the 8th Text REtrieval Conference (TREC-8) first proposed QA track . TREC-8 tasks included: Answer factoid questions by returning a text snippet which contained an answer to the question Build a reusable QA test collection. TREC-9:  TREC-9 Comparing to TREC-8, in TREC-9 the biggest change was the switch to “real" questions, rather than questions created especially for the track. The absolute value of scores dropped, yet the performance of the TREC-9 systems improved significantly in QA technology. TREC 2001 :  TREC 2001 The major adjustment of TREC 2001 QA track is to divide the task into three separate tasks: the main task, the list task the context task. TREC 2002 :  TREC 2002 TREC 2002 QA track contained two tasks, the main task and the list task The system was required to return the exact answers Systems were limited to one response per question, not five Ranking metric changed to the confidence-weighted score TREC 2003 :  TREC 2003 The TREC 2003 question answering track contained two tasks: the passages task (factoid) the main task (factoids, lists, definitions) significant participation was involved in lists question task TREC 2004:  TREC 2004 The factoid question and list question are not independent; instead, they are all related to given topics More participants are involved in resolving list question and definition question tasks. CLEF:  CLEF In 2002, CLEF proposed its own Question Answering track which focuses on European Language QA, especially Cross-lingual QA (CLQA). CLEF 2003 QA track was divided into monolingual and bilingual tasks NTCIR:  NTCIR In 2003, the Asian information retrieval conference NTCIR proposed its Question Answering track which focuses on Asian Language QA. How to evaluate Question Answering?:  How to evaluate Question Answering? TREC About 1500 question collections from TREC-8,9,2001 Answers were extracted from a 3-Gbyte text collection containing about 1 million documents from sources such as the Los Angeles Times and Wall Street Journal. Each answer has at most 50 characters. The answer accuracy used to be measured by the Mean Reciprocal Rank (MRR) metric used by NIST in the TREC QA evaluations. In TREC2002, ranking metric was changed to the confidence-weighted score. How to evaluate Question Answering?:  How to evaluate Question Answering? CLEF In CLEF 2002, a test set for future cross-lingual research, DISEQuA (Dutch Italian Spanish English Questions and Answers )Corpus, is created. What is the future of Question Answering?:  What is the future of Question Answering? Factoid Questions Lists Questions Definition Questions Non-English monolingual QA Cross-lingual QA cross-lingual and cross-media QA Summary:  Summary QA definition General QA system architecture QA technologies QA research milestone Roadmap Questions?:  Questions?

Related presentations


Other presentations created by Barbara

Solar System
17. 06. 2007
0 views

Solar System

Advanced SQL Injection
30. 08. 2007
0 views

Advanced SQL Injection

PrivateExchange
22. 04. 2008
0 views

PrivateExchange

07 fordjob1
17. 04. 2008
0 views

07 fordjob1

20061011114434853
13. 04. 2008
0 views

20061011114434853

Bruce Lambert Army Corps
10. 04. 2008
0 views

Bruce Lambert Army Corps

SPAC2007 Juan Rodriguez
09. 04. 2008
0 views

SPAC2007 Juan Rodriguez

Chapter7
07. 04. 2008
0 views

Chapter7

tourism chapter 04
30. 03. 2008
0 views

tourism chapter 04

LAC International Trade
28. 03. 2008
0 views

LAC International Trade

feb2006final
27. 03. 2008
0 views

feb2006final

virtualcommunities
26. 03. 2008
0 views

virtualcommunities

Mickey Mouse
26. 06. 2007
0 views

Mickey Mouse

1who gets tb in nyc
27. 09. 2007
0 views

1who gets tb in nyc

lijian
12. 10. 2007
0 views

lijian

O2 Diesel
08. 11. 2007
0 views

O2 Diesel

American Romanticism
30. 08. 2007
0 views

American Romanticism

233nm60
30. 08. 2007
0 views

233nm60

MBA Lecture Series v2
30. 08. 2007
0 views

MBA Lecture Series v2

hep2005 talk MarkVagins
09. 10. 2007
0 views

hep2005 talk MarkVagins

Control Tech
05. 12. 2007
0 views

Control Tech

DasuCMSTriggerUCSD
07. 10. 2007
0 views

DasuCMSTriggerUCSD

ams ppt
30. 08. 2007
0 views

ams ppt

Facts x about Finland
22. 11. 2007
0 views

Facts x about Finland

OWAS PAppSecEU2006 CLASP Project
30. 08. 2007
0 views

OWAS PAppSecEU2006 CLASP Project

OWASP Flyer Sep06
30. 08. 2007
0 views

OWASP Flyer Sep06

fun with hyperplanes 2007
28. 12. 2007
0 views

fun with hyperplanes 2007

american history
28. 12. 2007
0 views

american history

Frank Garber Presentation
02. 01. 2008
0 views

Frank Garber Presentation

DPS07 65 01 Fritzius
03. 01. 2008
0 views

DPS07 65 01 Fritzius

Teaching Political Sociology
04. 01. 2008
0 views

Teaching Political Sociology

Gaming in Education
07. 01. 2008
0 views

Gaming in Education

Plume tracking hardware
07. 01. 2008
0 views

Plume tracking hardware

Altera
28. 11. 2007
0 views

Altera

dead reckon cdr
07. 01. 2008
0 views

dead reckon cdr

Infections 3
04. 12. 2007
0 views

Infections 3

CMC IR1001
27. 09. 2007
0 views

CMC IR1001

class2 3
16. 11. 2007
0 views

class2 3

mixload
06. 11. 2007
0 views

mixload

web query 0609
07. 11. 2007
0 views

web query 0609

FSA
27. 12. 2007
0 views

FSA

CompanyDossier
29. 09. 2007
0 views

CompanyDossier

Hunting For Black Holes
28. 11. 2007
0 views

Hunting For Black Holes

DAR
20. 02. 2008
0 views

DAR

8 Soci 1015 Chapter7 Family
24. 02. 2008
0 views

8 Soci 1015 Chapter7 Family

ABSSEI Oswald
29. 02. 2008
0 views

ABSSEI Oswald

NeMO Curr Part3 v2
26. 06. 2007
0 views

NeMO Curr Part3 v2

nelson sheinberg Presentation
26. 06. 2007
0 views

nelson sheinberg Presentation

n0002 SPIE1
26. 06. 2007
0 views

n0002 SPIE1

Metric System 1
26. 06. 2007
0 views

Metric System 1

media kit
26. 06. 2007
0 views

media kit

March 14 PMI Presentation
26. 06. 2007
0 views

March 14 PMI Presentation

fountain of age
26. 06. 2007
0 views

fountain of age

Lifting Equation
13. 12. 2007
0 views

Lifting Equation

Dietary Guidelines
04. 03. 2008
0 views

Dietary Guidelines

upshur pc1
10. 03. 2008
0 views

upshur pc1

crossref
30. 08. 2007
0 views

crossref

ddbppt
20. 11. 2007
0 views

ddbppt

DEPBasicsCourse
30. 12. 2007
0 views

DEPBasicsCourse

guerra
12. 11. 2007
0 views

guerra

James F Cooper
30. 08. 2007
0 views

James F Cooper

lubin talk
03. 01. 2008
0 views

lubin talk

NDD presentation compressed
30. 08. 2007
0 views

NDD presentation compressed

madcooper
07. 12. 2007
0 views

madcooper

graduacion1
01. 01. 2008
0 views

graduacion1

GBIF demo Japan081003
27. 11. 2007
0 views

GBIF demo Japan081003

20061019 1732 oberauer hql06
15. 11. 2007
0 views

20061019 1732 oberauer hql06

phpulse oct
05. 01. 2008
0 views

phpulse oct

media searching
26. 06. 2007
0 views

media searching

Smith Core values
17. 06. 2007
0 views

Smith Core values

Smith1
17. 06. 2007
0 views

Smith1

Significance of the Cross
17. 06. 2007
0 views

Significance of the Cross

Sharp
17. 06. 2007
0 views

Sharp

section 2 attitude to food
17. 06. 2007
0 views

section 2 attitude to food

Section4 5
17. 06. 2007
0 views

Section4 5

Spirituality
17. 06. 2007
0 views

Spirituality

sonnet presentation
17. 06. 2007
0 views

sonnet presentation

Star addition tutorial
17. 06. 2007
0 views

Star addition tutorial

stand up comedy
17. 06. 2007
0 views

stand up comedy

SS 1SBrown
17. 06. 2007
0 views

SS 1SBrown

Emerson Transcendentalism
30. 08. 2007
0 views

Emerson Transcendentalism

ABinEurope
23. 11. 2007
0 views

ABinEurope

TextMining 06
03. 10. 2007
0 views

TextMining 06

oct04ach
05. 11. 2007
0 views

oct04ach

SCP2
17. 06. 2007
0 views

SCP2

transcendentalism
30. 08. 2007
0 views

transcendentalism

micro ch03 presentation
04. 10. 2007
0 views

micro ch03 presentation

SC morning
17. 06. 2007
0 views

SC morning

ISIC cobrandNEUenglish
18. 03. 2008
0 views

ISIC cobrandNEUenglish

02b LisbonWeb
30. 12. 2007
0 views

02b LisbonWeb

ProvenceArchitecture
05. 11. 2007
0 views

ProvenceArchitecture

san diego 04
01. 11. 2007
0 views

san diego 04

noemie 2
26. 06. 2007
0 views

noemie 2

Community Service PP 06 FOR WEB
05. 11. 2007
0 views

Community Service PP 06 FOR WEB

Sections3 7
17. 06. 2007
0 views

Sections3 7

ECE TRANS WP29 GRSP 41 inf09e
26. 11. 2007
0 views

ECE TRANS WP29 GRSP 41 inf09e

srwg graz
26. 11. 2007
0 views

srwg graz

Meydan
23. 11. 2007
0 views

Meydan

LWS05
02. 11. 2007
0 views

LWS05

mal 2005 bra
30. 08. 2007
0 views

mal 2005 bra

Standards Aligned Classroom
17. 06. 2007
0 views

Standards Aligned Classroom

steenkampNVDRS
06. 03. 2008
0 views

steenkampNVDRS