wcor06

Information about wcor06

Published on March 21, 2008

Author: VolteMort

Source: authorstream.com

Content

Image and Multimedia Categorization:  Image and Multimedia Categorization Gabriela Csurka, Eric Gaussier, François Pacull, Florent Perronnin, Jean-Michel Renders Xerox Research Centre Europe France Generic Visual Categorization (GVC):  The pattern classification problem which consists in assigning one or multiple labels to an image based on its semantic content Generic: cope with various object and scene types Challenge: handle variations in view, lighting, occlusion, and typical object and scene variations Generic Visual Categorization (GVC) Generic Visual Categorizer (GVC):  Generic Visual Categorizer (GVC) “Bag-of-key-patches” inspired by the “bag-of-words” : Patch detection: ROI (Harris, segmentation, etc.), multi-scale grid, random. Feature extraction: SIFT, RIFT, shape context, moments, color, etc. Visual vocabulary: K-means, GMM + EM, mean-shift, etc. Histogram computation: accumulating hard or soft occurrences Classification: pLSA, SVM, logistic regression, etc. Universal and adapted vocabularies:  Universal and adapted vocabularies F. Perronnin, C. Dance, G. Csurka and M. Bressan, Adapted Vocabularies for Generic Visual Categorization, ECCV 2006. Bi-partite histograms:  For each image, compute one histogram per category on the combined vocabularies Separate the relevant information from the irrelevant one Bi-partite histograms F. Perronnin, C. Dance, G. Csurka and M. Bressan, Adapted Vocabularies for Generic Visual Categorization, ECCV 2006. Experimental results:  Experimental results Among the best performing systems at Pascal VOC Challenge 3rd system, 2nd institution 5-fold CV results on a 35 categories database, about 40000 images: Collected for RevealThis, related to travel and leisure, only mono-labeled Computed equal error rate (EER) and mean classification error rate (MCER) Expected confusions influenced the poor classification results F. Perronnin, C. Dance, G. Csurka and M. Bressan, Adapted Vocabularies for Generic Visual Categorization, ECCV 2006. Multiple-view categorization:  Multiple-view categorization Problem statement: Given a set of data annotated in two different set of categories (different view). An independently pre-trained categorizer system available for both set. The aim is to exploit possible dependencies between the two category system to refine the categorization decisions. Visual (GVC) Textual (PLC) J.-M. Renders, E. Gaussier, C Goutte, F. Pacull and G. Csurka, Categorization in Multiple Category Systems, ICML 2006. Asymmetric re-weighting:  Asymmetric re-weighting From assuming leads to: where The potential: can be computed through MLE on some training data J.-M. Renders, E. Gaussier, C Goutte, F. Pacull and G. Csurka, Categorization in Multiple Category Systems, ICML 2006. Symmetric re-weighting:  Symmetric re-weighting where From assuming we get from which J.-M. Renders, E. Gaussier, C Goutte, F. Pacull and G. Csurka, Categorization in Multiple Category Systems, ICML 2006. Text categorization:  Text categorization Texts are modeled as co-occurrences of documents (d) and words (w) with associated classes (c). The models are learned using PLC: where are estimated through MLE The posterior class probabilities of a new data are given by: J.-M. Renders, E. Gaussier, C Goutte, F. Pacull and G. Csurka, Categorization in Multiple Category Systems, ICML 2006. Web page classification:  Web page classification Dmoz (http://www.dmoz.org) directory of classified web pages: Considered documents related to Travel and Leisure Considered flat categories: e.g. Theme_Parks/Disney, Travelogues/Middle_East, Preparation/Passports_and_Visas, Transportation/Boating, Recreation/WaterActivities/Scuba_Diving, … For each document (2828) we extracted: Textual information Images corresponding to the root and first level of the linked pages Logos, buttons, too small images were automatically discarded Splitting the data in: 1068 documents containing about 9300 images 1760 “pure” text documents (used to train the PLC) J.-M. Renders, E. Gaussier, C Goutte, F. Pacull and G. Csurka, Categorization in Multiple Category Systems, ICML 2006. Experimental results:  Experimental results All images in Dmoz were manually annotated (the mentioned 35 categories) For text we kept flat Dmoz categories (89) Results are means of 5 fold cross validation J.-M. Renders, E. Gaussier, C Goutte, F. Pacull and G. Csurka, Categorization in Multiple Category Systems, ICML 2006. Good and bad correlation example:  Good and bad correlation example Label: Transportation/Boating Text: Boating Magazine Wins Awards in Boating Writers International the Annual Writing Contest Internet Directory Boat of the Year, The Sea Doo, Sea Ray Sundancer, Boat Test Instant Confidence Do sweat the small stuff Watch streaming videos online Finding Mr. Smoothie, Cat vs. V A scientific approach Party Boat, Play our web game … Label: Flora_and_Fauna\Birding Text: Bird watching on the Greek Island of Lesvos Lesvos is known to the birding world as one of the best locations in Europe to see migrating birds. The island s vast and varied landscape offers numerous species of birds exactly what they want and thus it is a haven not only for birds but for birdwatchers too who arrive in droves in the spring. This is also the best time to see the beautiful display of wildflowers. For people interested in birds the best place to stay is Skala …… J.-M. Renders, E. Gaussier, C Goutte, F. Pacull and G. Csurka, Categorization in Multiple Category Systems, ICML 2006. (i,j) in symmetric re-weighting :  (i,j) in symmetric re-weighting Transportation/Train_and_RailRoads Flora_and Fauna/Underwater Boat Underwater Train SkyActivity Recreation/SkyActivities/Skydiving Recreation/SkyActivities/Ballooning Paintings Recreation/WinterActivities/Ice_Skating Recreation/Fishing Transportation/Limousines_and_Shuttles Transportation/Offroad_Vehicles Fishing Vehicle Travel/Preparation J.-M. Renders, E. Gaussier, C Goutte, F. Pacull and G. Csurka, Categorization in Multiple Category Systems, ICML 2006. Categorization of video data:  Categorization of video data Video segments Cross-media Categorization Text Images Video Segmentation Analysis Keyframe Categorization Image Processing SHOTS ASR + Audio Segmentation Analysis Speech Processing Speaker Identification and Clustering TRANSCRIPTIONS Text Segmentation Analysis Text Processing Text Categorization STORIES Collaborative work within RevealThis EU Project. Categorizer’s improvement example:  Categorizer’s improvement example Keyframes Transcript (manual) Cross Media Categorization Results:  Cross Media Categorization Results 2 videos about Greece was cut in 189 video segments and annotated: based on their multimedia content (40 predefined categories) by two independent annotator groups Evaluated the automatic annotations with these annotations as ground truth For text considered only those categories related to text categories (31) For images considered only those categories related to image categories (33) Conclusion:  Conclusion Generic Visual Categorization (ECCV 2006) Novel approach based on a universal vocabulary and class-specific vocabularies obtained through adaptation Main advantages: low cost, no parameter tuning required no bounding boxes or manual segmentation required scales with the number of categories Multiple View Categorization (ICML 2006) Proposed two re-weighted approaches to handle multiple-view categories Experiments shows that these approaches manage to capture correlation between views, even in the case of noisy training data. Their main advantages are: the models are very simple and be estimated directly from some training data no need for huge amount of training data can be used on top of any existing pre-trained categorizer (without retraining them)

Related presentations


Other presentations created by VolteMort

Global Supply Chain
13. 04. 2008
0 views

Global Supply Chain

Green Accounting CT 2006
18. 04. 2008
0 views

Green Accounting CT 2006

Chapter 01
10. 04. 2008
0 views

Chapter 01

jmkfah
09. 04. 2008
0 views

jmkfah

climate and science 07
07. 04. 2008
0 views

climate and science 07

2006080708
26. 03. 2008
0 views

2006080708

FP7 MTAPU
18. 03. 2008
0 views

FP7 MTAPU

apostles symbols
16. 08. 2007
0 views

apostles symbols

Your First Flex Application
28. 11. 2007
0 views

Your First Flex Application

G070221 00
28. 11. 2007
0 views

G070221 00

how we help you become pregnant
03. 12. 2007
0 views

how we help you become pregnant

greenfieldlrp
03. 10. 2007
0 views

greenfieldlrp

ch4
16. 11. 2007
0 views

ch4

Habitat El Bosque Tropical
20. 11. 2007
0 views

Habitat El Bosque Tropical

ghostgirl
21. 11. 2007
0 views

ghostgirl

serious blow
16. 08. 2007
0 views

serious blow

Gospel
16. 08. 2007
0 views

Gospel

Jesus Feeds 5000
16. 08. 2007
0 views

Jesus Feeds 5000

Exegeting Jesus Parables
16. 08. 2007
0 views

Exegeting Jesus Parables

KNEZEVIC Desimir
04. 10. 2007
0 views

KNEZEVIC Desimir

week9
14. 12. 2007
0 views

week9

coldwar
19. 12. 2007
0 views

coldwar

icde07 hagonzal
23. 11. 2007
0 views

icde07 hagonzal

organic solvents
30. 12. 2007
0 views

organic solvents

ID172 LOGANALY
31. 12. 2007
0 views

ID172 LOGANALY

Meconium
04. 01. 2008
0 views

Meconium

dutch history fo rdummies
11. 12. 2007
0 views

dutch history fo rdummies

life cycle
09. 08. 2007
0 views

life cycle

2006Stats RRT C 5 3
09. 08. 2007
0 views

2006Stats RRT C 5 3

Ethical Issues at End of Life
09. 08. 2007
0 views

Ethical Issues at End of Life

Lecturx7
09. 08. 2007
0 views

Lecturx7

ESI toolkit
07. 11. 2007
0 views

ESI toolkit

Sure of faith
16. 08. 2007
0 views

Sure of faith

HARTLEY WSOWS 20040204
05. 09. 2007
0 views

HARTLEY WSOWS 20040204

Biodiesel web
09. 11. 2007
0 views

Biodiesel web

csce520 lect2
16. 11. 2007
0 views

csce520 lect2

SM Aula 8 v3
28. 12. 2007
0 views

SM Aula 8 v3

33Chris
04. 01. 2008
0 views

33Chris

Celebration of life martha
09. 08. 2007
0 views

Celebration of life martha

life as an astronomer
09. 08. 2007
0 views

life as an astronomer

Ilene Lewis
09. 08. 2007
0 views

Ilene Lewis

Deep Drill Active HT2
09. 08. 2007
0 views

Deep Drill Active HT2

issues
28. 12. 2007
0 views

issues

families
24. 02. 2008
0 views

families

2005 OSD CAIG Presentation
04. 03. 2008
0 views

2005 OSD CAIG Presentation

sears techmission values2005
16. 08. 2007
0 views

sears techmission values2005

GSutter ppts
24. 06. 2007
0 views

GSutter ppts

griffiths LD summit 08nov06 post
24. 06. 2007
0 views

griffiths LD summit 08nov06 post

Griffiths D4L 26apr07 v2
24. 06. 2007
0 views

Griffiths D4L 26apr07 v2

Charlotte English FINAL
12. 03. 2008
0 views

Charlotte English FINAL

FOREIGN POLICY 1920s 1930s
14. 03. 2008
0 views

FOREIGN POLICY 1920s 1930s

Florence Labord Moodle
24. 06. 2007
0 views

Florence Labord Moodle

Einführung MKT Übungen
24. 06. 2007
0 views

Einführung MKT Übungen

kt cohort seminars sep20 2006
24. 06. 2007
0 views

kt cohort seminars sep20 2006

Karpati EPICT Final Review
24. 06. 2007
0 views

Karpati EPICT Final Review

JCampbell ppt
24. 06. 2007
0 views

JCampbell ppt

Boise Police 2 1 05
06. 11. 2007
0 views

Boise Police 2 1 05

Cheryl Keenan COABE 050505
09. 08. 2007
0 views

Cheryl Keenan COABE 050505

Lum db v1
16. 08. 2007
0 views

Lum db v1

2007 April Poll Powerpoint
05. 09. 2007
0 views

2007 April Poll Powerpoint

Viennot
02. 10. 2007
0 views

Viennot

EUROPEAN E INVESTOR 20040921
03. 10. 2007
0 views

EUROPEAN E INVESTOR 20040921

PulmonaryThromboembo lism
19. 11. 2007
0 views

PulmonaryThromboembo lism

Raffle Pandemic Flu Planning
05. 09. 2007
0 views

Raffle Pandemic Flu Planning

Face
11. 10. 2007
0 views

Face

navypowerpt
30. 11. 2007
0 views

navypowerpt

IHSLG CPD ERes RCSI 07
24. 06. 2007
0 views

IHSLG CPD ERes RCSI 07

retreat petery
16. 08. 2007
0 views

retreat petery

Open Day talk StudentLife
05. 12. 2007
0 views

Open Day talk StudentLife

LSIDs
09. 08. 2007
0 views

LSIDs

HF diff
16. 08. 2007
0 views

HF diff

IKT taikymas pradiniame ugdyme
24. 06. 2007
0 views

IKT taikymas pradiniame ugdyme

Dylan Symposium Presentation
09. 08. 2007
0 views

Dylan Symposium Presentation

Are We There Yet
16. 08. 2007
0 views

Are We There Yet

h0ykom ren
24. 06. 2007
0 views

h0ykom ren

hAykom ren
24. 06. 2007
0 views

hAykom ren

Halton Data Fair Winner MsNeilly
09. 08. 2007
0 views

Halton Data Fair Winner MsNeilly

careers 07
09. 08. 2007
0 views

careers 07

IBC05B
02. 01. 2008
0 views

IBC05B

Eating the Elephant
26. 11. 2007
0 views

Eating the Elephant

LSLR pt2
09. 08. 2007
0 views

LSLR pt2

pgeog251 ch18 af
27. 11. 2007
0 views

pgeog251 ch18 af

henny eyova
24. 06. 2007
0 views

henny eyova

ksypolitos SCH TelematicServices
24. 06. 2007
0 views

ksypolitos SCH TelematicServices

Morgan town 2007
09. 08. 2007
0 views

Morgan town 2007

IMS State of Open Source 0606
24. 06. 2007
0 views

IMS State of Open Source 0606

h dillon training shoestring
24. 06. 2007
0 views

h dillon training shoestring

Click on SUNY for internetII
05. 09. 2007
0 views

Click on SUNY for internetII

kruul
24. 06. 2007
0 views

kruul

228 210 RSCEast PowerPressed
24. 06. 2007
0 views

228 210 RSCEast PowerPressed

kanayama
24. 06. 2007
0 views

kanayama

Businessplan NYSERnet
05. 09. 2007
0 views

Businessplan NYSERnet

gse program
24. 06. 2007
0 views

gse program

ica 20105 cert 2 it 2007
24. 06. 2007
0 views

ica 20105 cert 2 it 2007

Mukherjee sbatransition
09. 08. 2007
0 views

Mukherjee sbatransition

Kinsinger VA
09. 08. 2007
0 views

Kinsinger VA

ALA05O lszewski
29. 11. 2007
0 views

ALA05O lszewski

lec12 04 lcca
09. 08. 2007
0 views

lec12 04 lcca

I GIG2
16. 08. 2007
0 views

I GIG2