reliable multicast

Information about reliable multicast

Published on October 3, 2007

Author: Kestrel

Source: authorstream.com

Content

Reliable Multicast Transport for Distributed Middleware:  Reliable Multicast Transport for Distributed Middleware Gidon Gershinsky IBM Haifa Research Lab Talk outline:  Talk outline IP multicast overview IETF Market adoption Our work IP Multicast:  IP Multicast Deering’s PhD, 1988 RFC1112 “Host extensions for IP multicast”, 1989 D class of IP addresses: 224.0.0.1 – 239.255.255.255 Administratively scoped multicast (RFC 2365) 239.0.0.0 - 239.255.255.255 IP, UDP. Win*, Unix, Linux, AS. Java (UDP). Ethernet, TokenRing, FDDI. Satellite. Cisco and Nortel routers. “Without a doubt, multicast has become a hot topic“ “Next year is the year of multicast”. IP to Ethernet:  IP to Ethernet Ethernet multicast: 23 low-order bits of IP multicast address are placed to 01.00.5E.00.00.00 Switching:  Switching Switches: default “on” CGMP (Cisco Group Management Protocol) Must be configured on both routers and Layer 2 switches. Receiver: IGMP “join” to router. Router: CGMP join to switch. IGMP snooping Eavesdrop on Layer 3 IGMP messages. Must examine every multicast packet – not suitable for low-end switches. Can require dedicated h/w circuits. Routing:  Routing Routers: default “off” Dense mode: flood and prune Reverse Path Forwarding (RPF) PIM-DM, DVMRM Dense mode: explicit topology MOSPF Sparse mode: rendezvous points PIM-SM Cisco: PIM-DM, PIM-SM IGMP: v2 – active leave, v3 – ssm (s,g) PIM-SM:  PIM-SM Reliable Multicast:  Reliable Multicast "no single reliable multicast protocol will likely meet the needs of all applications" RFC 2357 Transport characteristics Reliability Real-time delivery Number of transmitters Late joins Network topology Reliability - protocol families (RFC 3048): Negative Acknowledgment (NACK) Tree-based ACK Asynchronous Layered Coding (ALC) Router assist Reliable Multicast:  Reliable Multicast Bulk Data Corporate data, server cache replication, software distribution Files, large memory segments Static Full reliability, no real-time, one sender Streaming Data Stock quotes, news, video, audio Messages, v/a formats Dynamic Full-to-none reliability reqs, varying real-time reqs, one/few sender(s) Collaborative Whiteboard interaction, multimedia conference Short messages, v/a formats Dynamic and/or static Full-to-moderate reliability reqs, moderate real-time reqs, many senders IETF RMT WG:  IETF RMT WG No standard protocol defined. “Building Blocks” (RFC 2887) for One-to-many bulk-data transfer (RFC 3048) Nack-oriented reliable multicast (Draft) Tree-ACK (TRACK) reliable multicast (Draft) Layered-coding transport (Draft) Generic Router Assist (Draft) Forward Error Correction (Draft) Tree Auto-Configuration (Draft) IETF WGs:  IETF WGs Multicast-Address Allocation (malloc) Multicast Security (msec) Group key management Subset-Difference (Dalit Naor, IBM Haifa) Source-Specific Multicast (ssm) (source IP, mcast group) Protocol- Independent Multicast (PIM) Inter-Domain Multicast Routing (idmr) DVMRP Nack-based reliability:  Nack-based reliability PGM protocol, Experimental RFC 3208 Packet stream; transmission window Nack suppression Exponential t = T/L*ln(x*(exp(L)-1)*(T/L)) Dependent on gap size Designated local repairers (DLR) Network Elements Additional Nack suppression Repair data filtering Cisco router support Erasure codes:  Erasure codes a.k.a Forward Error Correction Salomon-Reed codes: Improve scalability by reducing (Nack) feedback traffic. k packets -> k+n packets. Streaming data Proactive encoding Reactive encoding “Tornado codes”: k packets -> infinite number Content distribution. No backlink. Congestion Control:  Congestion Control Datagram (IP or UDP) traffic is unfair to self-managed data streams (inc TCP). No standard. Feedback from end-points (receivers) and network elements. Nack suppression. TCP-friendly CC: Rate ~ mtu/(rtt*sqrt(loss)) TCP-like window slide, ACKer selection. Worst-throughput. “Crying-baby” problem. Layered Architecture:  Layered Architecture Same (or multi-layer) data - to a number of multicast groups. Possibly no feedback Static layer scheme Base group, r0. r1=r0*k, r2=r0*k^2, etc Time slots Leave if packet lost Join new if zero loss and trigger set Receiver-driven congestion control Equation-based reception rate, RTT measured by e.g. the time required to join. Dynamic layer scheme:  Dynamic layer scheme “Wave and Equation Based Rate Control, WEBRC” Leave latency (IGMP v1 + leave propagation) G groups, A – active, G-A - quiescent. r(G)=0, r(G-1)=0,…,r(A+1)=0,r(A),r(A-1),…,r(1) Group j, timeslot t, rate is r(((j-t-1) mod G)+1) Always join the base group. Must leave quiescent wave groups. Marketplace:  Marketplace Enterprise “Middleware”. No use in public internet domain, private customers. Messaging (JMS and like) Tibco: Rendezvous “reliable broadcast” or multicast 60-second limit, probably Nack mechanism Routing daemons: subnet and wide-area Talarian: PGM implementation Pro/re-active FEC Network elements: Host implementation Bought by Tibco 01/2002 110m$ Marketplace:  Marketplace Messaging (cont) Microsoft: PGM for MSMQ SoftWired Proprietary protocol (nack-based) JMS Automatic assignment of topics to mcast groups Positive ACK for “epoch” Scalable to ~100 Fiorano Proprietary protocol (nack-based) Uses standard mcast-routers Uses one multicast group only Marketplace:  Marketplace Content (bulk data) delivery Digital Fountain FEC (Tornado-style erasure codes) Useful for unicast streams as well, e.g. on long distance links Bandwiz Proprietary patented FEC algorithm Cluster synchronization (Horus-style) BEA (WebLogic server cluster) Software replication Symantec “Norton Ghost Tool” Multimedia real-time streams IBM Haifa:  IBM Haifa Enterprise middleware environment NACK, FEC reliability mechanisms Security Congestion control Message streams, bulk data (files) delivery Burst suppression:  Burst suppression small messages at extreme rates (Nagle-like algorithm) P = A + B*Size. Cisco 2500 Router: Hub-centric distribution:  Hub-centric distribution Message stream concatenation Extreme storage demands Reliability definition B = T*Rate; Tmin depends on Loss, Nrec Persistence SSD technologies Topic mapping to groups:  Topic mapping to groups Limited number of multicast groups Ti1,..,Tin(i) -> Gi, i=1,…,Ng Sk subscribes to {T}. Will get {T} and {Tr} Perform mapping taking into account: Topic load Network topology Receiver characteristics, interest correlation Dynamic re-mapping as congestion control tool Publications:  Publications Patent on Nack suppression (filed) Patent on Multidocument multicasting (filed) Patent on Multicast Caching (filed) Paper on Networked Group Communication (to be submitted)

Related presentations


Other presentations created by Kestrel

English Literature
16. 02. 2008
0 views

English Literature

birth control
10. 10. 2007
0 views

birth control

ramasetu22may2007 1796
30. 09. 2007
0 views

ramasetu22may2007 1796

purpletree
07. 10. 2007
0 views

purpletree

Verdi
08. 10. 2007
0 views

Verdi

preschool
11. 10. 2007
0 views

preschool

playingwithliterature
12. 10. 2007
0 views

playingwithliterature

mlin2
15. 10. 2007
0 views

mlin2

cartoon pool a d
15. 10. 2007
0 views

cartoon pool a d

J1
16. 10. 2007
0 views

J1

Corps Safety Council 24 Jul 06
18. 10. 2007
0 views

Corps Safety Council 24 Jul 06

Discovery of Cosmic Rays
13. 10. 2007
0 views

Discovery of Cosmic Rays

State of Georgia Sunum
17. 10. 2007
0 views

State of Georgia Sunum

North Africa
23. 10. 2007
0 views

North Africa

slides ch10
01. 11. 2007
0 views

slides ch10

LaoTzu2
04. 12. 2007
0 views

LaoTzu2

drying
07. 12. 2007
0 views

drying

Mikheev SPM210207
15. 10. 2007
0 views

Mikheev SPM210207

benelux intervet 09 12 2004
16. 10. 2007
0 views

benelux intervet 09 12 2004

mpls
29. 10. 2007
0 views

mpls

Network Series Overview
30. 10. 2007
0 views

Network Series Overview

wu zixin defense
01. 11. 2007
0 views

wu zixin defense

Chapter1
02. 11. 2007
0 views

Chapter1

20050812
23. 10. 2007
0 views

20050812

olnes pki interoperability
07. 11. 2007
0 views

olnes pki interoperability

TomGibbs
21. 10. 2007
0 views

TomGibbs

Presentaci n RSC EFQM francais
16. 11. 2007
0 views

Presentaci n RSC EFQM francais

Parts of a Flower
14. 12. 2007
0 views

Parts of a Flower

L1Ch3 2
17. 12. 2007
0 views

L1Ch3 2

dyfi pathfinder presentation
02. 11. 2007
0 views

dyfi pathfinder presentation

Robot
03. 01. 2008
0 views

Robot

2004Summary
03. 01. 2008
0 views

2004Summary

sdocjung e
09. 10. 2007
0 views

sdocjung e

MOM 7
15. 10. 2007
0 views

MOM 7

01 what is AI
04. 01. 2008
0 views

01 what is AI

Do Air Cleaners Work
19. 11. 2007
0 views

Do Air Cleaners Work

transporte maritimo en CA
22. 10. 2007
0 views

transporte maritimo en CA

Wind Hedges905 2 ppt
04. 10. 2007
0 views

Wind Hedges905 2 ppt

richard hansberger
03. 10. 2007
0 views

richard hansberger

EspositoNOW2006
15. 10. 2007
0 views

EspositoNOW2006

Lochbuhler
17. 10. 2007
0 views

Lochbuhler

PRES Canada US Market
29. 10. 2007
0 views

PRES Canada US Market

davereese july99
30. 10. 2007
0 views

davereese july99

884 philmont05 finalpreparations
28. 11. 2007
0 views

884 philmont05 finalpreparations

ch2 voc2
20. 02. 2008
0 views

ch2 voc2

1 74presentation
19. 10. 2007
0 views

1 74presentation

The Causes of War
06. 03. 2008
0 views

The Causes of War

BF CCC conf 2
23. 11. 2007
0 views

BF CCC conf 2

IndustryForumSlidesF eb16
11. 03. 2008
0 views

IndustryForumSlidesF eb16

EAGER UNECE 2007
15. 10. 2007
0 views

EAGER UNECE 2007

spin05 coverity
26. 02. 2008
0 views

spin05 coverity

IM845
24. 03. 2008
0 views

IM845

PresentationAbridged
03. 10. 2007
0 views

PresentationAbridged

chap08 ppt10thedition
08. 04. 2008
0 views

chap08 ppt10thedition

Be Happier Smarter And Healthier
26. 09. 2007
0 views

Be Happier Smarter And Healthier

benefits e
25. 10. 2007
0 views

benefits e

crec ipv6 apan 2
09. 10. 2007
0 views

crec ipv6 apan 2

Cisco Dec4
18. 04. 2008
0 views

Cisco Dec4

Graphplan
30. 10. 2007
0 views

Graphplan

Patoka Final ALS poster
26. 11. 2007
0 views

Patoka Final ALS poster

real options
28. 04. 2008
0 views

real options

Anderson
07. 05. 2008
0 views

Anderson

The Future of Healthcare
08. 05. 2008
0 views

The Future of Healthcare

Lecture22
08. 05. 2008
0 views

Lecture22

prairiechicken
03. 01. 2008
0 views

prairiechicken

PediatricObesityProb lem
30. 04. 2008
0 views

PediatricObesityProb lem

Innovation
02. 05. 2008
0 views

Innovation

PassingGas Dr Railton
02. 05. 2008
0 views

PassingGas Dr Railton

Guide Lines for Bladder Cancer
02. 05. 2008
0 views

Guide Lines for Bladder Cancer

MECH500
02. 05. 2008
0 views

MECH500

l3
23. 11. 2007
0 views

l3

smallpoxmaster
21. 10. 2007
0 views

smallpoxmaster

endeavour 1 00
21. 11. 2007
0 views

endeavour 1 00

backgr
19. 10. 2007
0 views

backgr

Copenhagen
12. 10. 2007
0 views

Copenhagen

presentacion valparaiso
24. 10. 2007
0 views

presentacion valparaiso

ZP582pp
23. 10. 2007
0 views

ZP582pp

pre e301
21. 10. 2007
0 views

pre e301

Riesgo
31. 10. 2007
0 views

Riesgo

Gallick 1 10 07
16. 10. 2007
0 views

Gallick 1 10 07

podcastingagnews
08. 10. 2007
0 views

podcastingagnews

Berton Astronomie par Internet
15. 11. 2007
0 views

Berton Astronomie par Internet

jean michel lauren
11. 04. 2008
0 views

jean michel lauren

Shining Examples 2007
29. 10. 2007
0 views

Shining Examples 2007

lecture9
10. 12. 2007
0 views

lecture9

kathyppt
06. 11. 2007
0 views

kathyppt

Lawrence CAS2K3
28. 12. 2007
0 views

Lawrence CAS2K3

swieta
20. 11. 2007
0 views

swieta