<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>CCIE Blog &#187; Service Provider</title>
	<atom:link href="http://blog.ipexpert.com/category/ccie/service-provider/feed/" rel="self" type="application/rss+xml" />
	<link>http://blog.ipexpert.com</link>
	<description>CCIE Candidates blog for all technical overviews relating to CCIE R&#38;S, CCIE Voice, CCIE Security &#38; CCIE SP</description>
	<lastBuildDate>Thu, 09 Feb 2012 14:05:20 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.1.2</generator>
		<item>
		<title>Multi-Homed BGP and Policy-Based Routing</title>
		<link>http://blog.ipexpert.com/2012/02/08/multi-homed-bgp-and-policy-based-routing/</link>
		<comments>http://blog.ipexpert.com/2012/02/08/multi-homed-bgp-and-policy-based-routing/#comments</comments>
		<pubDate>Wed, 08 Feb 2012 15:19:19 +0000</pubDate>
		<dc:creator>Marko Milivojevic</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[BGP]]></category>
		<category><![CDATA[PBR]]></category>
		<category><![CDATA[r&s]]></category>
		<category><![CDATA[sp]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=10117</guid>
		<description><![CDATA[This blog explores another interesting question a student of ours asked the other day. His network is dual-homed to two ISPs on a single router. He wanted to make sure one of his subnets is always routed over ISP-1 and the other over ISP-2, unless there is a network failure. There was also a requirement [...]]]></description>
			<content:encoded><![CDATA[<p>This blog explores another interesting question a student of ours asked the other day. His network is dual-homed to two ISPs on a single router. He wanted to make sure one of his subnets is always routed over ISP-1 and the other over ISP-2, unless there is a network failure. There was also a requirement for the return traffic to take the same route, i.e. no asymmetric routing. This will be a fun one to solve.<span id="more-10117"></span></p>
<p>First of all, let&#8217;s take a look at the testbed network we can use for this situation.</p>
<p>&nbsp;</p>
<p><img title="BGP-PBR" src="http://blog.ipexpert.com/wp-content/uploads/2012/02/BGP-PBR.png" alt="BGP-PBR" />&nbsp;</p>
<p>In this scenario, routers R2 and R5 represent the two ISPs. Routers R6 and R9 represent our internal network, with two subnets we need to route differently represented by Loopback interfaces Loopback9 (9.9.9.0/24 subnet) and Loopback99 (from a 99.99.99.0/24 subnet) on R9. Router R4 represents a host &#8220;somewhere&#8221; on the Internet we&#8217;ll be using for testing. We&#8217;ll pretend to have no access to change any configurations on Internet routers, so only routers R6 and R9 are available to us. Let&#8217;s see the initial configurations and clarify few things there.</p>
<h2>Initial Network Configuration</h2>
<p>R2:</p>
<pre class="config">interface GigabitEthernet0/0
 ip address 172.16.24.2 255.255.255.0
!
interface GigabitEthernet0/1
 ip address 172.16.26.2 255.255.255.0
!
router bgp 65002
 neighbor 172.16.24.4 remote-as 65004
 neighbor 172.16.26.6 remote-as 65069
 address-family ipv4
  neighbor 172.16.24.4 activate
  neighbor 172.16.24.4 send-community
  neighbor 172.16.26.6 activate
  neighbor 172.16.26.6 send-community
!</pre>
<p>Router R4 is a dual-homed, just like our AS is. We&#8217;re using a simple configuration to prevent transit. We will apply a very similar configuration in our AS later.</p>
<p>R4:</p>
<pre class="config">interface Loopback4
 ip address 10.0.0.4 255.255.255.255
!
interface FastEthernet0/0
 ip address 172.16.24.4 255.255.255.0
!
interface FastEthernet0/1
 ip address 172.16.45.4 255.255.255.0
!
router bgp 65004
 neighbor 172.16.24.2 remote-as 65002
 neighbor 172.16.45.5 remote-as 65005
 address-family ipv4
  neighbor 172.16.24.2 activate
  neighbor 172.16.24.2 send-community
  neighbor 172.16.24.2 route-map NO-TRANSIT in
  neighbor 172.16.45.5 activate
  neighbor 172.16.45.5 send-community
  neighbor 172.16.45.5 route-map NO-TRANSIT in
  network 10.0.0.4 mask 255.255.255.255
!
route-map NO-TRANSIT permit 10
 set community no-advertise
!</pre>
<p>R5:</p>
<pre class="config">interface FastEthernet0/0
 ip address 172.16.56.5 255.255.255.0
!
interface FastEthernet0/1
 ip address 172.16.45.5 255.255.255.0
!
router bgp 65005
 neighbor 172.16.45.4 remote-as 65004
 neighbor 172.16.56.6 remote-as 65069
 address-family ipv4
  neighbor 172.16.45.4 activate
  neighbor 172.16.45.4 send-community
  neighbor 172.16.56.6 activate
  neighbor 172.16.56.6 send-community
!</pre>
<p>Similarly to the configuration on R4, we need to prevent the transit between our ISPs. However, we can&#8217;t use the &#8220;no-advertise&#8221; community here, since we need to advertise the received route(s) to R9. This is easily fixed using &#8220;no-export&#8221; community instead.</p>
<p>R6:</p>
<pre class="config">interface FastEthernet0/0
 ip address 172.16.56.6 255.255.255.0
!
interface FastEthernet0/1
 ip address 172.16.26.6 255.255.255.0
!
interface Serial0/2/0
 ip address 192.168.69.6 255.255.255.0
!
router bgp 65069
 neighbor 172.16.26.2 remote-as 65002
 neighbor 172.16.56.5 remote-as 65005
 neighbor 192.168.69.9 remote-as 65069
 address-family ipv4
  neighbor 172.16.26.2 activate
  neighbor 172.16.26.2 send-community
  neighbor 172.16.26.2 route-map NO-TRANSIT in
  neighbor 172.16.56.5 activate
  neighbor 172.16.56.5 send-community
  neighbor 172.16.56.5 route-map NO-TRANSIT in
  neighbor 192.168.69.9 activate
  neighbor 192.168.69.9 send-community
  neighbor 192.168.69.9 next-hop-self
!
route-map NO-TRANSIT permit 10
 set community no-export
!</pre>
<p>R9:</p>
<pre class="config">interface Loopback9
 ip address 9.9.9.9 255.255.255.255
!
interface Loopback99
 ip address 99.99.99.99 255.255.255.255
!
interface Serial0/2/0
 ip address 192.168.69.9 255.255.255.0
!
router bgp 65069
 neighbor 192.168.69.6 remote-as 65069
 address-family ipv4
  neighbor 192.168.69.6 activate
  neighbor 192.168.69.6 send-community
  network 9.9.9.0 mask 255.255.255.0
  network 99.99.99.0 mask 255.255.255.0
!</pre>
<p>At this point, router R9 should be able to reach Loopback4 interface advertised by R4 from its Loopback9 and Loopback99 interfaces. Let&#8217;s give it a go.</p>
<p>R9:</p>
<pre>R9#ping 10.0.0.4 source Loopback9

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 10.0.0.4, timeout is 2 seconds:
Packet sent with a source address of 9.9.9.9
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 1/3/4 ms
R9#ping 10.0.0.4 source Loopback99

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 10.0.0.4, timeout is 2 seconds:
Packet sent with a source address of 99.99.99.99
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 1/2/4 ms</pre>
<p>This works as expected. Now, lets&#8217; work on our &#8220;traffic engineering&#8221;.</p>
<h2>Chosing Different Paths from R9</h2>
<p>Let&#8217;s say that our goal is to make the traffic between 9.9.9.0/24 and 10.0.0.0/24 take the path R9-&gt;R6-&gt;R2-&gt;R4, while the traffic between 99.99.99.0/24 needs to take the R9-&gt;R6-&gt;R5-&gt;R4 path. We can easily fix this issue using a simple policy-based routing (PBR) configuration on R6.</p>
<p>All we need is to match the source of traffic when it enters R6 from R9 and force it down the specific path. For example, a policy like this may do the trick.</p>
<pre class="config">ip access-list standard Network-9
 permit 9.9.9.0 0.0.0.255
!
ip access-list standard Network-99
 permit 99.99.99.0 0.0.0.255
!
route-map Force-Path permit 10
 match ip address Network-9
 set ip next-hop 172.16.26.2
!
route-map Force-Path permit 20
 match ip address Network-99
 set ip next-hop 172.16.56.5
!
interface Serial0/2/0
 ip policy route-map Force-Path
!</pre>
<p>We could apply this policy and be done with it. However, there are couple of problems with this. What if the next-hop is not reachable? For example, the remote router crashes, the switch between R6 and R2/R5 drops the packets, etc? We would be black-holing the traffic. This is not a good thing in any kind of a production environment. Is there a way to solve this? As it turns out, there is. We can actually monitor the exit interface, next-hop route, as well as the next-hop itself, using object tracking. We can then have a conditional policy that will be taken into account only when all of these parameters are in place and operational. So, the policy I&#8217;m going to apply is <em>a little bit</em> more involved:</p>
<p>R6:</p>
<pre class="config">ip access-list standard Network-9
 permit 9.9.9.0 0.0.0.255
!
ip access-list standard Network-99
 permit 99.99.99.0 0.0.0.255
!
track 2 list boolean and
 object 21
 object 22
 object 23
!
track 5 list boolean and
 object 51
 object 52
 object 53
!
track 21 interface FastEthernet0/1 ip routing
track 22 ip route 172.16.26.0 255.255.255.0 reachability
track 23 ip sla 2
track 51 interface FastEthernet0/0 ip routing
track 52 ip route 172.16.56.0 255.255.255.0 reachability
track 53 ip sla 2
!
ip sla 2
 icmp-echo 172.16.26.2 source-ip 172.16.26.6
ip sla schedule 2 life forever start-time now
!
ip sla 5
 icmp-echo 172.16.56.5 source-ip 172.16.56.6
ip sla schedule 5 life forever start-time now
!
route-map Force-Path permit 10
 match ip address Network-9
 set ip next-hop verify-availability 172.16.26.2 10 track 2
!
route-map Force-Path permit 20
 match ip address Network-99
 set ip next-hop verify-availability 172.16.56.5 10 track 5
!
interface Serial0/2/0
 ip policy route-map Force-Path
!</pre>
<p>That&#8217;s a lot to handle in one go. Let&#8217;s break it down a little bit. First off, I start by defining track lists. Track lists are simply multiple tracking objects that will be compared using a single boolean logic. In this case, I have three sub-objects I&#8217;m tracking and I&#8217;m combining them using &#8220;and&#8221; logic. In plain English, this means the track list will be &#8220;up&#8221; if all monitored sub-objects are &#8220;up&#8221;. The three objects are exit interface&#8217;s routing status, next-hop route and the next-hop reachability, which we monitor using IP SLA ICMP-Echo (ping) probe. Finally, it all comes together in a route-map, which uses &#8220;verify-availability&#8221; keyword to track the next-hop. Let&#8217;s see if it all works.</p>
<p>R6:</p>
<pre>R6#show track 2
Track 2
  List boolean and
  Boolean AND is Up
    2 changes, last change 00:03:34
    object 21 Up
    object 22 Up
    object 23 Up
  Tracked by:
    ROUTE-MAP 0

R6#show track 5
Track 5
  List boolean and
  Boolean AND is Up
    2 changes, last change 00:03:36
    object 51 Up
    object 52 Up
    object 53 Up
  Tracked by:
    ROUTE-MAP 0

R6#show ip policy
Interface      Route map
Serial0/2/0    Force-Path</pre>
<p>R9:</p>
<pre>R9#traceroute 10.0.0.4 source Loopback9 

Type escape sequence to abort.
Tracing the route to 10.0.0.4

  1 192.168.69.6 0 msec 4 msec 0 msec
  2 172.16.26.2 4 msec 0 msec 0 msec
  3 172.16.24.4 4 msec *  0 msec

R9#traceroute 10.0.0.4 source Loopback99

Type escape sequence to abort.
Tracing the route to 10.0.0.4

  1 192.168.69.6 4 msec 0 msec 0 msec
  2 172.16.56.5 4 msec 0 msec 4 msec
  3 172.16.45.4 0 msec *  0 msec</pre>
<p>This seems to be working, as we expected. What about the return traffic?</p>
<p>R4:</p>
<pre>R4#traceroute 9.9.9.9 source Loopback4

Type escape sequence to abort.
Tracing the route to 9.9.9.9

  1 172.16.24.2 0 msec 0 msec 4 msec
  2 172.16.26.6 0 msec 0 msec 0 msec
  3 192.168.69.9 0 msec *  0 msec
R4#traceroute 99.99.99.99 source Loopback4

Type escape sequence to abort.
Tracing the route to 99.99.99.99

  1 172.16.24.2 0 msec 0 msec 4 msec
  2 172.16.26.6 0 msec 4 msec 0 msec
  3 192.168.69.9 0 msec *  0 msec</pre>
<p>We can clearly see that R4 is preferring the path R4-&gt;R2-&gt;R6-?R9 for both destinations. This means that the traffic between 10.0.0.0/24 and 99.99.99.0/24 networks is taking the asymmetric route, which was one of the things we needed to avoid. Let&#8217;s handle that part now.</p>
<h2>Chosing Different Paths from R4</h2>
<p>Let&#8217;s not be misguided by the subtitle. Remember that R4 is just another Internet host. We can&#8217;t modify any configuration on it, yet we need to influence the decisions it makes.</p>
<p>Possibly the simplest solution in this case would be to take the 9.9.9.0/24 network and prepend our AS when advertising it to R5 and do the same for 99.99.99.0/24 when advertising to R2. In the lab environment, this works like a charm. In real life, all our prepending can be easily overridden with a higher local preference or a similar thing. We can only <em>hint</em> our preference for the incoming traffic &#8211; we cannot decide it. It would also be a very simple thing to do. I don&#8217;t like simple things, so let&#8217;s complicate our solution a little bit.</p>
<p>There is one thing in IP routing that trumps all weights, local preferences and as-paths of this world. It&#8217;s a rule that &#8220;more specific route always wins&#8221;. How about we use that solution for our return traffic? Let&#8217;s inject 9.9.9.0/25 and 9.9.9.128/25 towards R2, and 99.99.99.0/25 and 99.99.99.128/25 towards R5. That way, R2 will advertise more specific 9.0.0.0/24 subnets and R5 will do the same for 99.0.0.0/24. To prevent black-holing, we&#8217;ll keep advertising both original /24 routes to both R2 and R5. Let&#8217;s take a look at that solution.</p>
<p>R6:</p>
<pre class="config">ip prefix-list Network-Inject-9 seq 10 permit 9.9.9.0/25
ip prefix-list Network-Inject-9 seq 20 permit 9.9.9.128/25
!
ip prefix-list Network-Inject-99 seq 10 permit 99.99.99.0/25
ip prefix-list Network-Inject-99 seq 20 permit 99.99.99.128/25
!
ip prefix-list Network-Match-9 seq 10 permit 9.9.9.0/24
!
ip prefix-list Network-Match-99 seq 10 permit 99.99.99.0/24
!
ip prefix-list R9 seq 5 permit 192.168.69.9/32
!
route-map Inject permit 10
 set ip address prefix-list Network-Inject-9
!
route-map Inject permit 20
 set ip address prefix-list Network-Inject-99
!
route-map Match permit 10
 match ip address prefix-list Network-Match-9
 match ip route-source prefix-list R9
!
route-map Match permit 20
 match ip address prefix-list Network-Match-99
 match ip route-source prefix-list R9
!
route-map Filter-Specific-R2 deny 10
 match ip address prefix-list Network-Inject-99
!
route-map Filter-Specific-R2 permit 20
!
route-map Filter-Specific-R5 deny 10
 match ip address prefix-list Network-Inject-9
!
route-map Filter-Specific-R5 permit 20
!
router bgp 65069
 address-family ipv4
  bgp inject-map Inject exist-map Match copy-attributes
  neighbor 172.16.26.2 route-map Filter-Specific-R2 out
  neighbor 172.16.56.5 route-map Filter-Specific-R5 out
!</pre>
<p>Again, quite a long configuration is in front of us. To solve the problem at hand, I&#8217;m using a BGP feature called &#8220;inject-map&#8221;. This feature works by referencing two route-maps, one to specify the routes to be injected and the other one to specify when these routes should be injected. In this case, my injection map is called &#8220;Inject&#8221; and the selection route-map is called &#8220;Match&#8221;. This is where simplicity ends and &#8220;IOS mind tricks&#8221; begin.</p>
<p>BGP inject-map feature is a tricky one. The &#8220;match&#8221; route-map <strong>must</strong> use two prefix-lists; one to match the source of the route (in our case a prefix-list called R9) and the second one to specify the routes to be considered as a condition for injection. We&#8217;re using two separate routes as triggers and for some odd reason, we must use two route-map entries to solve this problem. Each of these entries specifies a different prefix-list for the trigger route (Network-Match-9 and Network-Match-99).</p>
<p>The &#8220;injection&#8221; route-map works in a similar fashion. We have two-entry route-map, which uses two separate prefix-lists to inject more specific routes. These prefix-lists are Network-Inject-9 and Network-Inject-99. At this point, we should have all those more-specific routes in the BGP table on R6.</p>
<p>R6:</p>
<pre>R6#show ip bgp | begin Network
   Network          Next Hop            Metric LocPrf Weight Path
<span style="background-color: yellow; color: black;">*&gt;i9.9.9.0/25       192.168.69.9             0    100      0 i</span>
*&gt;i9.9.9.0/24       192.168.69.9             0    100      0 i
<span style="background-color: yellow; color: black;">*&gt;i9.9.9.128/25     192.168.69.9             0    100      0 i</span>
*&gt; 10.0.0.4/32      172.16.26.2                            0 65002 65004 i
*                   172.16.56.5                            0 65005 65004 i
<span style="background-color: yellow; color: black;">*&gt;i99.99.99.0/25    192.168.69.9             0    100      0 i</span>
*&gt;i99.99.99.0/24    192.168.69.9             0    100      0 i
<span style="background-color: yellow; color: black;">*&gt;i99.99.99.128/25  192.168.69.9             0    100      0 i</span></pre>
<p>The very last bit is to make sure the injected routes are advertised only to those neighbors we want them advertised to. For this purpose, I used Filter-Specific-R2 and Filter-Specific-R5 route-maps. If we examine routes received from R6 on R2 and R5, we should see a different picture on each.</p>
<p>R2:</p>
<pre>R2#show ip bgp neighbors 172.16.26.6 routes | begin Network
   Network          Next Hop            Metric LocPrf Weight Path
*&gt; 9.9.9.0/25       172.16.26.6                            0 65069 i
*&gt; 9.9.9.0/24       172.16.26.6                            0 65069 i
*&gt; 9.9.9.128/25     172.16.26.6                            0 65069 i
*&gt; 99.99.99.0/24    172.16.26.6                            0 65069 i

Total number of prefixes 4</pre>
<p>R5:</p>
<pre>R5#show ip bgp neighbors 172.16.56.6 routes | begin Network
   Network          Next Hop            Metric LocPrf Weight Path
*&gt; 9.9.9.0/24       172.16.56.6                            0 65069 i
*&gt; 99.99.99.0/25    172.16.56.6                            0 65069 i
*&gt; 99.99.99.0/24    172.16.56.6                            0 65069 i
*&gt; 99.99.99.128/25  172.16.56.6                            0 65069 i

Total number of prefixes 4</pre>
<p>This is exactly what I wanted to see. Last, but not the least, the routing table on R4 should also tell us that our solution worked. We&#8217;ll also confirm all this with two tracroutes.</p>
<p>R4:</p>
<pre>R4#show ip route bgp
     99.0.0.0/8 is variably subnetted, 3 subnets, 2 masks
B       99.99.99.0/25 [20/0] via 172.16.45.5, 00:09:26
B       99.99.99.0/24 [20/0] via 172.16.45.5, 00:09:26
B       99.99.99.128/25 [20/0] via 172.16.45.5, 00:09:26
     9.0.0.0/8 is variably subnetted, 3 subnets, 2 masks
B       9.9.9.0/25 [20/0] via 172.16.24.2, 00:09:25
B       9.9.9.0/24 [20/0] via 172.16.45.5, 00:09:26
B       9.9.9.128/25 [20/0] via 172.16.24.2, 00:09:25

R4#traceroute 9.9.9.9 source Loopback4    

Type escape sequence to abort.
Tracing the route to 9.9.9.9

  1 172.16.24.2 0 msec 0 msec 4 msec
  2 172.16.26.6 0 msec 0 msec 0 msec
  3 192.168.69.9 0 msec *  0 msec

R4#traceroute 99.99.99.99 source Loopback4

Type escape sequence to abort.
Tracing the route to 99.99.99.99

  1 172.16.45.5 0 msec 0 msec 0 msec
  2 172.16.56.6 4 msec 0 msec 0 msec
  3 192.168.69.9 4 msec *  0 msec</pre>
<p>There we go, a perfect solution, for a very real problem. Do you have an alternative solution to this? If you do, please post it in the comments below!</p>
<p>Happy studies!</p>
<p>&#8211;<br />
<a href="http://facebook.com/ccie18427" target="_blank">Marko Milivojevic</a> &#8211; CCIE #18427<br />
Senior CCIE Instructor &#8211; <a href="http://www.ipexpert.com/" target="_blank">IPexpert</a><br />
Join our <a href="http://www.onlinestudylist.com/" target="_blank">Online Study List</a></p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/02/08/multi-homed-bgp-and-policy-based-routing/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/02/08/multi-homed-bgp-and-policy-based-routing/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/02/08/multi-homed-bgp-and-policy-based-routing/feed/</wfw:commentRss>
		<slash:comments>6</slash:comments>
		</item>
		<item>
		<title>Chapter Challenge: BSR Sample Trouble Tickets Solutions</title>
		<link>http://blog.ipexpert.com/2012/01/26/chapter-challenge-bsr-sample-trouble-tickets-solutions/</link>
		<comments>http://blog.ipexpert.com/2012/01/26/chapter-challenge-bsr-sample-trouble-tickets-solutions/#comments</comments>
		<pubDate>Thu, 26 Jan 2012 15:51:42 +0000</pubDate>
		<dc:creator>Anthony Sequeira</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[bsr]]></category>
		<category><![CDATA[labs]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[practice]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9926</guid>
		<description><![CDATA[The following is an excerpt from the latest IPexpert text, IPv4/6 Multicast Operation and Troubleshooting by Anthony Sequeira and Terry Vinson.]]></description>
			<content:encoded><![CDATA[<p>The following is an excerpt from the latest IPexpert text, <strong><em><a href="http://www.ipexpert.com/cisco/trouble-series-1" target="_blank">IPv4/6 Multicast Operation and Troubleshooting</a> </em></strong>by Anthony Sequeira and Terry Vinson.</p>
<h2><strong>Chapter Challenge: BSR Sample Trouble Tickets Solutions</strong></h2>
<p>The following section includes the solutions to the three Trouble Tickets presented in the previous section. Figure 9-11 provides a flowchart that outlines a &#8220;quick fire&#8221; approach to isolating and remediating issues associated with BSR.<span id="more-9926"></span></p>
<div id="attachment_9931" class="wp-caption alignleft" style="width: 310px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-113.png"><img class="size-medium wp-image-9931" title="9-11" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-113-300x240.png" alt="" width="300" height="240" /></a><p class="wp-caption-text">Figure 9-11: BSR Quick Fire Troubleshooting Flowchart</p></div>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p><span style="font-size: 20px; font-weight: bold;"><strong>Trouble Ticket #1 Solution</strong></span></p>
<p>Your supervisor has brought to your attention that the C-BSR routers R2 and R7 do not agree on the identity of the BSR. You must correct the issue.</p>
<p><strong>Step 1 &#8211; Fault Verification:</strong></p>
<p>R2 and R7 are the C-BSRs that are of interest in this trouble ticket:</p>
<pre><strong>R2#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong> BSR address: 192.1.2.2 (?)
</strong><strong> Uptime:      00:59:48, BSR Priority: 200, Hash mask length: 0
</strong><strong>Next bootstrap message in 00:00:12</strong></pre>
<pre><strong>R7#show ip pim bsr
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      03:35:07, BSR Priority: 255, Hash mask length: 0
</strong><strong> Next bootstrap message in 00:00:53</strong></pre>
<p>These two C-BSRs each think they are the BSR in this topology. This verifies that the problem actually exists.</p>
<p><strong>Step 2 &#8211; Fault Isolation:</strong></p>
<p>The next course of action is to use the <strong>mtrace</strong> utility to rule out the possibility of an RPF issue. Make certain to perform this process in both directions, first from R2 toward R7, then from R7 toward R2.</p>
<pre><strong>R2#mtrace 192.1.2.2 192.1.7.7
</strong><strong>Type escape sequence to abort.
</strong><strong>Mtrace from 192.1.2.2 to 192.1.7.7 via RPF
</strong><strong>From source (?) to destination (?)
</strong><strong>Querying full reverse path...
</strong><strong>0  192.1.7.7
</strong><strong>-1  172.16.67.7 PIM  [192.1.2.0/24]
</strong><strong>-2  172.16.67.6 PIM  [192.1.2.0/24]
</strong><strong>-3  172.16.26.2 PIM  [192.1.2.0/24]
</strong><strong>-4  192.1.2.2</strong></pre>
<p>There are no problems in the path from R2 to R7. Now reverse the testing:</p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<pre><strong>R7#mtrace 192.1.7.7 192.1.2.2
</strong><strong>Type escape sequence to abort.
</strong><strong>Mtrace from 192.1.7.7 to 192.1.2.2 via RPF
</strong><strong>From source (?) to destination (?)
</strong><strong>Querying full reverse path...
</strong><strong> 0  192.1.2.2
</strong><strong>-1  172.16.26.2 PIM  [192.1.7.0/24]
</strong><strong>-2  172.16.26.6 PIM  [192.1.7.0/24]
</strong><strong>-3  172.16.67.7 PIM  [192.1.7.0/24]
</strong><strong>-4  192.1.7.7</strong></pre>
<p><span style="font-family: Georgia, 'Times New Roman', 'Bitstream Charter', Times, serif; font-size: 13px; line-height: 19px; white-space: normal;">This output indicates that there are no Reverse Path Forwarding errors in the path between the C-BSRs. With this confirmed, the next step in the process is to utilize <strong>debug ip pim bsr</strong> on all candidate-BSRs and the devices in the path between them.</span></p>
<pre><strong>R2#debug ip pim bsr
</strong><strong>PIM-BSR(0): Bootstrap message for 192.1.2.2 originated</strong><strong>
</strong><strong>R6#debug ip pim bsr
</strong><strong>PIM-BSR(0): 192.1.2.2 bootstrap forwarded on FastEthernet0/0</strong><strong>
</strong><strong>R7#debug ip pim bsr
</strong><strong>PIM-BSR(0): bootstrap dropped</strong></pre>
<p><strong> </strong></p>
<p>The verification clearly demonstrates that R2 generates a Bootstrap message. R6 forwards that Bootstrap message, and R7 drops it. This means that either there is a PIM neighborship issue or a filter/border/boundary command on R7. The FastEthernet0/0 interface of R7 is the only interface capable of receiving any BSR messages from R2 (192.1.2.2). The quickest method to verify this is to execute the <strong>show run interface FastEthernet0/0</strong> command on R7:</p>
<p><strong> </strong></p>
<pre><strong>R7#show run interface FastEthernet0/0
</strong><strong>Building configuration...</strong><strong>
</strong><strong>Current configuration : 135 bytes
</strong><strong>!
</strong><strong>interface FastEthernet0/0
</strong><strong> ip address 172.16.67.7 255.255.255.0
</strong><strong> ip pim bsr-border
</strong><strong> ip pim sparse-mode
</strong><strong> duplex auto
</strong><strong> speed auto
</strong><strong>end</strong></pre>
<p><strong> </strong></p>
<p>The <strong>ip pim bsr-border</strong> command under the interface stops the BSR messages as they arrive at or exit R7. This has unquestionably isolated our fault.</p>
<p>&nbsp;</p>
<p><strong>Step 3 &#8211; Fault Remediation:</strong></p>
<p>In this scenario, the <strong>ip pim bsr-border</strong> command needs to be removed.</p>
<pre><strong>R7(config)#interface FastEthernet0/0
</strong><strong>R7(config-if)#no ip pim bsr-border</strong></pre>
<p><strong>Step 4 &#8211; Verification of Remediation</strong></p>
<p>Once the error has been isolated and remediated it is highly recommended to verify that the Trouble Ticket has been repaired using the same method of the initial fault verification.</p>
<pre><strong>R2#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:01:51, BSR Priority: 255, Hash mask length: 0
</strong><strong> Expires:     00:01:18
</strong><strong>This system is a candidate BSR
</strong><strong> Candidate BSR address: 192.1.2.2, priority: 200, hash mask length: 0</strong></pre>
<pre><strong>R7#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      04:14:14, BSR Priority: 255, Hash mask length: 0
</strong><strong> Next bootstrap message in 00:00:46</strong></pre>
<p><strong> </strong></p>
<p>Both the C-BSRs agree that R7 is the BSR (based on the priority of 255), and R2 is continuing to announce itself as a C-BSR should R7 fail.</p>
<h2><strong>Trouble Ticket #2 Solution </strong></h2>
<p>After solving Trouble Ticket #1, your supervisor has observed that a new C-BSR (R5) that has just been introduced in the network does not agree with R2 and R7 regarding the identity of the Bootstrap Router. Correct this issue.</p>
<p><strong>Step 1 &#8211; Fault Verification:<br />
</strong>R2 and R7 are the C-BSRs that are of interest in this trouble ticket:</p>
<pre><strong>R2#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:01:51, BSR Priority: 255, Hash mask length: 0
</strong><strong> Expires:     00:01:18
</strong><strong>This system is a candidate BSR
</strong><strong> Candidate BSR address: 192.1.2.2, priority: 200, hash mask length: 0</strong><strong> </strong></pre>
<pre><strong>R7#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      04:14:14, BSR Priority: 255, Hash mask length: 0
</strong><strong> Next bootstrap message in 00:00:46</strong></pre>
<pre><strong>R5#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong> BSR address: 192.1.5.5 (?)
</strong><strong> Uptime:      04:15:26, BSR Priority: 255, Hash mask length: 0
</strong><strong> Next bootstrap message in 00:00:33</strong></pre>
<p>R2 and R7 agree that R7 is the BSR, but R5 is reporting itself as the BSR in the topology. This verifies that the problem actually exists.</p>
<p><strong>Step 2 &#8211; Fault Isolation:</strong></p>
<p>In order to verify that RPF issues are not at fault, use the <strong>mtrace</strong> utility. Perform this check in both directions, first from R2 toward R5, and then in reverse.</p>
<pre><strong>R2#mtrace 192.1.2.2 192.1.7.7
</strong><strong>Type escape sequence to abort.
</strong><strong>Mtrace from 192.1.2.2 to 192.1.7.7 via RPF
</strong><strong>From source (?) to destination (?)
</strong><strong>Querying full reverse path...
</strong><strong> 0  192.1.7.7
</strong><strong>-1  172.16.67.7 PIM  [192.1.2.0/24]
</strong><strong>-2  172.16.67.6 PIM  [192.1.2.0/24]
</strong><strong>-3  172.16.26.2 PIM  [192.1.2.0/24]
</strong><strong>-4  192.1.2.2</strong><strong> </strong></pre>
<pre><strong>R5#mtrace 192.1.5.5 192.1.2.2
</strong><strong>Type escape sequence to abort.
</strong><strong>Mtrace from 192.1.5.5 to 192.1.2.2 via RPF
</strong><strong>From source (?) to destination (?)
</strong><strong>Querying full reverse path...
</strong><strong> 0  192.1.2.2
</strong><strong>-1  172.16.24.2 PIM  [192.1.5.0/24]
</strong><strong>-2  172.16.24.4 PIM  [192.1.5.0/24]
</strong><strong>-3  172.16.45.5 PIM  [192.1.5.0/24]
</strong><strong>-4  192.1.5.5</strong></pre>
<p><strong> </strong></p>
<p>Next is the verification of the BSR messaging. Use the <strong>debug ip pim bsr</strong> command on R2, R4 and R5:</p>
<pre><strong>R2#debug ip pim bsr
</strong><strong>PIM-BSR debugging is on
</strong><strong>R2#
</strong><strong>PIM-BSR(0): 192.1.7.7 bootstrap forwarded on Loopback0
</strong><strong>PIM-BSR(0): 192.1.7.7 bootstrap forwarded on GigabitEthernet0/0</strong></pre>
<p>R2 is sending BSR announcements out the Gi0/0 interface directed to R4.</p>
<pre><strong>R4#debug ip pim bsr
</strong><strong>PIM-BSR debugging is on
</strong><strong>R4#
</strong><strong>PIM-BSR(0): 192.1.7.7 bootstrap forwarded on Serial0/0/0.1
</strong><strong>PIM-BSR(0): 192.1.7.7 bootstrap forwarded on Loopback0</strong></pre>
<p><strong> </strong></p>
<p>We see that R4 is forwarding BSR messages from R7 out the Serial0/0/0.1 and on Loopback0, but not out FastEthernet 0/0 toward R5. The next step is to examine PIM neighbor relationships and inspect for multicast boundaries/filters.</p>
<pre><strong>R4#show ip pim neighbor
</strong><strong>PIM Neighbor Table
</strong><strong>Mode: B - Bidir Capable, DR - Designated Router, N - Default DR Priority,
</strong><strong> S - State Refresh Capable
</strong><strong>Neighbor            Interface                Uptime/Expires     Ver   DR
</strong><strong>Address                                               Prio/Mode
</strong><strong>172.16.24.2       FastEthernet0/0   22:34:25/00:01:23  v2    1 / S
</strong><strong>172.16.46.6       Serial0/0.1       22:35:35/00:01:17  v2    1 / S
</strong><strong>172.16.45.5       FastEthernet0/1   22:35:14/00:01:06  v1    1 / DR S</strong></pre>
<p><strong> </strong></p>
<p>Looking carefully at this output on R4 demonstrates that PIM version 2 neighbor relationships have formed across the FastEthernet0/0 and Serial0/0/0.1 interfaces, but a PIM version 1 neighbor relationship has formed across FastEthernet0/1 toward R5. BSR requires the use of PIM-SM version 2 in order to operate. This has isolated our fault.</p>
<p><strong> </strong></p>
<p><strong>Step 3 &#8211; Fault Remediation:</strong></p>
<p>In this scenario, <strong>ip pim version 2 </strong>needs to be configured between R4 and R5:</p>
<pre><strong>R4(config)#int f0/1
</strong><strong>R4(config-if)#no ip pim version 1</strong><strong>
</strong><strong>R5(config)#int f0/1
</strong><strong>R5(config-if)#no ip pim version 1</strong></pre>
<p><strong>Step 4 &#8211; Verification of Remediation</strong></p>
<p>Once the error has been isolated and remediated, it is highly recommended to verify that the Trouble Ticket has been repaired using the same method used to verify the fault initially:</p>
<pre><strong>R2#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:36:11, BSR Priority: 255, Hash mask length: 0
</strong><strong> Expires:     00:01:58
</strong><strong>This system is a candidate BSR
</strong><strong> Candidate BSR address: 192.1.2.2, priority: 200, hash mask length: 0</strong></pre>
<pre><strong>R7#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      04:48:37, BSR Priority: 255, Hash mask length: 0
</strong><strong> Next bootstrap message in 00:00:23</strong><strong> </strong></pre>
<pre><strong>R5#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:02:06, BSR Priority: 255, Hash mask length: 0
</strong><strong> Expires:     00:02:03
</strong><strong>This system is a candidate BSR
</strong><strong> Candidate BSR address: 192.1.5.5, priority: 250, hash mask length: 0</strong></pre>
<p><strong> </strong></p>
<p>All three C-BSRs agree that R7 is the BSR.</p>
<h2><strong>Trouble Ticket #3 Solution </strong></h2>
<p>Your supervisor has notified you that R1 is not receiving any RP-set information from the BSR. You must correct this issue.</p>
<p><strong>Step 1 &#8211; Fault Verification:<br />
</strong>R1 is the router of interest in this trouble ticket:</p>
<p><strong> </strong></p>
<pre><strong>R1#sh ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings</strong><strong>
</strong><strong>R1#</strong></pre>
<p>R1 is not receiving the C-RP RP-set information from the BSR. This verifies that the problem actually exists.</p>
<p><strong>Step 2 &#8211; Fault Isolation:</strong></p>
<p>To ensure that BSR messages have made it to all PIM devices, use the <strong>mtrace</strong> utility. Make certain to perform this process from the C-RPs to the BSR.</p>
<pre><strong>R4#mtrace 192.1.4.4 192.1.7.7
</strong><strong>Type escape sequence to abort.
</strong><strong>Mtrace from 192.1.4.4 to 192.1.7.7 via RPF
</strong><strong>From source (?) to destination (?)
</strong><strong>Querying full reverse path...
</strong><strong> 0  192.1.7.7
</strong><strong>-1  172.16.67.7 PIM  [192.1.4.0/24]
</strong><strong>-2  172.16.67.6 PIM  [192.1.4.0/24]
</strong><strong>-3  172.16.26.2 PIM  [192.1.4.0/24]
</strong><strong>-4  172.16.24.4 PIM  [192.1.4.0/24]
</strong><strong>-5  192.1.4.4</strong></pre>
<p>There are no problems in the path from R4 to R7. Now repeat the test from R6 to R7:</p>
<p><strong> </strong></p>
<pre><strong>R6#mtrace 192.1.6.6 192.1.7.7
</strong><strong>Type escape sequence to abort.
</strong><strong>Mtrace from 192.1.6.6 to 192.1.7.7 via RPF
</strong><strong>From source (?) to destination (?)
</strong><strong>Querying full reverse path...
</strong><strong> 0  192.1.7.7
</strong><strong>-1  172.16.67.7 PIM  [192.1.6.0/24]
</strong><strong>-2  172.16.67.6 PIM  [192.1.6.0/24]
</strong><strong>-3  192.1.6.6</strong></pre>
<p>This indicates that there are no RPF errors. Next, execute the <strong>debug ip pim bsr</strong> command on R1, R4, R5, R2, R6 and R7.</p>
<pre><strong>R1#debug ip pim bsr
</strong><strong>PIM-BSR debugging is on
</strong><strong>R1#
</strong><strong>R1#</strong></pre>
<p>The output on R1 indicates it is not receiving any BSR messages on Fa0/0 from R5. On R5:</p>
<pre><strong>R5#debug ip pim bsr
</strong><strong>PIM-BSR debugging is on
</strong><strong>R5#
</strong><strong>PIM-BSR(0): 192.1.7.7 bootstrap forwarded on Loopback0
</strong><strong>PIM-BSR(0): 192.1.7.7 bootstrap forwarded on FastEthernet0/0
</strong><strong>R5#</strong></pre>
<p><strong> </strong></p>
<p>R5 is forwarding BSR messages from R7 out FastEthernet0/0 toward R1. The previous output on R1 indicated that no BSR messages are arriving. The next verification is to look for RPF failures on R1.</p>
<pre><strong>R1#sh ip rpf 192.1.7.7
</strong><strong>RPF information for ? (192.1.7.7) failed, no route exists
</strong><strong>R1#</strong></pre>
<p>The issue is an RPF failure on R1 toward R5. This is best verified by examining the PIM-SM neighbors on R1:</p>
<pre><strong>R1#sh ip pim neighbor
</strong><strong>PIM Neighbor Table
</strong><strong>Mode: B - Bidir Capable, DR - Designated Router, N - Default DR Priority,
</strong><strong> S - State Refresh Capable
</strong><strong>Neighbor          Interface                Uptime/Expires    Ver   DR
</strong><strong>Address                                                            Prio/Mode
</strong><strong>R1#</strong></pre>
<p><strong> </strong></p>
<p>There is no neighbor relationship between R1 and R5. A <strong>show run interface FastEthernet0/0</strong> command will reveal the issue.</p>
<p><strong> </strong></p>
<pre><strong>R1#sh run interface FastEthernet 0/0
</strong><strong>Building configuration...</strong><strong>
</strong><strong>Current configuration : 96 bytes
</strong><strong>!
</strong><strong>interface FastEthernet0/0
</strong><strong> ip address 172.16.15.1 255.255.255.0
</strong><strong> duplex auto
</strong><strong> speed auto
</strong><strong>end</strong></pre>
<p>Looking carefully at this output on R1 demonstrates that PIM-SM version 2 is not enabled on FastEthernet0/0.</p>
<p><strong>Step 3 &#8211; Fault Remediation:</strong></p>
<p>In this scenario, <strong>ip pim sparse-mode </strong>needs to be configured on FastEthernet0/0.</p>
<pre><strong>R1(config)#int f0/0
</strong><strong>R1(config-if)#ip pim sparse-mode
</strong><strong>Step 4 - Verification of Remediation</strong></pre>
<p>Once the error has been isolated and remediated, it is highly recommended to verify that the Trouble Ticket has been repaired using the same method used to verify the fault initially.</p>
<pre><strong>R1#sh ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings</strong><strong>
</strong><strong>Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:00:15, expires: 00:02:13
</strong><strong> RP 192.1.4.4 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 255, holdtime 150
</strong><strong> Uptime: 00:00:15, expires: 00:02:12</strong></pre>
<p>R1 now has the complete C-RP RP-set information as expected.</p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/26/chapter-challenge-bsr-sample-trouble-tickets-solutions/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/26/chapter-challenge-bsr-sample-trouble-tickets-solutions/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/26/chapter-challenge-bsr-sample-trouble-tickets-solutions/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Chapter Challenge: BSR Sample Trouble Tickets</title>
		<link>http://blog.ipexpert.com/2012/01/25/chapter-challenge-bsr-sample-trouble-tickets/</link>
		<comments>http://blog.ipexpert.com/2012/01/25/chapter-challenge-bsr-sample-trouble-tickets/#comments</comments>
		<pubDate>Wed, 25 Jan 2012 15:45:23 +0000</pubDate>
		<dc:creator>Anthony Sequeira</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[bsr]]></category>
		<category><![CDATA[exam]]></category>
		<category><![CDATA[lab]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[practice]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9918</guid>
		<description><![CDATA[The following is an excerpt from the latest IPexpert text, IPv4/6 Multicast Operation and Troubleshooting by Anthony Sequeira and Terry Vinson.]]></description>
			<content:encoded><![CDATA[<p>The following is an excerpt from the latest IPexpert text, <strong><em><a href="http://www.ipexpert.com/cisco/trouble-series-1" target="_blank">IPv4/6 Multicast Operation and Troubleshooting</a> </em></strong>by Anthony Sequeira and Terry Vinson.</p>
<p><strong>Chapter Challenge: BSR Sample Trouble Tickets</strong></p>
<p>The following section includes three sample Trouble Tickets designed to challenge the troubleshooting skills that have been developed in all previous sections of this chapter. These Trouble Tickets were designed using the Routing &amp; Switching rental racks at www.ProctorLabs.com with the initial configurations provided in the file <strong><em><a href="http://www.ipexpert.com/samples/IPexperts_Multicast-Operations-and-Troubleshooting-SAMPLE-with-INITIAL-Configs.zip">MCAST-CH9-BSR-TT-INITIAL.txt</a></em></strong>. Keep in mind these sample Trouble Tickets were also tested against home practice racks and the most popular router emulators.<span id="more-9918"></span></p>
<p>The network topology used in this section is shown in Figure 9-10 below:</p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong></p>
<div id="attachment_9921" class="wp-caption alignleft" style="width: 661px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-10.png"><img class="size-full wp-image-9921" title="9-10" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-10.png" alt="" width="651" height="243" /></a><p class="wp-caption-text">Figure 9-10: The Chapter Challenge Topology</p></div>
<p></strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<h2><strong>Trouble Ticket #1 </strong></h2>
<p>Your supervisor has brought to your attention that the C-BSR routers R2 and R7 do not agree on the identity of the BSR. You must correct the issue.</p>
<h2><strong>Trouble Ticket #2</strong></h2>
<p>After solving Trouble Ticket #1, your supervisor has observed that a new C-BSR (R5) that has just been introduced in the network does not agree with R2 and R7 regarding the identity of the Bootstrap Router. Correct this issue.</p>
<h2><strong>Trouble Ticket #3</strong></h2>
<p>Your supervisor has notified you that R1 is not receiving any RP-set information from the BSR. You must correct this issue.</p>
<p>Anthony Sequeira CCIE, CCSI<br />
Twitter: @compsolv<br />
Facebook: http://www.facebook.com/compsolv</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/25/chapter-challenge-bsr-sample-trouble-tickets/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/25/chapter-challenge-bsr-sample-trouble-tickets/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/25/chapter-challenge-bsr-sample-trouble-tickets/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>BSR debug Command Tools</title>
		<link>http://blog.ipexpert.com/2012/01/24/bsr-debug-command-tools/</link>
		<comments>http://blog.ipexpert.com/2012/01/24/bsr-debug-command-tools/#comments</comments>
		<pubDate>Tue, 24 Jan 2012 15:22:40 +0000</pubDate>
		<dc:creator>Anthony Sequeira</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[bsr]]></category>
		<category><![CDATA[lab exam]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9912</guid>
		<description><![CDATA[The following is an excerpt from the latest IPexpert text, IPv4/6 Multicast Operation and Troubleshooting by Anthony Sequeira and Terry Vinson.]]></description>
			<content:encoded><![CDATA[<p>The following is an excerpt from the latest IPexpert text, <strong><em><a href="http://www.ipexpert.com/cisco/trouble-series-1" target="_blank">IPv4/6 Multicast Operation and Troubleshooting</a> </em></strong>by Anthony Sequeira and Terry Vinson.</p>
<h2><strong>BSR debug Command Tools</strong></h2>
<p>As a quick reference, here are the <strong>debug</strong> command tools utilized in this chapter. This section utilizes the BSR topology in Figure 9-9 for all example output.</p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong></p>
<div id="attachment_9913" class="wp-caption alignleft" style="width: 659px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-9.png"><img class="size-full wp-image-9913" title="9-9" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-9.png" alt="" width="649" height="241" /></a><p class="wp-caption-text">Figure 9-9: A Sample BSR Topology</p></div>
<p></strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p><strong>debug COMMAND:<br />
debug ip mpacket [vrf </strong><em>vrf-name</em><strong>] [detail | fastswitch] [</strong><em>access-list</em><strong>] [</strong><em>group</em><strong>]</strong></p>
<p>This command displays multicast packets that are received and sent on the device.</p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> – optional; specifies the name of the multicast VRF instance</li>
<li><strong>detail</strong> – optional; displays IP header and MAC information</li>
<li><strong>fastswitch</strong> – optional; displays IP packet information in the fast path</li>
<li><strong>access-list </strong>– optional; restricts the output per the specified access-list</li>
</ul>
<pre><strong>EXAMPLE OUTPUT:
</strong><strong>IP(0): s=172.16.24.4 (FastEthernet0/0) d=224.9.9.9 id=7, ttl=254, prot=1, len=114(100), mroute olist nullIP(0): s=172.16.24.4 (FastEthernet0/0) d=224.9.9.9 id=8, ttl=254, prot=1, len=114(100), mroute olist null
IP(0): s=172.16.24.4 (FastEthernet0/0) d=224.9.9.9 id=9, ttl=254, prot=1, len=114(100), mroute olist null</strong></pre>
<p><strong> </strong></p>
<p><strong>debug COMMAND:<br />
debug ip pim [vrf </strong><em>vrf-name</em><strong>] [bsr]</strong></p>
<p>This command displays the mappings for the PIM group to the active Rendezvous Point(s).</p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> – optional; specifies the name of the multicast VRF instance</li>
</ul>
<pre><strong>EXAMPLE OUTPUT:
</strong><strong>R4#debug ip pim bsr
</strong><strong>PIM-BSR debugging is on
</strong><strong>R4#
</strong><strong>PIM-BSR(0): 192.1.2.2 bootstrap forwarded on FastEthernet0/1
</strong><strong>PIM-BSR(0): 192.1.2.2 bootstrap forwarded on Serial0/0/0.1
</strong><strong>PIM-BSR(0): bootstrap (192.1.2.2) on non-RPF path Serial0/0/0.1 or from non-RPF neighbor 172.16.24.2 discarded</strong><strong> </strong></pre>
<pre><strong>R2#debug ip pim bsr
</strong><strong>PIM-BSR(0): RP-set for 224.0.0.0/4
</strong><strong>PIM-BSR(0):   RP(1) 192.1.7.7, holdtime 150 sec priority 0
</strong><strong>PIM-BSR(0):   RP(2) 192.1.5.5, holdtime 150 sec priority 0
</strong><strong>PIM-BSR(0): Bootstrap message for 192.1.2.2 originated
</strong><strong>R2#
</strong><strong>PIM-BSR(0):  RP 192.1.5.5, 1 Group Prefixes, Priority 0, Holdtime 150
</strong><strong>R2#
</strong><strong>PIM-BSR(0):  RP 192.1.7.7, 1 Group Prefixes, Priority 0, Holdtime 150
</strong><strong>R2#</strong><strong> </strong></pre>
<pre><strong>R5#debug ip pim bsr
</strong><strong>PIM-BSR(0): Build v2 Candidate-RP advertisement for 192.1.5.5 priority 0, holdtime 150
</strong><strong>PIM-BSR(0):  Candidate RP's group prefix 224.0.0.0/4
</strong><strong>PIM-BSR(0): Send Candidate RP Advertisement to 192.1.2.2
</strong><strong>R5#</strong></pre>
<p><strong><br />
</strong>Anthony Sequeira CCIE, CCSI<br />
Twitter: @compsolv<br />
Facebook: http://www.facebook.com/compsolv</p>
<p>&nbsp;</p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/24/bsr-debug-command-tools/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/24/bsr-debug-command-tools/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/24/bsr-debug-command-tools/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>BSR show Command Tools</title>
		<link>http://blog.ipexpert.com/2012/01/23/bsr-show-command-tools/</link>
		<comments>http://blog.ipexpert.com/2012/01/23/bsr-show-command-tools/#comments</comments>
		<pubDate>Mon, 23 Jan 2012 17:08:47 +0000</pubDate>
		<dc:creator>Anthony Sequeira</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[bsr]]></category>
		<category><![CDATA[exam]]></category>
		<category><![CDATA[lab]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[practice]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9905</guid>
		<description><![CDATA[The following is an excerpt from the latest IPexpert text, IPv4/6 Multicast Operation and Troubleshooting by Anthony Sequeira and Terry Vinson.]]></description>
			<content:encoded><![CDATA[<p>The following is an excerpt from the latest IPexpert text, <strong><em><a href="http://www.ipexpert.com/cisco/trouble-series-1" target="_blank">IPv4/6 Multicast Operation and Troubleshooting</a> </em></strong>by Anthony Sequeira and Terry Vinson.</p>
<h2>BSR show Command Tools</h2>
<p>As a quick reference, here are the <strong>show</strong> command tools utilized in this chapter. This section utilizes the BSR topology in Figure 9-8 for all example output.<span id="more-9905"></span></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong></p>
<div id="attachment_9907" class="wp-caption alignleft" style="width: 659px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-8.png"><img class="size-full wp-image-9907" title="9-8" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-8.png" alt="" width="649" height="241" /></a><p class="wp-caption-text">Figure 9-8: A Sample BSR Topology</p></div>
<p></strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p><strong>show COMMAND:</strong></p>
<p><strong>show ip pim [vrf </strong><em>vrf-name</em><strong>] bsr-router</strong></p>
<p>This command displays information about a bootstrap router (BSR)</p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> – optional; specifies the name of the multicast VRF instance</li>
</ul>
<pre><strong>EXAMPLE OUTPUT:
</strong><strong>R1#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.2.2 (?)
</strong><strong> Uptime:      00:26:57, BSR Priority: 0, Hash mask length: 0
</strong><strong> Expires:     00:01:12</strong></pre>
<p><strong> </strong></p>
<p><strong>show COMMAND:<br />
show</strong> <strong>ip</strong> <strong>pim</strong> [<strong>vrf</strong> <em>vrf-name</em>] <strong>rp-hash</strong> {<em>group-address</em> | group-name}</p>
<p>This command displays the mappings for the PIM group to the active Rendezvous Point(s).</p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> – optional; specifies the name of the multicast VRF instance</li>
<li><strong>group-address</strong> – the multicast group address</li>
</ul>
<pre><strong>EXAMPLE OUTPUT:
 </strong><strong>R4#show ip pim rp-hash 224.9.9.9
</strong><strong> RP 192.1.7.7 (?), v2
</strong><strong> Info source: 192.1.2.2 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 03:32:33, expires: 00:01:27
</strong><strong> PIMv2 Hash Value (mask 0.0.0.0)
</strong><strong> RP 192.1.7.7, via bootstrap, priority 0, hash value 390961567
</strong><strong> RP 192.1.5.5, via bootstrap, priority 0, hash value 119808709</strong></pre>
<p><strong> </strong></p>
<p><strong>show COMMAND:<br />
show</strong> <strong>ip</strong> <strong>pim</strong> [<strong>vrf</strong> <em>vrf-name</em>] <strong>rp</strong> <strong>mapping</strong> [<em>rp-address</em>]</p>
<p>This command displays the mappings for the PIM group to the active Rendezvous Point(s).</p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> – optional; specifies the name of the multicast VRF instance</li>
<li><strong>rp-address</strong> – optional; allows the specification of a specific RP IP address in order to filter the output</li>
</ul>
<pre><strong>EXAMPLE OUTPUT:
 </strong><strong>R4#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings
</strong><strong>Group(s) 224.0.0.0/4
</strong><strong>RP 192.1.7.7 (?), v2
</strong><strong>Info source: 192.1.2.2 (?), via bootstrap, priority 0, holdtime 150
</strong><strong>Uptime: 03:45:33, expires: 00:01:29
</strong><strong>RP 192.1.5.5 (?), v2
</strong><strong>Info source: 192.1.2.2 (?), via bootstrap, priority 0, holdtime 150
</strong><strong>Uptime: 03:45:47, expires: 00:01:30</strong></pre>
<p><strong>show COMMAND:</strong></p>
<p><strong>show ip rpf [vrf </strong><em>vrf-name</em><strong>] {</strong><em>route-distinguisher</em><strong> | </strong><em>source-address</em><strong> [</strong><em>group-address</em><strong>] [rd </strong><em>route-distinguisher</em><strong>]} [metric]</strong></p>
<p>This command displays information that IP multicast routing uses to perform the Reverse Path Forwarding (RPF) check for a multicast source</p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> – optional; specifies the name of the multicast VRF instance</li>
<li><strong>route-distinguisher </strong>- Route distinguisher (RD) of a VPNv4 prefix; entering the route-distinguisher argument displays RPF information related to the specified VPN route</li>
<li><strong>source-address </strong>- IP address or name of a multicast source for which to display RPF information</li>
<li><strong>group-address </strong>- optional; IP address or name of a multicast group for which to display RPF information</li>
<li><strong>rd </strong><em>route-distinguisher </em>- optional; displays the Border Gateway Protocol (BGP) RPF next hop for the VPN route associated with the RD specified for the route-distinguisher argument</li>
<li><strong>metric </strong>- optional; displays the unicast routing metric</li>
</ul>
<pre><strong>EXAMPLE OUTPUT:
 </strong><strong>R5#show ip rpf 192.1.2.2
</strong><strong>RPF information for ? (192.1.2.2)
</strong><strong> RPF interface: FastEthernet0/1
</strong><strong> RPF neighbor: ? (172.16.45.4)
</strong><strong>RPF route/mask: 192.1.2.0/24
</strong><strong> RPF type: unicast (eigrp 100)
</strong><strong> RPF recursion count: 0
</strong><strong> Doing distance-preferred lookups across tables</strong></pre>
<p><strong> </strong></p>
<p><strong>show COMMAND:</strong></p>
<p><strong>show</strong> <strong>ip</strong> <strong>pim</strong> [<strong>vrf</strong> <em>vrf-name</em>] <strong>neighbor</strong> [<em>interface-type</em> <em>interface-number</em>]</p>
<p>This command displays information about Protocol Independent Multicast (PIM) neighbors discovered by PIM version 1 router query messages or PIM version 2 hello messages.</p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> – optional; specifies the name of the multicast VRF instance</li>
<li><strong>interface-type </strong> &#8211; optional; restricts the output to information about PIM neighbors reachable on the specified interface</li>
</ul>
<pre><strong>EXAMPLE OUTPUT:
 </strong><strong>R4#show ip pim neighbor
</strong><strong>PIM Neighbor Table
</strong><strong>Mode: B - Bidir Capable, DR - Designated Router, N - Default DR Priority,
</strong><strong>S - State Refresh Capable
</strong><strong>Neighbor    Interface  Uptime/Expires    Ver   DR Address    Prio/Mode
</strong><strong>172.16.45.5 FastEthernet0/1 01:17:41/00:01:25 v2    1 / DR S
</strong><strong>172.16.46.6 Serial0/0/0.1   01:16:39/00:01:19 v2    1 / S</strong></pre>
<p>Anthony Sequeira CCIE, CCSI<br />
Twitter: @compsolv<br />
Facebook: http://www.facebook.com/compsolv</p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/23/bsr-show-command-tools/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/23/bsr-show-command-tools/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/23/bsr-show-command-tools/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>BSR Sample Troubleshooting Scenarios</title>
		<link>http://blog.ipexpert.com/2012/01/18/bsr-sample-troubleshooting-scenarios/</link>
		<comments>http://blog.ipexpert.com/2012/01/18/bsr-sample-troubleshooting-scenarios/#comments</comments>
		<pubDate>Wed, 18 Jan 2012 15:43:05 +0000</pubDate>
		<dc:creator>Anthony Sequeira</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[bsr]]></category>
		<category><![CDATA[lab exam]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[practice]]></category>
		<category><![CDATA[r&s]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9841</guid>
		<description><![CDATA[The following is an excerpt from the latest IPexpert text, IPv4/6 Multicast Operation and Troubleshooting by Anthony Sequeira and Terry Vinson. BSR Sample Troubleshooting Scenarios This section provides a detailed look at how to best approach troubleshooting some of the common issues discussed in previous sections. It includes coverage of a methodology for identification, isolation, and [...]]]></description>
			<content:encoded><![CDATA[<p>The following is an excerpt from the latest IPexpert text, <strong><em><a href="http://www.ipexpert.com/cisco/trouble-series-1" target="_blank">IPv4/6 Multicast Operation and Troubleshooting</a> </em></strong>by Anthony Sequeira and Terry Vinson.</p>
<h2><strong>BSR Sample Troubleshooting Scenarios</strong></h2>
<p>This section provides a detailed look at how to best approach troubleshooting some of the common issues discussed in previous sections. It includes coverage of a methodology for identification, isolation, and remediation of faults in the BSR operational process. The intent here is to hone and develop troubleshooting skills tailored to first identify if a problem is multicast or unicast related, and then how to begin isolating the cause of the fault in the most efficient manner possible. Figure 9-7 illustrates the topology used to explore this topic. Note that R4 and R6 operate as C-RPs and R5 and R7 are C-BSRs:<span id="more-9841"></span></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong></p>
<div id="attachment_9843" class="wp-caption alignleft" style="width: 659px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-7.png"><img class="size-full wp-image-9843" title="9-7" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-7.png" alt="" width="649" height="241" /></a><p class="wp-caption-text">Figure 9-7: A Sample BSR Topology</p></div>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p></strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p>In the <strong><em>Common Issues with BSR</em></strong> section, three primary types of problems were identified: RPF failures, unicast routing failures, and multicast forwarding and routing failures. This section explores these three categories of failure, by directing our attention to the commands necessary to identify that a problems exists. There are three types of devices in this topology: C-RP(s), C-BSR(s), and transit devices (PIM enabled routers).</p>
<p><strong>Step One:</strong> Which device won the BSR election &#8211; R5 or R7?</p>
<pre><strong>R5#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong> BSR address: 192.1.5.5 (?)
</strong><strong> Uptime:      00:01:35, BSR Priority: 0, Hash mask length: 0
</strong><strong> Next bootstrap message in 00:00:25</strong></pre>
<p>R5 believes that it is the PIM version 2 Bootstrap Router. Given that the priority is zero, this seems odd, because R7 has a higher IP address. Issue the same <strong>show</strong> command on R7:</p>
<p><strong> </strong></p>
<pre><strong>R7#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:13:11, BSR Priority: 0, Hash mask length: 0
</strong><strong> Next bootstrap message in 00:00:48</strong></pre>
<p><strong> </strong></p>
<p>R7 has also elected itself as the Bootstrap Router.</p>
<p>It is not possible for this to happen in a correctly configured BSR environment. This issue seems to indicate that the two candidate-BSR devices have failed to exchange their BSR announcement messages. How are those BSR announcement messages exchanged?</p>
<p>As discussed previously, PIM-SM version 2 messages exchange the BSR information, and these Bootstrap messages are how the C-BSRs discover each other and decide which assumes the role of the BSR.</p>
<p>The link-local multicast group 224.0.0.13 accomplishes this process and is subject to the RPF check mechanism. There are a number of ways to isolate RPF issues (<strong>mstat</strong>, <strong>mtrace</strong>, <strong>show ip rpf</strong>, <strong>debug ip pim bsr</strong>), but <strong>mstat</strong> and <strong>mtrace </strong>cannot be used with link-local multicast as they result in a &#8220;% bad IP group address&#8221; message.</p>
<p>Eliminating the <strong>mstat</strong> and <strong>mtrace </strong>commands leaves either <strong>show ip rpf</strong> or <strong>debug ip pim bsr</strong>, or some combination of both. However, this brings up an issue that should be considered.<strong> </strong>The BSR advertisement interval is fixed at 60 seconds and cannot be changed. This means valuable time could be wasted waiting for results using <strong>debug ip pim bsr </strong>on all devices in the multicast path. This leaves <strong>show ip rpf</strong> as the best option to isolate this issue.</p>
<p>Does R5 have any RPF issues reaching R7&#8242;s Loopback0 interface?</p>
<pre><strong>R5#show ip rpf 192.1.7.7
</strong><strong>RPF information for ? (192.1.7.7)
</strong><strong> RPF interface: FastEthernet0/1
</strong><strong> RPF neighbor: ? (172.16.45.4)
</strong><strong> RPF route/mask: 192.1.7.0/24
</strong><strong> RPF type: unicast (eigrp 100)
</strong><strong> RPF recursion count: 0
</strong><strong> Doing distance-preferred lookups across tables</strong></pre>
<p>No, it does not. Does R7 have any issues reaching R5&#8242;s Loopback0 interface?</p>
<p><strong> </strong></p>
<pre><strong>R7#show ip rpf 192.1.5.5
</strong><strong>RPF information for ? (192.1.5.5) failed, no route exists</strong></pre>
<p><strong> </strong></p>
<p>R7 does in fact have an issue related to RPF failure. How would R7 reach the IP address of 192.1.5.5:</p>
<pre><strong>R7#show ip route 192.1.5.5
</strong><strong>Routing entry for 192.1.5.0/24
</strong><strong>Known via "eigrp 100", distance 90, metric 163840, type internal
</strong><strong> Redistributing via eigrp 100
</strong><strong> Last update from 172.16.67.6 on FastEthernet0/0, 01:59:59 ago
</strong><strong>Routing Descriptor Blocks:
</strong><strong> * 172.16.67.6, from 172.16.67.6, 01:59:59 ago, via FastEthernet0/0
</strong><strong> Route metric is 163840, traffic share count is 1
</strong><strong> Total delay is 5400 microseconds, minimum bandwidth is 100000 Kbit
</strong><strong> Reliability 255/255, minimum MTU 1500 bytes
</strong><strong> Loading 1/255, Hops 4</strong></pre>
<p><strong> </strong></p>
<p>R7 will use FastEthernet0/0 as the RPF interface. An RPF interface must be configured to participate in PIM-SM version 2 for BSR messages to be exchanged successfully. Use the <strong>show ip pim interface</strong> command to most quickly verify if this is taking place.</p>
<pre><strong>R7#show ip pim interface</strong><strong>
</strong><strong>Address</strong><strong> </strong><strong>Interface</strong><strong> </strong><strong>Ver/</strong><strong> </strong><strong>Nbr</strong><strong> </strong><strong>Query</strong><strong> </strong><strong>DR</strong><strong> </strong><strong>DR
</strong><strong> </strong><strong>Mode</strong><strong> </strong><strong>Count</strong><strong> </strong><strong>Intvl</strong><strong> </strong><strong>Prior
</strong><strong>192.1.7.7</strong><strong> </strong><strong>Loopback0</strong><strong> </strong><strong>v2/S</strong><strong> </strong><strong>0</strong><strong> </strong><strong>30</strong><strong> </strong><strong>1</strong><strong> </strong><strong>192.1.7.7
</strong><strong>172.16.79.7</strong><strong> </strong><strong>FastEthernet0/1</strong><strong> </strong><strong>v2/S</strong><strong> </strong><strong>1</strong><strong> </strong><strong>30</strong><strong> </strong><strong>1</strong><strong> </strong><strong>172.16.79.9</strong></pre>
<p>FastEthernet0/1 is not in the interface list. To remediate this, enable PIM-SM version 2 on R7&#8242;s FastEthernet0/0 interface.</p>
<pre><strong>R7(config)#int FastEthernet0/0
</strong><strong>R7(config-if)#ip pim sparse-mode</strong></pre>
<p><strong> </strong></p>
<p>Note the PIM neighborship between R7 and R6 immediately comes up.</p>
<pre><strong>R7(config-if)#
</strong><strong>%PIM-5-DRCHG: DR change from neighbor 0.0.0.0 to 172.16.67.7 on interface FastEthernet0/0</strong></pre>
<p>Verification in now necessary to determine if one BSR has been elected. Based on the equal priority values, R7 should be elected as the BSR.</p>
<pre><strong>R7#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong>This system is the Bootstrap Router (BSR)
</strong><strong>BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:47:31, BSR Priority: 0, Hash mask length: 0
</strong><strong> Next bootstrap message in 00:00:29</strong></pre>
<p>And R5 should agree:</p>
<pre><strong>R5#show ip pim bsr
</strong><strong>PIMv2 Bootstrap information
</strong><strong>BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:03:15, BSR Priority: 0, Hash mask length: 0
</strong><strong> Expires:     00:01:54
</strong><strong>This system is a candidate BSR
</strong><strong> Candidate BSR address: 192.1.5.5, priority: 0, hash mask length: 0</strong></pre>
<p><strong> </strong></p>
<p>This output indicates that both R5 and R7 agree that R7 (192.1.7.7) is the BSR. Note that R5 maintains its Candidate-BSR status; it will opt to elect itself BSR should R7 stop functioning. This is part of the normal Active/Passive failover mechanism employed by BSR.</p>
<p>Having corrected the issue related to the actual election of the BSR, the next step is to determine whether or not the BSR is learning each of the C-RP RP-sets. This is best accomplished with the <strong>show ip rp mapping</strong> command on the BSR itself.</p>
<p><strong> </strong></p>
<pre><strong>R7#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings
</strong><strong>This system is the Bootstrap Router (v2)</strong></pre>
<pre><strong> </strong></pre>
<pre><strong>Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2
</strong><strong> Info source: 172.16.67.6 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:21:10, expires: 00:02:16</strong></pre>
<p>The BSR is only learning about R6&#8242;s RP-Set information for the multicast scope of 224.0.0.0/4. How are the C-RPs communicating this information to the BSR?</p>
<p>Unicast routing is used to deliver this information from the C-RP, but multicast is used by the BSR to communicate its presence to the individual C-RPs. Has the BSR successfully communicated its existence to both C-RPs?</p>
<p><strong> </strong></p>
<pre><strong>R4#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:03:21, BSR Priority: 0, Hash mask length: 0
</strong><strong> Expires:     00:01:48
</strong><strong> Candidate RP: 192.1.4.4(Loopback0)
</strong><strong> Holdtime 150 seconds
</strong><strong> Advertisement interval 60 seconds
</strong><strong> Next advertisement in 00:00:35</strong></pre>
<pre><strong>R6#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.7.7 (?)
</strong><strong> Uptime:      00:54:57, BSR Priority: 0, Hash mask length: 0
</strong><strong> Expires:     00:01:12
</strong><strong> Candidate RP: 192.1.6.6(Loopback0)
</strong><strong> Holdtime 150 seconds
</strong><strong> Advertisement interval 60 seconds
</strong><strong> Next advertisement in 00:00:22</strong></pre>
<p><span style="font-family: Georgia, 'Times New Roman', 'Bitstream Charter', Times, serif; font-size: 13px; line-height: 19px; white-space: normal;">R4 and R6 know that R7 is the BSR. These C-RPs now unicast their RP-Set information to the BSR for dissemination throughout the multicast domain. Knowing that this is a unicast problem, the most effective tool now is <strong>ping</strong>. Remember, the unicast of the RP-Set information will be sourced and destined to specific IP addresses, and the easiest method of testing reachability is to verify from the BSR. Specifically, pings should be sourced from the IP address of the BSR to the IP address of each C-RP.</span></p>
<p><strong> </strong></p>
<pre><strong>R7#ping 192.1.6.6 source 192.1.7.7
</strong><strong>Type escape sequence to abort.
</strong><strong>Sending 5, 100-byte ICMP Echos to 192.1.6.6, timeout is 2 seconds:
</strong><strong>Packet sent with a source address of 192.1.7.7
</strong><strong>!!!!!
</strong><strong>Success rate is 100 percent (5/5), round-trip min/avg/max = 1/1/4 ms</strong></pre>
<p>Based on the fact that the BSR learned the RP-set information for R6, it should come as no surprise that unicast reachability exists. R4, however, is the C-RP in question:</p>
<p><strong>R7#ping 192.1.4.4 source 192.1.7.7</strong><strong> </strong><strong>Type escape sequence to abort. </strong><strong>Sending 5, 100-byte ICMP Echos to 192.1.4.4, timeout is 2 seconds: </strong><strong>Packet sent with a source address of 192.1.7.7 </strong><strong>&#8230;.. </strong><strong>Success rate is 0 percent (0/5)</strong></p>
<p>This output is proof of a unicast routing problem between R7 and R4. Now, several options can be used including pinging almost every interface between the two devices. The best course of action in this scenario would be to utilize the <strong>traceroute</strong> command from the BSR using the same source and destination used in the ping test:</p>
<p><strong> </strong></p>
<pre><strong>R7#traceroute 192.1.4.4 source 192.1.7.7
</strong><strong>Type escape sequence to abort.
</strong><strong>Tracing the route to 192.1.4.4</strong><strong>
</strong><strong> 1 172.16.67.6 0 msec 0 msec 0 msec
</strong><strong> 2 172.16.26.2 4 msec 0 msec 0 msec
</strong><strong> 3  *  *  *
</strong><strong>&lt;output omitted&gt;</strong></pre>
<p><strong> </strong></p>
<p>This output clearly illustrates the fact that the unicast issue exits on the router immediately after R2. According to the topology, this is R4 itself.</p>
<p>Go to R4 and verify the contents of the routing table. Specifically, the IP address of interest is the Loopback0 interface of R7 (192.1.7.7):</p>
<pre><strong>R4#show ip route 192.1.7.7
</strong><strong>Routing entry for 192.1.7.7/32
</strong><strong> Known via "static", distance 1, metric 0 (connected)
</strong><strong> Routing Descriptor Blocks:
</strong><strong> * directly connected, via Null0
</strong><strong> Route metric is 0, traffic share count is 1</strong></pre>
<pre><span style="font-family: Georgia, 'Times New Roman', 'Bitstream Charter', Times, serif; font-size: 13px; line-height: 19px; white-space: normal;">Based on this output, any traffic destined to R7's Loopback0 interface is immediately forwarded to the Null0 interface via the static route configured. To remediate this problem, the best course of action is to remove this static route, and then check if R7 begins to learn RP-sets from both R4 and R6.</span></pre>
<pre><strong>R4(config)#no ip route 192.1.7.7 255.255.255.255 null 0</strong></pre>
<p>Verification on R7 should show that both R4 and R6 are now sending their respective RP-Set information to the BSR:</p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<pre><strong>R7#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings
</strong><strong>This system is the Bootstrap Router (v2)</strong><strong>
</strong><strong>Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2
</strong><strong> Info source: 172.16.67.6 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 01:59:04, expires: 00:02:20
</strong><strong> RP 192.1.4.4 (?), v2
</strong><strong> Info source: 172.16.24.4 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:00:27, expires: 00:01:58</strong></pre>
<pre><span style="font-family: Georgia, 'Times New Roman', 'Bitstream Charter', Times, serif; font-size: 13px; line-height: 19px; white-space: normal;">R6 (192.1.6.6) and R4 (192.1.4.4) have actually succeeded in communicating their RP-sets to the BSR. Now that the BSR has learned each of these sets, the BSR will communicate this information to all PIM-SM version 2 enabled devices in the multicast domain. This is observed by issuing the <strong>show ip pim rp mapping</strong> command on each device:</span></pre>
<p><strong> </strong></p>
<pre><strong>R1#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings
</strong><strong> Group(s) 224.0.0.0/4
</strong><strong>RP 192.1.6.6 (?), v2
</strong><strong>Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong>Uptime: 00:12:33, expires: 00:01:53
</strong><strong> RP 192.1.4.4 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 01:11:37, expires: 00:01:55</strong><strong> </strong></pre>
<pre><strong>R2#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings</strong><strong>
</strong><strong>Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 02:54:14, expires: 00:01:56
</strong><strong> RP 192.1.4.4 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:11:37, expires: 00:01:56</strong><strong> </strong></pre>
<pre><strong>R4#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings
</strong><strong>This system is a candidate RP (v2)</strong><strong> </strong></pre>
<pre><strong>Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2</strong></pre>
<pre><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:12:33, expires: 00:01:54
</strong><strong> RP 192.1.4.4 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 01:11:37, expires: 00:01:53</strong></pre>
<pre><strong>R5#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings
</strong><strong> Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:12:33, expires: 00:01:55
</strong><strong> RP 192.1.4.4 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 01:11:37, expires: 00:01:56</strong></pre>
<pre><strong> </strong></pre>
<pre><strong>R6#show ip pim rp mapping</strong></pre>
<pre><strong>PIM Group-to-RP Mappings
</strong><strong>This system is a candidate RP (v2)
</strong><strong> Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 02:54:14, expires: 00:01:53
</strong><strong> RP 192.1.4.4 (?), v2</strong></pre>
<pre><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150</strong></pre>
<pre><strong> Uptime: 00:11:37, expires: 00:01:56</strong></pre>
<pre><strong> </strong></pre>
<pre><strong>R7#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings</strong></pre>
<pre><strong>This system is the Bootstrap Router (v2)
</strong><strong> Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2
</strong><strong> Info source: 172.16.67.6 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 02:10:14, expires: 00:02:14
</strong><strong> RP 192.1.4.4 (?), v2
</strong><strong> Info source: 172.16.24.4 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:11:37, expires: 00:01:49</strong></pre>
<pre><strong> </strong></pre>
<pre><strong>R9#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings</strong></pre>
<p>R9 has not received any RP-Set information from the BSR. How is this information being communicated? Recall that BSR announcements are sent via multicast. Multicast traffic is susceptible to RPF checks. Failure of the multicast traffic to pass the RPF check can be verified via the <strong>show ip rpf</strong> command on R9. This test should be done toward the IP address of the BSR.</p>
<p><strong> </strong></p>
<pre><strong>R9#show ip rpf 192.1.7.7
</strong><strong>RPF information for ? (192.1.7.7)
</strong><strong> RPF interface: FastEthernet0/1
</strong><strong> RPF neighbor: ? (172.16.79.7)
</strong><strong> RPF route/mask: 192.1.7.0/24
</strong><strong> RPF type: unicast (eigrp 100)
</strong><strong> RPF recursion count: 0
</strong><strong> Doing distance-preferred lookups across tables</strong></pre>
<p>This output indicates that there are no RPF issues. This begs the question, &#8220;If there are no RPF failures, what else can cause problems with multicast traffic?&#8221; The answer &#8211; issues related to the forwarding, routing, and filtering of multicast traffic.</p>
<p><strong>debug ip pim bsr</strong> is the best tool for troubleshooting issues on one device associated with multicast forwarding and how this can specifically effect BSR messages:</p>
<pre><strong>R9#debug ip pim bsr
</strong><strong>PIM-BSR debugging is on
</strong><strong>R9#
</strong><strong>PIM-BSR(0): bootstrap dropped</strong></pre>
<p>In this particular instance, the output of the <strong>debug</strong> command states specifically that the bootstrap packets are being dropped. This message will appear every 60 seconds, as new BSR announcements arrive from R7. Why are the packets being dropped?</p>
<p>Careful observation will show that under the FastEthernet0/1 interface of R9 someone has configured the <strong>ip pim bsr-border</strong> command.</p>
<p><strong> </strong></p>
<pre><strong>R9#show run int f0/1
</strong><strong>Building configuration...</strong><strong>
</strong><strong>Current configuration : 165 bytes
</strong><strong>!
</strong><strong>interface FastEthernet0/1
</strong><strong> ip address 172.16.79.9 255.255.255.0
</strong><strong> ip pim bsr-border
</strong><strong> ip pim sparse-mode
</strong><strong> ip igmp join-group 224.9.9.9
</strong><strong> duplex auto
</strong><strong> speed auto
</strong><strong>end</strong></pre>
<p><strong> </strong></p>
<p>When this command is configured on an interface, no PIM-SM version 2 BSR messages will be sent or received through the interface. Removal of this command will allow R9 to receive the RP-set information.</p>
<pre><strong>R9(config)#interface fastethernet0/1
</strong><strong>R9(config-if)#no ip pim bsr-border</strong><strong> </strong></pre>
<p>Once this is accomplished, perform the verification again:</p>
<pre><strong>R9#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings</strong><strong>
</strong><strong>Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.6.6 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:00:51, expires: 00:01:37
</strong><strong> RP 192.1.4.4 (?), v2
</strong><strong> Info source: 192.1.7.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:00:51, expires: 00:01:37</strong></pre>
<p><strong> </strong></p>
<p>The remediation has worked and now all devices have received complete RP-set information from the information source: 192.1.7.7.</p>
<p>As a final verification, a simulated source generated on R1 bound for the multicast group 224.9.9.9 can successfully reach R9&#8242;s FastEthernet0/1 interface:</p>
<pre><strong>R1#ping 224.9.9.9 repeat 10
</strong><strong>Type escape sequence to abort.
</strong><strong>Sending 10, 100-byte ICMP Echos to 224.9.9.9, timeout is 2 seconds:
</strong><strong>Reply to request 0 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 1 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 2 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 3 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 4 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 5 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 6 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 7 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 8 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 9 from 172.16.79.9, 1 ms</strong></pre>
<p>Anthony Sequeira CCIE, CCSI<br />
Twitter: @compsolv<br />
Facebook: http://www.facebook.com/compsolv</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/18/bsr-sample-troubleshooting-scenarios/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/18/bsr-sample-troubleshooting-scenarios/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/18/bsr-sample-troubleshooting-scenarios/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Common Issues with BSR</title>
		<link>http://blog.ipexpert.com/2012/01/17/common-issues-with-bsr/</link>
		<comments>http://blog.ipexpert.com/2012/01/17/common-issues-with-bsr/#comments</comments>
		<pubDate>Tue, 17 Jan 2012 16:44:03 +0000</pubDate>
		<dc:creator>Anthony Sequeira</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[bsr]]></category>
		<category><![CDATA[exam]]></category>
		<category><![CDATA[lab]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9837</guid>
		<description><![CDATA[The following is an excerpt from the latest IPexpert text, IPv4/6 Multicast Operation and Troubleshooting by Anthony Sequeira and Terry Vinson.]]></description>
			<content:encoded><![CDATA[<p>The following is an excerpt from the latest IPexpert text, <strong><em><a href="http://www.ipexpert.com/cisco/trouble-series-1" target="_blank">IPv4/6 Multicast Operation and Troubleshooting</a> </em></strong>by Anthony Sequeira and Terry Vinson.</p>
<div>
<h2><strong>Common Issues with BSR</strong></h2>
<p>While not as problematic as AutoRP, there are a number of issues that can surface with Bootstrap Router protocol. The most common problems relate to the exchange of essential control plane information. By far the control plane establishment in BSR has many more components compared to its data plane process, but when compared to its AutoRP counterpart, BSR is much easier to troubleshoot. For simplicity in troubleshooting common issues while deploying BSR, we identify three categories of problems: Reverse Path Forwarding (RPF) failures, unicast routing issues, and multicast routing problems.<span id="more-9837"></span></p>
<h2><strong>RPF Failures </strong></h2>
<p>In the <strong><em>Troubleshooting BSR</em></strong> section, this text discussed what phases of the BSR operational mechanisms where subject to Reverse Path Forwarding (RPF) checks. Recall that of the three phases, only the BSR election/announcement phase and the propagation of group-to-RP mappings phase are subject to the RPF process. Logically then, RPF issues can prevent a candidate-BSR from learning about other candidate-BSRs. Additionally, this problem can prevent an elected BSR from successfully communicating the candidate RP-set to any, some, or all of the other PIM enabled devices in the multicast domain.</p>
<p>The following list of issues has a relatively high probability of occurring thanks to RPF failures. Remember that these RPF checks are performed against the IP address of the BSR itself. Be aware that anytime all interfaces in a network are not running PIM &#8211; these issues may arise.</p>
<ul>
<li>Candidate-BSRs do not agree on the identity of the BSR for the multicast domain.</li>
<li>All or some of the PIM-SM version 2 enabled devices in the multicast domain do not receive any candidate RP-set information from the elected BSR.</li>
</ul>
<p>We will perform a walk through for each of these RPF issues in the <strong><em>BSR Sample Troubleshooting Scenarios </em></strong>section that follows.</p>
<h2><strong>Unicast Routing and Forwarding Problems</strong></h2>
<p>From earlier portions of this chapter, it is clear that the ability of the RP candidates to communicate their candidate group-to-RP mapping information directly to the BSR is dependent on their ability to unicast to the advertised IP address of the BSR. Of course, since this reachability is unicast, it is not subject to RPF checks. As a result, a common issue is:</p>
<ul>
<li>An elected BSR fails to learn candidate group-to-RP mappings from all or some of the C-RPs in the topology and the IP address of the candidate RP(s) are not reachable when ICMP echoes are sourced from the IP address of the BSR.</li>
</ul>
<p>This is a situation where it will be necessary to look at the underlying routing protocols used in the network. Typically, this would be an issue of asynchronous routing, and should be something obvious once the routing tables of the source and transit devices are analyzed.</p>
<h2><strong>Multicast Routing and Forwarding Problems</strong></h2>
<p>These problems manifest themselves in more subtle ways when compared to the previous points. As discussed earlier, the majority of the BSR operational mechanisms involve the formation of the control plane so that a device can be assigned as the BSR, and so that C-RP group-to-RP mappings can be communicated to the BSR. From that point, the candidate RP-set information can be propagated throughout the multicast domain.</p>
<p>Situations like the following exist when information fails to propagate to any or all devices, but RPF checks and unicast routing seem to be functioning correctly:</p>
<ul>
<li>One or more candidate-RP(s) fail to receive any c-RP-set information from the BSR.</li>
<li>One or more candidate-BSR fails to participate in the BSR election process resulting in the assignment of more than one BSR.</li>
</ul>
<p>In the <strong><em>BSR Sample Troubleshooting Scenarios</em></strong> section that follows, troubleshooting these issues are demonstrated. For each problem, the text demonstrates how to quickly and efficiently verify each symptom, isolate the cause, and remediate the issue.</p>
</div>
<p>Anthony Sequeira CCIE, CCSI<br />
Twitter: @compsolv<br />
Facebook: http://www.facebook.com/compsolv</p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/17/common-issues-with-bsr/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/17/common-issues-with-bsr/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/17/common-issues-with-bsr/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>The Operation and Troubleshooting of the Bootstrap Router (BSR) Protocol</title>
		<link>http://blog.ipexpert.com/2012/01/16/the-operation-and-troubleshooting-of-the-bootstrap-router-bsr-protocol/</link>
		<comments>http://blog.ipexpert.com/2012/01/16/the-operation-and-troubleshooting-of-the-bootstrap-router-bsr-protocol/#comments</comments>
		<pubDate>Mon, 16 Jan 2012 15:51:32 +0000</pubDate>
		<dc:creator>Anthony Sequeira</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[bsr]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9766</guid>
		<description><![CDATA[The following post is an excerpt from IPexpert's latest text - IPv4/6 Multicast Operation and Troubleshooting. ]]></description>
			<content:encoded><![CDATA[<p>The following is an excerpt from the latest IPexpert text, <strong><em><a href="http://www.ipexpert.com/cisco/trouble-series-1" target="_blank">IPv4/6 Multicast Operation and Troubleshooting</a> </em></strong>by Anthony Sequeira and Terry Vinson.</p>
<h1>The Operation and Troubleshooting of BSR</h1>
<p>To better understand how to troubleshoot BSR we will divide its basic operation into three distinct stages: BSR election/announcements, candidate-Rendezvous Point announcements, and the propagation of group-to-RP mappings. Once each phase has been outlined and defined, we will see how its operation could be negatively impacted by environmental variables found in the multicasting, IP routing, and switching domains.<span id="more-9766"></span></p>
<h2>BSR Election/Announcements</h2>
<p>In this stage of the BSR operation a Bootstrap Router has either been assigned, or elected on the basis of its configured priority. This works in a two stage process whereby the identity of a BSR is discovered. During this stage, every router that has been configured to work as a Bootstrap Router will begin to flood &#8220;bootstrap messages&#8221; while simultaneously listening for &#8220;bootstrap messages&#8221; from other candidate-BSRs in the domain. Once a BSR learns of another BSR with a higher priority it will immediately relinquish its role as BSR. This demonstrates that the BSR election process is preemptive in nature and is designed to provide alternate availability during equipment or process failures. It must be observed that this process ultimately, if configured properly, will result in the election of a single BSR. Other devices may exist in the multicast domain that can assume the role of the BSR, but they will always remain in a standby state until the existing BSR goes down or the priority settings are changed. After the BSR is elected, it will begin attempting to discover the identity of any existing candidate-RPs (C-RPs). The BSR will also actively listen for messages coming from these C-RPs as they are discovered.</p>
<p>In an effort to find the C-RPs in the domain, the BSR will first begin to inform the other devices in the topology of its existence. BSR accomplishes this using PIM-SM version 2 protocol messages. These messages are flooded on a hop-by-hop basis between all devices in the multicast domain. Figure 9-2 illustrates this process.</p>
<div id="attachment_9778" class="wp-caption alignleft" style="width: 659px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-2.png"><img class="size-full wp-image-9778 " title="9-2" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-2.png" alt="" width="649" height="241" /></a><p class="wp-caption-text">Figure 9-2: The BSR Announcing its Presence</p></div>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>Clearly, BSR can only be employed between PIM version 2 enabled devices. It is important to note that because of this; BSR is not compatible with PIM-SM version 1. The primary difference between PIM-SM versions 1 and 2 is that in version 2, messages are no longer encapsulated inside IGMP. PIM version 2 messages are encapsulated in IP packets with a protocol number of 103. Another significant difference is that PIM-SM version 2 messages are propagated throughout the domain via the link-local multicast group 224.0.0.13 (ALL-PIM-ROUTERS). As described in the <strong><em>BSR Technology Review</em></strong> section, this means that BSR does not require any legacy dense mode functionality to announce its presence throughout the multicast domain as is the case with AutoRP. Fortunately, these distinctions reduce the level of difficulty associated with troubleshooting all phases of the BSR operational process. Placement of the BSR is no longer as sensitive an issue as with its AutoRP counterpart, the Mapping Agent (MA). Furthermore, the use of a link-local multicast address for hop-by-hop flooding of BSR announcements creates fewer overall issues compared to AutoRP in general.</p>
<p>The fact that BSR uses a multicast address to communicate its identity and presence to the multicast domain means that this phase of BSR is subjected to Reverse Path Forwarding (RPF) checks. Specifically, any messages destined for PIM speakers in the domain will need to pass the RPF check toward the IP address of the BSR from the C-RP. The multicast process drops messages that fail this check.</p>
<p>The fastest method to determine that BSR announcements are being propagated successfully is to execute the <strong>show ip pim bsr-router</strong> command on each of the respective candidate-RPs. In a working environment, like that shown in Figure 9-3, we would expect to see output similar to the following for this command:<strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong></p>
<div id="attachment_9786" class="wp-caption alignleft" style="width: 659px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-3.png"><img class="size-full wp-image-9786" title="9-3" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-3.png" alt="" width="649" height="241" /></a><p class="wp-caption-text">Figure 9-3: A Sample Working BSR Topology</p></div>
<p></strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>
</strong></pre>
<pre><strong>R5#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.2.2 (?)
</strong><strong> Uptime:          00:00:21, BSR Priority: 0, Hash mask length: 0
</strong><strong> Expires:          00:02:00
</strong><strong> Candidate RP: 192.1.5.5(Loopback0)
</strong><strong> Holdtime 150 seconds
</strong><strong> Advertisement interval 60 seconds
</strong><strong> Next advertisement in 00:00:50</strong></pre>
<p>Notice the identity of the Bootstrap Router is 192.1.2.2, which is the Loopback0 interface of R2. We have two C-RPs in this topology so we will repeat this <strong>show</strong> command on the second C-RP:</p>
<pre><strong>R7#show ip pim bsr-router
</strong><strong>PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.2.2 (?)
</strong><strong> Uptime:          00:12:40, BSR Priority: 0, Hash mask length: 0
</strong><strong> Expires:           00:01:59
</strong><strong> Candidate RP: 192.1.7.7(Loopback0)
</strong><strong> Holdtime 150 seconds
</strong><strong> Advertisement interval 60 seconds
</strong><strong> Next advertisement in 00:00:49</strong></pre>
<p><strong> </strong></p>
<p>The second C-RP knows the identity of the BSR as well. Clearly, the BSR announcements have successfully propagated to all C-RPs in the topology.</p>
<p><strong>Note:</strong> Notice the (?) entry next to the BSR address. This is not a point for concern. This simply means that the C-RP cannot resolve the IP address to a hostname.</p>
<p>Earlier it was described how the elected BSR begins to actively listen for messages coming from the C-RPs. It is clear now that the C-RPs know where to send their messages thanks to the propagation of the BSR information. Notice also in the output of the <strong>show</strong> commands used above that there is candidate-RP information on both R5 and R7 that needs to be communicated. Also note the holdtime and advertisement intervals for each.</p>
<p>Before the next stage of verification, however, execute the same <strong>show</strong> command on a device participating in the multicast domain that is not a C-RP. For example, R4:</p>
<pre><strong>R4#sh ip pim bsr-router
</strong><strong> PIMv2 Bootstrap information
</strong><strong> BSR address: 192.1.2.2 (?)
</strong><strong> Uptime:      00:41:02, BSR Priority: 0, Hash mask length: 0
</strong><strong> Expires:     00:01:18</strong></pre>
<p>Note that R4 knows the identity of the BSR, but has no candidate-RP information to communicate. This is a normal condition for this stage of the BSR operation. It is time to take a closer look at the second stage of BSR.</p>
<h2>Candidate-Rendezvous Point Announcement</h2>
<p>In the previous section, the election of the BSR was observed, and the process of  PIM-SM version 2 announcements were monitored. This resulted in the C-RPs and other PIM devices participating in the multicast domain learning the identity of the BSR. This section focuses on how the BSR dynamically learns the identity of all devices configured as RP candidates.</p>
<p>After a C-RP discovers the BSR it will immediately begin to send periodic C-RP advertisements directly to the BSR every 60 seconds via unicast. This is the default advertisement interval and can be changed. The default holdtime is 150 seconds. In addition to notifying the BSR of its identity, the RP candidates also communicate what group-to-RP mappings they possess. Figure 9-4 illustrates this unicast process.</p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong></p>
<div id="attachment_9783" class="wp-caption alignleft" style="width: 659px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-4.png"><img class="size-full wp-image-9783 " title="9-4" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-4.png" alt="" width="649" height="241" /></a><p class="wp-caption-text">Figure 9-4: The C-RP Announcements</p></div>
<p></strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>Let us examine the BSR to see if it is receiving the information unicast by the individual C-RPs. Use the <strong>show ip pim rp mapping</strong> command on the BSR itself to accomplish this:</p>
<p><strong> </strong></p>
<pre><strong>R2#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings
</strong><strong>This system is the Bootstrap Router (v2)</strong><strong>
</strong><strong>Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.7.7 (?), v2
</strong><strong> Info source: 172.16.67.7 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:57:49, expires: 00:01:36
</strong><strong> RP 192.1.5.5 (?), v2
</strong><strong> Info source: 172.16.45.5 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:35:57, expires: 00:01:29</strong></pre>
<p>Note the BSR has learned the identity of both candidate-RP devices.</p>
<p>The fact that C-RP advertisements are sent via unicast means that RPF checks are unnecessary. This makes this phase of the BSR operational mechanism very streamlined and easy to troubleshoot. Should any information from any RP candidate fail to appear in the BSR&#8217;s group-to-RP mappings table, it is most likely an IP routing issue. This can quickly be identified by pinging the IP address of the C-RP in question from the BSR. To ensure the proper testing of bidirectional unicast reachability, always source this ping from the BSR&#8217;s IP address. For example:</p>
<pre><strong>R2#ping 192.1.7.7 source loopback 0
</strong><strong> Type escape sequence to abort.
</strong><strong>Sending 5, 100-byte ICMP Echos to 192.1.7.7, timeout is 2 seconds:
</strong><strong> Packet sent with a source address of 192.1.2.2
</strong><strong>!!!!!
</strong><strong>Success rate is 100 percent (5/5), round-trip min/avg/max = 1/2/4 ms</strong></pre>
<p>In the third and final stage of the BSR operational mechanism, the BSR begins to flood group-to-RP mapping information to other devices in the multicast domain.</p>
<h2>Propagation of Group-to-RP Mappings</h2>
<p>In this phase of the BSR operation, the BSR floods all of the group-to-RP C-RP advertisements in its PIM group-to-RP mappings table throughout the multicast domain. In this stage, the information that the BSR communicates is known as the &#8220;candidate RP-set&#8221; or just &#8220;RP-set&#8221; for short.</p>
<p>This propagation of mappings phase uses the same methodology that the BSR employed to communicate its presence to the RP candidates in the earlier step. This means that if the initial phase of the BSR announcement process operated without complication, then it is highly likely that this stage will perform likewise. Figure 9-5 illustrates the hop-by-hop flooding process employed to propagate the RP-set information.</p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong></p>
<div id="attachment_9789" class="wp-caption alignleft" style="width: 659px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-5.png"><img class="size-full wp-image-9789" title="9-5" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-5.png" alt="" width="649" height="241" /></a><p class="wp-caption-text">Figure 9-5: The C-RP RP-Set Announcements</p></div>
<p></strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p><strong> </strong></p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>Remember, this process uses the PIM-SM version 2 multicast address of 224.0.0.13 to communicate with the PIM enabled devices in the network on a hop-by-hop basis. This process, because it employs multicast, is susceptible to the RPF check.</p>
<p>The most efficient method employed to test whether or not the BSR has successfully communicated the RP-set information to each of the devices in the topology is to execute the <strong>show ip pim rp mapping</strong> command on each device participating in the multicast domain. This should produce identical output on all devices similar to the following:</p>
<pre><strong>R4#show ip pim rp mapping
</strong><strong>PIM Group-to-RP Mappings
</strong><strong> Group(s) 224.0.0.0/4
</strong><strong> RP 192.1.7.7 (?), v2
</strong><strong> Info source: 192.1.2.2 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 01:41:24, expires: 00:01:44
</strong><strong> RP 192.1.5.5 (?), v2
</strong><strong> Info source: 192.1.2.2 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 01:19:31, expires: 00:01:43</strong></pre>
<p>The critical component here is that all devices should have the same group-to-RP mappings. Note that both RP candidates are mapped to provide RP services to the entire multicast group range of 224.0.0.0/4.</p>
<p>Which C-RP will assume the role of RP if a multicast source is introduced to the topology? Emulate a multicast source destined to the group address of 224.9.9.9 on the FastEthernet interface of R1 and examine where the source-based tree terminates:</p>
<pre><strong>R1#ping 224.9.9.9 repeat 100000</strong></pre>
<p>This ping will not be successful because there are no multicast receivers for this group in the topology, but it provides a way to verify what C-RP will assume the role of RP for the group 224.9.9.9. This is proven using the <strong>show ip pim rp</strong> command on both R5 and R7:</p>
<pre><strong>R5#show ip pim rp
</strong><strong>Group: 224.9.9.9, RP: 192.1.7.7, v2, uptime 01:34:58, expires 00:01:30
</strong><strong>R7#show ip pim rp
</strong><strong>Group: 224.9.9.9, RP: 192.1.7.7, v2, next RP-reachable in 00:00:16</strong></pre>
<p>The output indicates that the RP is R7 (192.1.7.7). The BSR process selects R7 as the RP because the assigned priority for each of the candidates is the same. In this topology, the Cisco default of priority of 0 is used. In instances where the priority is a tie, the determining factor for RP selection is the highest IP address as described in the <strong><em>BSR Technology Review</em></strong> section.</p>
<p>Once again, it is critical to note that this process of RP selection is not performed by the BSR. Unlike the mapping agent in AutoRP, the Bootstrap Router communicates the entire RP-set to the devices in the multicast domain. The individual devices accept the RP-set and then make logical decisions as to which C-RP they select. Network administrators can manipulate or influence this election process through the use of hashes, priorities, filters, and message constraints.</p>
<h2>Load Balancing Between Candidate-RPs</h2>
<p>It is possible to distribute RP functionality between multiple C-RPs when configuring BSR. This load balancing is not always a perfectly balanced approach between individual RPs.  However, using factors like the total number of available C-RPs and an optional value known as the hash mask length can provide an approximation of load balancing. Assigning a value to the hash mask length greater than the default of &#8220;0&#8243; directly affects the normal RP selection algorithm that runs on all PIM-SM version 2 enabled devices. Hash mask length is communicated to all devices inside the BSR announcements.</p>
<p>Generally, the longer the hash length, the more evenly the BSR process will try to assign groups to individual RPs in the candidate RP-Set. The assumptions are that the same hash mask length is communicated to each PIM-SM version 2 device by the BSR, and that each of those devices has the same candidate RP-set. As a result, each PIM device runs the same algorithm and makes the same RP selection for each multicast group.</p>
<p>There are three values used by this mathematical function in BSR: the candidate-RP address, a multicast group address, and the hash mask length. These values are all hashed together on a group-by-group basis in order to approximate the load balancing.</p>
<p>This process can be summarized as follows:</p>
<p>1 &#8211; A hashing algorithm is run for each multicast group address for each C-RP in the RP-set and a hash value is obtained.</p>
<p>2 &#8211; The C-RP with the highest calculated hash value becomes the RP for that particular multicast group.</p>
<p>3 &#8211; There is the possibility that the hashing algorithm will result in equal hash values for different C-RPs. In this case, the C-RP with the highest IP address will become the RP for that group. With all this taken into account, the outcome should be predicable:</p>
<p>2<sup>(32 &#8211; hash length) = </sup># of RPs that will be used in load balancing*</p>
<p>* This assumes that there are enough C-RPs in the RP-set to allow an even distribution.</p>
<p>Figure 9-6 shows a sample topology for load balancing.</p>
<p><span style="font-weight: 800;"> </span></p>
<div id="attachment_9795" class="wp-caption alignleft" style="width: 634px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-6.png"><img class="size-full wp-image-9795" title="9-6" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-6.png" alt="" width="624" height="232" /></a><p class="wp-caption-text">Figure 9-6: A Sample C-RP Load Balancing Topology</p></div>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>In this example, there are two candidate-RPs. In order to achieve the most even distribution between these devices apply a hash mask length of 31 to the <strong>ip pim bsr-candidate</strong> command on R2:</p>
<pre><strong>R2(config)#ip pim bsr-candidate Loopback0 31</strong></pre>
<p><strong> </strong></p>
<p>Now verify what RP each device in the topology will use for any given group through the use of the <strong>show ip pim rp-hash</strong> command. Here is such a test on R4 using the multicast group addresses of 224.1.1.1 and 224.1.1.2: <strong> </strong></p>
<p><strong> </strong></p>
<pre><strong>R4#show ip pim rp-hash 224.1.1.1
</strong><strong> RP 192.1.7.7 (?), v2
</strong><strong> Info source: 192.1.2.2 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:18:30, expires: 00:02:06
</strong><strong> PIMv2 Hash Value (mask 255.255.255.254)
</strong><strong> RP 192.1.7.7, via bootstrap, priority 0, hash value 1483128991
</strong><strong> RP 192.1.5.5, via bootstrap, priority 0, hash value 1211976133</strong></pre>
<p>Note the hash value of R7=1,483,129,991. This is greater than R5&#8242;s value of 1,211,976,133, so R7 is selected as the RP for the group 224.1.1.1. Now for the group 224.1.1.2:</p>
<pre><strong>R4#show ip pim rp-hash 224.1.1.2
</strong><strong> RP 192.1.5.5 (?), v2
</strong><strong> Info source: 192.1.2.2 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:51:56, expires: 00:02:16
</strong><strong> PIMv2 Hash Value (mask 255.255.255.254)
</strong><strong> RP 192.1.7.7, via bootstrap, priority 0, hash value 423840189
</strong><strong> RP 192.1.5.5, via bootstrap, priority 0, hash value 694993047</strong></pre>
<p><strong> </strong></p>
<p>The hashing process selects R5 as the RP because of its higher hash value. Now for 224.1.1.3:</p>
<pre><strong>R4#show ip pim rp-hash 224.1.1.3
</strong><strong> RP 192.1.5.5 (?), v2
</strong><strong> Info source: 192.1.2.2 (?), via bootstrap, priority 0, holdtime 150
</strong><strong> Uptime: 00:52:00, expires: 00:02:12
</strong><strong> PIMv2 Hash Value (mask 255.255.255.254)
</strong><strong> RP 192.1.7.7, via bootstrap, priority 0, hash value 423840189
</strong><strong> RP 192.1.5.5, via bootstrap, priority 0, hash value 694993047</strong></pre>
<p><strong> </strong></p>
<p>Notice the hashing process selects R5 again. One might logically think that it would fall to R7, but notice this is not the case. The algorithm will try to evenly distribute the load between the two available candidate-RPs, but it will do so via a relatively random process, given the wide range of arbitrary variables that go into the hash calculation.</p>
<h2>The Final Step</h2>
<p>As one last step to fully demonstrate that our BSR configuration and multicast domain are configured properly, R9 joins the multicast group 224.9.9.9.  Verify that a ping test from R1 is successful.</p>
<pre><strong>R9(config)#interface FastEthernet0/1
</strong><strong>R9(config-if)#ip igmp join-group 224.9.9.9
</strong><strong>R9(config-if)#end</strong></pre>
<p>This results in successful pings on R1:</p>
<pre><strong>R1#ping 224.9.9.9 repeat 100000
</strong><strong>Type escape sequence to abort.
</strong><strong>Sending 100000, 100-byte ICMP Echos to 224.9.9.9, timeout is 2 seconds:
</strong><strong>Reply to request 0 from 172.16.79.9, 4 ms
</strong><strong>Reply to request 1 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 2 from 172.16.79.9, 1 ms
</strong><strong>Reply to request 3 from 172.16.79.9, 1 ms</strong></pre>
<p>Anthony Sequeira CCIE, CCSI<br />
Twitter: @compsolv<br />
Facebook: http://www.facebook.com/compsolv<strong><br />
</strong></p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/16/the-operation-and-troubleshooting-of-the-bootstrap-router-bsr-protocol/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/16/the-operation-and-troubleshooting-of-the-bootstrap-router-bsr-protocol/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/16/the-operation-and-troubleshooting-of-the-bootstrap-router-bsr-protocol/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Bootstrap Router (BSR) Protocol Technology Review</title>
		<link>http://blog.ipexpert.com/2012/01/15/bootstrap-router-bsr-protocol-technology-review/</link>
		<comments>http://blog.ipexpert.com/2012/01/15/bootstrap-router-bsr-protocol-technology-review/#comments</comments>
		<pubDate>Sun, 15 Jan 2012 17:58:03 +0000</pubDate>
		<dc:creator>Anthony Sequeira</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[bootstrap router protocol]]></category>
		<category><![CDATA[bsr]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[PIM]]></category>
		<category><![CDATA[r&s]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9754</guid>
		<description><![CDATA[In this excerpt from IPv4/6 Multicast Operation and Troubleshooting, the Bootstrap Router protocol is thoroughly reviewed. ]]></description>
			<content:encoded><![CDATA[<p>The following is an excerpt from the latest IPexpert text, <strong><em><a href="http://www.ipexpert.com/cisco/trouble-series-1" target="_blank">IPv4/6 Multicast Operation and Troubleshooting</a> </em></strong>by Anthony Sequeira and Terry Vinson.</p>
<h1>Chapter 9: Bootstrap Router (BSR) Protocol</h1>
<p>In this chapter of <strong><em>IPv4/6 Multicast Operation and Troubleshooting</em></strong>, the processes and the functionality of the Bootstrap Router (BSR) protocol are examined in great depth. Once the operational characteristics of this important protocol are detailed completely, the focus becomes that of troubleshooting. This includes the careful examination of symptoms, a fault isolation methodology, and the implementation of repairs for the Bootstrap Routing (BSR) protocol. The chapter begins with a thorough review of BSR, and then quickly launches in to an exhaustive analysis of the “art” of troubleshooting this multicast support protocol. This important chapter concludes with sample troubleshooting scenarios, reference materials for the most important <strong>show</strong> and <strong>debug</strong> commands, and exciting challenges that allow readers to practice implementing the troubleshooting skills they have obtained.<span id="more-9754"></span></p>
<h2>BSR Technology Review</h2>
<p>Bootstrap router (BSR) was created as an open standard solution meant to address many of the shortcomings in the Cisco proprietary AutoRP technology. The Protocol Independent Multicast Sparse Mode (PIM-SM) version 2 specification introduced BSR.</p>
<p><strong>Note:</strong> Many texts refer to BSR as simply PIM-SM version 2.</p>
<p>While BSR addresses many issues with AutoRP, it operates in a very similar manner when examined from a high level. There are router(s) that act as candidate-Rendezvous Points (RPs) and router(s) that act similar to the Mapping Agent (MA) found in AutoRP. In BSR terminology, the equivalent to the Mapping Agent is the Bootstrap Router itself.</p>
<p><strong>Note:</strong> AutoRP is detailed in <strong><em>Chapter 8: AutoRP</em></strong>.</p>
<p>Figure 9-1 demonstrates a sample BSR topology. <strong> </strong><br />
<strong> </strong></p>
<p style="text-align: left;">&nbsp;</p>
<div id="attachment_9761" class="wp-caption alignleft" style="width: 659px"><a href="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-11.png"><img class="size-full wp-image-9761" title="9-1" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/9-11.png" alt="" width="649" height="241" /></a><p class="wp-caption-text">Figure 9-1: A Sample BSR Topology</p></div>
<p style="text-align: left;"><strong><br />
</strong></p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>&nbsp;</p>
<p>A major design improvement over Cisco’s AutoRP is the fact that BSR requires no dense mode operation whatsoever. Rendezvous Point (RP) information is within BSR messages, which are carried inside of Protocol Independent Multicast (PIM) messages themselves. These PIM messages are link-local multicast messages. When a router receives a BSR message containing RP information, the router applies the Reverse Path Forwarding (RPF) check and then floods the message out all of the PIM-enabled interfaces. Remember, the link-local multicast address used for PIM messages is 224.0.0.13.</p>
<p>Since the PIM messages that carry the BSR information are link-local in scope, notice that there is no Time to Live (TTL) scoping that can be used with BSR.</p>
<p><strong>Note:</strong> BSR and AutoRP cannot interoperate directly with each other.</p>
<p>Obviously, a key element to the BSR process is the device or devices that want to serve as the Rendezvous Point for multicast groups in the Sparse Mode domain. To configure a candidate-RP in BSR, use the following command:<strong> </strong></p>
<p><strong>ip</strong> <strong>pim</strong> [<strong>vrf</strong> <em>vrf-name</em>] <strong>rp-candidate</strong> <em>interface-type</em> <em>interface-number</em> [<strong>bidir</strong>] [<strong>group-list</strong> <em>access-list</em>] [<strong>interval</strong> <em>seconds</em>] [<strong>priority</strong> <em>value</em>]</p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> &#8211; configures the router to advertise itself as the candidate-RP to the Bootstrap Router for the Virtual Routing and Forwarding (VRF) instance specified for the <em>vrf-name</em> argument</li>
<li><strong>interface-type interface-number</strong> &#8211; the interface bound to the IP address to serve as the candidate-RP IP address; for availability purposes, consider the use of a loopback interface; this interface needs to be PIM enabled</li>
<li><strong>bidir </strong>- optional &#8211; indicates that the multicast groups specified by the <em>access-list </em>argument are to operate in PIM bidirectional mode; PIM bidirectional mode is covered in <strong><em>Chapter 6: Bidirectional PIM</em></strong></li>
<li><strong>group-list </strong>- optional &#8211; specifies the prefixes that are advertised in association with the RP address; note that unlike AutoRP, this list cannot contain DENY entries</li>
<li><strong>interval </strong>- optional &#8211; specifies the candidate-RP advertisement interval, in seconds; the range is from 1 to 16383 with a default value of 60 seconds</li>
<li><strong>priority </strong>- optional &#8211; specifies the priority for the candidate-RP; the range is from 0 to 255; with a default priority value of 0; the BSR candidate-RP with the lowest priority value is preferred; be aware that other vendor implementations of BSR might default priority to 192 as this is the recommended default priority by the IETF</li>
</ul>
<p>As stated earlier, the Bootstrap Router itself in the topology is similar to the Mapping Agent in AutoRP with some subtle differences. Like the AutoRP Mapping Agent, the BSR listens to the candidate-RP announcements, but the BSR does not actually select the best RP for every group range. Instead, the BSR builds a set of candidate-RPs for each group range and disseminates this information to the topology using PIM. Multicast routers that receive these BSR messages select the preferred candidate-RP using a special hash function.</p>
<p>To configure the BSR router itself, use the following command:</p>
<p><strong>ip</strong> <strong>pim</strong> [<strong>vrf</strong> <em>vrf-name</em>] <strong>bsr-candidate</strong> <em>interface-type</em> <em>interface-number</em> [<em>hash-mask-length</em> [<em>priority</em>] ]<strong> </strong></p>
<p>Where:</p>
<ul>
<li><strong>vrf</strong> &#8211; configures the router to advertise itself as the Bootstrap Router for the Virtual Routing and Forwarding (VRF) instance specified for the <em>vrf-name</em> argument</li>
<li><strong>interface-type interface-number</strong> &#8211; the interface bound to the IP address to serve as the BSR device IP address; for availability purposes, consider the use of a loopback interface; this interface needs to be PIM enabled and the IP address is sent in BSR messages as the BSR IP address</li>
<li><strong>hash-mask-length</strong> &#8211; optional &#8211; the length of the mask to be ANDed with the group address before the PIMv2 hash function; all groups with the same seed hash correspond to the same RP; the hash mask length allows one RP to be used for multiple groups; the default length is 0</li>
<li><strong>priority </strong>- priority of the candidate-BSR; the range is from 0 to 255 with a default priority of 0; the candidate-BSR with the highest priority value is preferred; RFC 5059 specifies that 64 be used as the default priority value</li>
</ul>
<p>It is important to remember that in BSR, the multicast routers determine the RP to use based on RP-set information received from the BSR itself. The RP selection process for a particular multicast group is as follows:</p>
<p><strong>Step 1 </strong>- a longest match lookup is performed on the group prefix that is announced by the BSR candidate-RPs</p>
<p><strong>Step 2 </strong>-<strong> </strong>if more than one candidate-RP is found by the longest match lookup, the candidate-RP with the lowest priority (configured with the<strong> ip pim rp-candidate </strong>command) is preferred</p>
<p><strong>Step 3 </strong>-<strong> </strong>if more than one candidate-RP have the same priority, the BSR hash function is used to select the RP for a group; this hash function is covered in detail in the <strong><em>Operation and</em></strong> <strong><em>Troubleshooting BSR</em></strong> section of this chapter</p>
<p><strong>Step 4 </strong>- if more than one candidate-RP return the same hash value derived from the BSR hash function, the candidate-RP with the highest IP address is preferred</p>
<p><strong>Note:</strong> RFC 2362 does not specify the longest match lookup step, to ensure compatibility with this standard, configure the same group prefix length for redundant candidate-RPs.</p>
<p>Anthony Sequeira CCIE, CCSI<br />
Twitter: @compsolv<br />
Facebook: http://www.facebook.com/compsolv</p>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/15/bootstrap-router-bsr-protocol-technology-review/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/15/bootstrap-router-bsr-protocol-technology-review/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/15/bootstrap-router-bsr-protocol-technology-review/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Introducing IPexpert&#8217;s New IPv4/IPv6 Multicast Operation and Troubleshooting Guide</title>
		<link>http://blog.ipexpert.com/2012/01/13/introducing-ipexperts-new-ipv4ipv6-multicast-operation-and-troubleshooting-guide/</link>
		<comments>http://blog.ipexpert.com/2012/01/13/introducing-ipexperts-new-ipv4ipv6-multicast-operation-and-troubleshooting-guide/#comments</comments>
		<pubDate>Fri, 13 Jan 2012 15:18:55 +0000</pubDate>
		<dc:creator>Jessica Scott</dc:creator>
				<category><![CDATA[CCIE]]></category>
		<category><![CDATA[Routing & Switching]]></category>
		<category><![CDATA[Security]]></category>
		<category><![CDATA[Service Provider]]></category>
		<category><![CDATA[Storage]]></category>
		<category><![CDATA[Voice]]></category>
		<category><![CDATA[Wireless]]></category>
		<category><![CDATA[multicast]]></category>
		<category><![CDATA[practice]]></category>
		<category><![CDATA[Troubleshooting]]></category>

		<guid isPermaLink="false">http://blog.ipexpert.com/?p=9712</guid>
		<description><![CDATA[Introducing a new generations of CCIE-level preparation and reference materials from IPexpert. ]]></description>
			<content:encoded><![CDATA[<p><img class="alignnone size-full wp-image-9714" src="http://blog.ipexpert.com/wp-content/uploads/2012/01/New_book_banner_4.png" alt="" width="443" height="236" /></p>
<p>IPexpert is thrilled to introduce the first installment in our <strong>NEW Protocol Operation and Troubleshooting Series</strong>, IPexpert&#8217;s <a href="https://www.ipexpert.com/Cisco/Trouble-Series-1" target="_blank">IPv4/IPv6 Multicast Operation and Troubleshooting</a>.  This series was designed around CCIE student feedback on specific protocols and technologies that they feel they struggled with most  when preparing for the CCIE Lab exam. IPexpert&#8217;s IPv4/IPv6 Multicast  Operation and Troubleshooting dives deep into the <strong><em>specific operations and troubleshooting technologies</em></strong> for key multicast areas such as IGMP,  PIM Sparse Mode, multicast security and much more.</p>
<p>Developed by the industry&#8217;s most recognized Senior Technical Instructors, Editors, and Consultants, this new book series is sure to assist you in better understanding IPv4/IPv6 Multicast operations, troubleshooting methodologies, and time saving fault isolation techniques.</p>
<h3><span style="color: #993300">IPexpert&#8217;s IPv4/IPv6 Multicast Operation and Troubleshooting Topics:</span></h3>
<p style="padding-left: 30px"><strong>I. Introduction to Multicast Troubleshooting</strong><br />
<strong>II. IGMP</strong><br />
<strong>III. PIM Dense Mode</strong><br />
<strong>IV. PIM Sparse Mode</strong><br />
<strong>V. PIM Sparse-Dense Mode</strong><br />
<strong>VI. Bidirectional PIM</strong><br />
<strong>VII. Static RPs</strong><br />
<strong>VII. AutoRP</strong><br />
<strong>IX. BSR</strong><br />
<strong>X.  MSDP</strong><br />
<strong>XI. Anycast</strong><br />
<strong>XII. MP-BGP for Multicast</strong><br />
<strong>XIII. Interdomain Multicast</strong><br />
<strong>XIV. Multicast Advanced Features</strong><br />
<strong>XV. Multicast Security</strong><br />
<strong>XVI. IPv6 PIM</strong><br />
<strong>XVII. IPv6 MLD</strong></p>
<p><strong> </strong>Each section listed above contains an exhaustive technology review, <strong>show </strong>and <strong>debug </strong> command tools, review of common issues, sample troubleshooting scenarios  and chapter challenge sample Trouble Tickets with solutions. Sample  trouble tickets follow Proctor Labs topologies, and have also been fully tested on home racks and the most popular emulators in use today.</p>
<p>Check out the <a href="http://www.ipexpert.com/samples/IPexperts_Multicast-Operations-and-Troubleshooting-SAMPLE.pdf" target="_blank">free sample chapter <em><strong>Chapter 9: Bootstrap Router Protocol</strong></em></a> to examine this incredible new product series. The full IPv4/IPv6 Multicast Operations and Troubleshooting text releases Feb 20, 2012.</p>
<div style="width: 100%;height: 400px">
<div style="float: left;width: 300px;height: 250">
<p><a href="https://www.ipexpert.com/samples/IPexperts_Multicast-Operations-and-Troubleshooting-SAMPLE.pdf"><img src="http://blog.ipexpert.com/wp-content/uploads/2012/01/Free_Download.png" alt="" /></a></p>
</div>
<div style="float: right;width: 300px;height: 250">
<p>&nbsp;</p>
<p><strong>List Price: $149</strong><br />
<strong>Pre-Order Price: $99   <a href="https://www.ipexpert.com/Cisco/Trouble-Series-1" target="_blank"></a></strong><a href="https://www.ipexpert.com/Cisco/Trouble-Series-1" target="_blank"><br />
<img class="alignnone size-full wp-image-9205" src="http://blog.ipexpert.com/wp-content/uploads/2011/12/BN_button3.png" alt="" width="150" height="38" /></a></p>
<p>&nbsp;</p>
<p><span style="color: #993300"><strong>Questions? Contact a Training Advisor Today!</strong></span></p>
<p>Email: <a href="mailto:sales@ipexpert.com" target="_blank">sales@ipexpert.com</a><br />
Telephone: +1.810.326.1444<br />
Live Chat: <a href="http://www.ipexpert.com/chat" target="_blank">www.ipexpert.com/chat</a></p>
</div>
</div>
<div name="googleone_share_1" style="position:relative;z-index:5;float: right; margin-left: 10px;"><g:plusone size="medium" count="1" href="http://blog.ipexpert.com/2012/01/13/introducing-ipexperts-new-ipv4ipv6-multicast-operation-and-troubleshooting-guide/"></g:plusone></div><div style="text-align:left; margin: 0px 0px 0px 0px;" ><a href="http://blog.ipexpert.com/2012/01/13/introducing-ipexperts-new-ipv4ipv6-multicast-operation-and-troubleshooting-guide/?pfstyle=wp" style="text-decoration: none; outline: none; color: #990000;"><img class="printfriendly" src="http://cdn.printfriendly.com/pf-icon.gif" alt="Print Friendly"/><span style="font-size:14px; margin-left:3px; color: #990000;">Print Friendly</span></a></div>]]></content:encoded>
			<wfw:commentRss>http://blog.ipexpert.com/2012/01/13/introducing-ipexperts-new-ipv4ipv6-multicast-operation-and-troubleshooting-guide/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>

