EuroBank's Network Environment
Across all its subsidiaries, EuroBank has more than 1100 branches across Europe (which we call branches). In addition, EuroBank runs more than 40 large office sites (which we call offices) across the UK, Spain, and Germany. Each office has tens to hundreds of employees working in different departments (front and back office).EuroBank built a private core network composed of nine points of presence (POPs): five in the UK (including three in London), two in Germany (Berlin and Frankfurt), and two in Spain (Barcelona and Madrid).All branches and offices are connected to the EuroBank core network. For the branches, this connection is provided in the UK and Germany by means of a managed Layer 3 MPLS VPN service provided by local service providers in these countries. In Spain this connection is achieved through a managed Frame Relay network provided by a local service provider. In all countries, offices are directly connected to the core network via one of the nine POPs using private leased lines (34 Mbps or 155 Mbps), ATM PVCs, Metro Ethernet connections, or, when co-located within the POP, using local Fast Ethernet or Gigabit Ethernet connections.EuroBank core POPs are also attached to the Layer 3 MPLS VPN service and to the managed Frame Relay-based service of their local service providers in their respective country.Each office usually is composed of server farms hosting various applications accessed by branch locations. As already pointed out, each branch also accesses applications hosted in the various data centers in Europe.EuroBank has four data centerstwo in London, one in Frankfurt, and one in Madrid. These are interconnected to the local POP(s) by means of redundant high-speed links, Fast Ethernet or Gigabit Ethernet (wherever such metro services are available in that particular city), or 155-Mbps leased lines otherwise. Data centers are usually close to the core network POPs but are never co-located for availability reasons (thus keeping a power supply failure, for instance, from affecting both the POP and the data center). Such data centers host many applications on UNIX servers and mainframes that are accessed by the various branches and offices in the EuroBank group. In other words, although the branches usually connect to remote applications hosted in an office of their subsidiary, they also access applications hosted in the various data centers. Likewise, offices access applications hosted on servers located in other offices or within the data centers.In the past, EuroBank operated nine data centers, but it reduced that number to four over the last two years to meet its cost-reduction objectives. This was made possible because the company's high-speed MPLS infrastructure offers the necessary performance levels, allowing transparent access to a remotely located data center and because of the Layer 3 MPLS VPN technology, which allows strict control of access to different resources in the same location.
Description of the Branch Office
Branch offices are small-to-medium locations with regular front-office banking services. They do not require the support of multiple VPNs. They are located in various towns and cities across the UK, Germany, and Spain.[MLPPP]) to provide an equivalent bandwidth until the service is restored and the traffic is switched back to the local access link. Note that such backup technology is deployed both in the case of access to a Layer 3 MPLS VPN service provider core and in the case of the Frame Relay managed service used in Spain.[L2VPN]. If you want to know more about this resource, look up the code in the "References" appendix to find out specific information about the resource.Figure 6-1 shows the structure of a branch, as well as its connectivity to the EuroBank core network.
Figure 6-1. Branch Location and Interconnection to the EuroBank Core
[View full size image]

Description of an Office Location
As discussed, EuroBank offices potentially host hundreds of employees from different subsidiaries. They include all back-office processing in addition to the front-end applications. Outside the UK, the offices in Spain, Germany, and New York each support staff from a single subsidiary.From a networking infrastructure perspective, the only difference between the UK offices and the offices outside the UK is how the CE routers are connected and how many VPNs each CE router needs to support. In the Spanish and German offices, two CE routers are connected to the EuroBank core network by means of leased lines or metro connections. This is also true for smaller office locations in the UK.The office locations in the UK, an example of which is shown in UK Office Location Layer 3 MPLS VPN Design.") These CE routers attach to PE routers in the local POP via leased lines or metro connections. Hosts and servers are attached to the office network via Gigabit Ethernet switches dual-attached to the multi-VRF CE routers.
Figure 6-2. Office Locations in the UK and Interconnection to the EuroBank Network Core
[View full size image]

Description of a Core Network POP
The core network is composed of nine POPS: five in the UK (three in London, one in Manchester, and another in Newcastle), two in Germany (Berlin and Frankfurt), and two in Spain (Barcelona and Madrid).The POP structure is shown in Figure 6-3. Each POP has two P routers connected to two PE routers via two Gigabit Ethernet switches. To ensure full redundancy, each P router and PE router is attached to the two switches.
Figure 6-3. EuroBank POP Infrastructure
Inter-AS Back-to-Back VRFs (Option A)" section in Chapter 1, "Technology Primer: Layer 3 VPN, Multicast VPNs, IPv6, and Pseudowire." The EuroBank PE routers are also connected to the offices by means of metro connections, leased lines, and ATM PVCs.In Germany, the Frankfurt POP structure is identical to that of the UK, except that the PE routers support only a single VPN. In the case of the POP in Berlin, the POP structure is slightly simpler because only two PE routers also act as P routers. This is justified by the fact that the POP in Berlin is not connected to any data center. Having two sets of PE routers and P routers is not justified.In Spain, the PE routers are connected via a point-to-point Gigabit Ethernet link to each of the two central CE routers that are managed by the local service provider and that aggregate the traffic coming from the branches. Also, as in the case of the POPs in Germany, the EuroBank PE routers handle only a single VPN. Note that for similar reasons as in the case of Germany, EuroBank decided to have two PE routers (also acting as P routers) for its POP in Barcelona. The company has two P routers and two PE routers in its POP in Madrid (connected to its data center in Spain), as shown in Figure 6-3.
EuroBank decided to locate each of the nine POPs in the same premises as a large office. Therefore, the location infrastructure shown in Figure 6-3 actually covers both the POP and the co-located office. The PE routers in this case are used to attach the remote CE routers of other office locations as well as to support the VPN(s) for this location.Just as in the other regular office locations, VLANs over the Gigabit Ethernet switches are used to propagate the VPN connectivity to the hosts in the co-located office.The long-distance links interconnecting the POP locations are a mix of E3 (34-Mbps) links and ATM PVCs provided by international service providers (see Figure 6-4). The only exception is the case of the UK, where the three long-distance inter-POP links are Fast Ethernet. The three POPs of London are interconnected by Gigabit Ethernet (full rate). You'll read more about the metro connections in the section "Description of the Metro Connections in the UK."
Figure 6-4. EuroBank Core Network Topology
[View full size image]

Description of the Data Centers
A data center has two PE routers connected to two different POP locations wherever possible or otherwise to two different routers of the closest POP. A data center location is shown in Figure 6-5.
Figure 6-5. DataCenter Infrastructure

Description of the Metro Connections in the UK
In the UK, metro connections are used to interconnect large offices to a POP, to interconnect data centers to POPs, and for POP to POP connections. EuroBank elected to use two different metro services for such interconnections:Quality of Service Design" section.
Figure 6-6. Subrate Fast Ethernet Connection Between the POPs of Manchester and Newcastle

Figure 6-7. Gigabit Ethernet Metro Connection

EuroBank decided to buy metro Gigabit Ethernet connections with rates ranging from 300 Mbps to 600 Mbps based on its traffic estimates, which are reevaluated each month based on the traffic statistics provided by the service provider. Note that input traffic shaping is configured on the service provider's ingress Ethernet switch. High network availability is achieved by means of complete redundancy. Two Ethernet switches are installed in EuroBank locations and are connected to the metro service provider core network via fully diverse fiber paths.The metro service provider provides statistics related to port usage via a web interface (daily, weekly, and monthly usage).