MAP7032 Private network isolation procedure 32

The Network Topology tool has been used to determine that one or both management consoles have lost connectivity to the service processor on a single CEC enclosure (one of the two processor complexes in a storage facility) through the Black network (eth0).

MAP7032 Section-1

Before you begin

In MAP7000 Entry point For storage facility private network problems, you verified that power was available to the CEC enclosure and that service processor was IML'd.

Procedure

  1. For rack model 983 only. At the front of the rack, slide the management enclosure out to the service position and remove the top cover. See Figure 1.
    Note: The management enclosure is below the two CEC enclosures.
    1. Fully loosen the left and right captive thumb screws.
    2. Slide the management out fully so the sliding rails lock into place.
    3. At the rear of the top cover, fully loosen the left and right captive thumb screws.
    4. Slide the cover back until it lifts off.
    5. When the service action is complete, reverse these steps.
    Figure 1. Management enclosure (front)
    Front of Management enclosure (Model 983)
  2. Locate Ethernet switch SW1 (Figure 2, Figure 3, or Figure 4) in the storage facility that contains the affected service processor. Use the tables to determine the locations of the switch port, CEC port, and Ethernet cable that correspond to the failing service processor.
    Table 1. Port locations (Model 941 and 951)
    Service processor port location SW1 port location SW2 port location
    U789D.001.nnnnnnn-P1-C11-T3 (Upper CEC enclosure) T3
    U789D.001.nnnnnnn-P1-C11-T3 (Lower CEC enclosure) T4
    U789D.001.nnnnnnn-P1-C11-T4 (Upper CEC enclosure) T3
    U789D.001.nnnnnnn-P1-C11-T4 (Lower CEC enclosure) T4
    Table 2. Port locations (Model 961)
    Service processor port location SW1 port location SW2 port location
    U78AA.001.nnnnnnn-P1-T5 (Upper CEC enclosure) T3
    U78AA.001.nnnnnnn-P1-T5 (Lower CEC enclosure) T4
    U78AA.001.nnnnnnn-P1-T6 (Upper CEC enclosure) T3
    U78AA.001.nnnnnnn-P1-T6 (Lower CEC enclosure) T4
    Table 3. Port locations (Models 980, 983, and 984)
    Service processor port location SW1 port location SW2 port location
    U78CB.001.nnnnnnn-P1-T1 (Upper CEC enclosure) T3  
    U78CB.001.nnnnnnn-P1-T1 (Lower CEC enclosure) T4  
    U78CB.001.nnnnnnn-P1-T2 (Upper CEC enclosure)   T3
    U78CB.001.nnnnnnn-P1-T2 (Lower CEC enclosure)   T4
    Table 4. Port locations (Models 981, 985, and 986)
    Service processor port location SW1 port location SW2 port location
    U78C9.001.nnnnnnn-P1-T3 (Upper CEC enclosure) T3  
    U78C9.001.nnnnnnn-P1-T3 (Lower CEC enclosure) T4  
    U78C9.001.nnnnnnn-P1-T4 (Upper CEC enclosure)   T3
    U78C9.001.nnnnnnn-P1-T4 (Lower CEC enclosure)   T4
    Table 5. Port locations (Models 982 and 988)
    Service processor port location SW1 port location SW2 port location
    U78C7.001.nnnnnnn-P1-C5-T4 (Upper CEC enclosure) T3  
    U78C7.001.nnnnnnn-P1-C5-T4 (Lower CEC enclosure) T4  
    U78C7.001.nnnnnnn-P1-C5-T5 (Upper CEC enclosure)   T3
    U78C7.001.nnnnnnn-P1-C5-T5 (Lower CEC enclosure)   T4
    Figure 2. 8-port Ethernet switch port designations (SW1, SW2-Tx) Model 941, Model 951, and Model 961
    8-port Ethernet switch port designations (SW1, SW2-Tx)
    Figure 3. Located on the rear, righthand side of Rack-1, the 8-port Ethernet switch port designations (Models 98x, not 983)
    8-port Ethernet switch port locations, Model 98x
    Figure 4. Located inside the management enclosure, the 8-port Ethernet switch port designations (Model 983)
    Ethernet cables (Models 983)
  3. Check the Ethernet port "link" LED on the switch and CEC Ethernet ports identified in step 2.

    Is the link LED on solid?

    • Yes, go to step 5.
    • No, confirm that the Ethernet plugs are firmly seated at each end. Attempt to reset the link by unplugging and reseating the Ethernet plugs at both ends. If the "link" LED comes on, continue with the next step. If the "link" LED stays out, make a note of this, and go to step 5.
  4. Use the Network topology tool as described in MAP7001 Using the network topology tool to check whether the problem is resolved.

    Is the network problem resolved?

    • Yes, go to MAP1500 Ending a service action to close the serviceable event, save the network topology, and ensure that good subsystem status.
    • No, continue with the next step.
  5. Is there an unused port on the same switch?
    • Yes, go to the next step.
    • No, this can occur only on an 8-port switch. Temporarily unplug the cable from port T8 (T1 for model 98x), and then continue to the next step.
      Note: For models 9A2 and 9B2, this might cause a new serviceable event to be opened for Ethernet communications from the second LPAR on this CEC enclosure. After this cable is reconnected in the following step, you can close that serviceable event.
  6. Move the cable plugged into the port located in step 2 to an unused port on the Ethernet switch.
  7. Use the Network topology tool as described in MAP7001 Using the network topology tool to check whether the problem is resolved.
    Is the network problem resolved?
    • Yes, this indicates a faulty port on the Ethernet switch. Go to MAP7032 Section-2.
    • No, continue with the next step.
  8. Move the cables that were swapped in the prior steps back to their original positions.
  9. Temporarily install a new Ethernet cable in place of the existing cable between the faulty service processor Ethernet port and the Ethernet switch port that was determined earlier.
  10. Use the Network topology tool as described in MAP7001 Using the network topology tool to check whether the problem is resolved.
    Is the network problem resolved?

MAP7032 Section-2

About this task

In this section, the SW1 Ethernet switch will be replaced.

Procedure

  1. Go to Exchanging parts to replace the SW1 Ethernet switch.
  2. Return here after you have replaced the Ethernet switch.

MAP7032 Section-3

About this task

In this section, the faulty Ethernet cable will be replaced.

Procedure

  1. Replace the faulty Ethernet cable between the Ethernet switch and the service processor.
  2. Verify the fix using the Network topology tool as described in MAP7001 Using the network topology tool.
    Is the network problem resolved?
    • Yes, go to MAP1500 Ending a service action to close the serviceable event, save the network topology, and ensure good subsystem status.
    • No, reseat the cable again and repeat this step. If the problem persists, it appears that you installed a faulty Ethernet cable or you have a problem with the service processor. Replace the cable again. If replacing the cable again does not resolve the problem, go to MAP7032 Section-4 to reset or replace the service processor.

MAP7032 Section-4

About this task

In this section, the service processor will be reset, and the link will be re-tested. If the service processor reset does not resolve the problem, the service processor will be replaced.

Procedure

  1. Go to MAP4810 Resetting the service processor (FSP). Return here after you have completed the action.
  2. Use the Network topology tool as described in MAP7001 Using the network topology tool to check whether communication with the service processor is now working.
    Is communication with the service processor now working?
    • Yes, go to step 6.
    • No, go to step 3.
  3. Is the affected CEC enclosure in a model 961 (8205-E6C or 8205-E6D) or Model 98x?
    • Yes, go to step 4.
    • No, go to step 5.
  4. Use Storage Facility Management > storage facility > Exchange Parts to replace the CEC enclosure system backplane.
    When you have replaced the CEC enclosure system backplane, verify the fix using the network topology tool as described in MAP7001 Using the network topology tool.
    Note: For Model 961 and Model 98x, the service processor function is contained within the CEC enclosure system backplane.
  5. Use Storage Facility Management > storage facility > Exchange Parts to replace the service processor. When you have replaced the service processor, verify the fix using the Network topology tool as described in MAP7001 Using the network topology tool.
  6. Power on the storage facility system.
    1. Use Storage Facility Management > storage facility > Service Utilities > Storage Facility Power Control.
    2. Select Power ON Storage Facility.
  7. Use the Network topology tool as described in MAP7001 Using the network topology tool to check that all communication is now working.
    Is the network problem resolved?