Exchange the CEC enclosure Ethernet adapter

Before you begin

Icon for electrostatic discharge wrist strap Use approved ESD procedures to prevent damage.

Attention:

This procedure is not a stand-alone procedure. Customer disruption and damage to the hardware might occur when microcode and power boundaries are not in the proper conditions for this service action.
If a serviceable event FRU repair directed you to this procedure, the microcode and power boundaries are already set.
If a serviceable event FRU repair did not direct you to this procedure, see MAP1230 Replace a FRU without using a serviceable event.

Notes:

All the cables and FRUs to be removed must be uniquely identified so they can be reinstalled correctly.
If an installed earthquake resistance kit prevents you from accessing this FRU, refer to MAP1600.

Preparing the CEC enclosure to remove and replace the Ethernet adapter

About this task

Procedure

Use a replacement part with a valid DS8000® part number to ensure it has the proper firmware, VPD, and/or configuration to ensure it is compatible with the DS8000 service procedures. Attempting to use a generic server FRU might fail and require next level of support to recover.
All parts being removed must be marked or identified so they can be installed into their original locations.
Note: Failure to do this can extend the service duration and may require next level of support assistance.
The management console keyboard can be moved between the operating and stowed position as needed to allow service clearance above the CEC enclosure.
Use the front and rear blue identify LEDs to determine the CEC enclosure to be repaired. Both blue LEDs should be lit.
- CEC control panel blue identify LED as shown in Figure 1.
- CEC enclosure rear blue identify LED as shown in Figure 2.
Note: If both the front and rear CEC enclosure identify LEDs are not lit, use the location code listed in the serviceable event FRU list. See MAP1245 Finding FRUs by using location codes.

Figure 1. Control panel LEDs

Figure 2. CEC enclosure rear LEDs
Verify that the CEC enclosure is in the power-off state. See Figure 3
1. At the rear of the CEC enclosure, view all CEC enclosure power supply DC LEDs.
2. Are all DC (output) LEDs flashing?
  - Yes, continue with the next step.
  - No, do not continue with this FRU replacement. Go to MAP4841 CEC enclosure fails to power off during service processor repair (Models 961, 98x).
Figure 3. Location of the power supplies and LEDs (Models 981, 985, 986)
Use the flashing slot identify LED to confirm the location of the adapter to be replaced.
Attach the electrostatic discharge (ESD) wrist strap.
Attention:
- Attach an electrostatic discharge (ESD) wrist strap to an unpainted metal surface of your hardware to prevent the electrostatic discharge from damaging your hardware.
- When using an ESD wrist strap, follow all electrical safety procedures. An ESD wrist strap is used for static control. It does not increase or decrease your risk of receiving electric shock when using or working on electrical equipment.
- If you do not have an ESD wrist strap, just prior to removing the product from ESD packaging and installing or replacing hardware, touch an unpainted metal surface of the system for a minimum of 5 seconds.
Disconnect the power cords from the CEC with the DC (output) LEDs flashing. See Figure 4.
Notes:
- Ensure the power cords are correctly labeled.
- The power supply LEDs might continue to flash for up to 20 seconds while internal power is discharged.
- The power cord is fastened to the system using the hook-and-loop fastener . Unstrap the fastener to allow the enclosure to be placed in the service position.
Figure 4. Removing the power cords (Models 981, 985, 986)
Observe the CEC enclosure control panel green power button LED . See Figure 5.
- If it is off, go to the next step.
- If it is flashing, the CEC enclosure is still in the power-off state. DO NOT CONTINUE. Ensure that you have unplugged the power cables.
Figure 5. Control panel LEDs

Disconnect all remaining cables from the rear of the CEC enclosure. See Table 1 and Figure 6.

Table 1. CEC enclosure cable connections
Connection	Description
P1-T3 (HMC 1)	FSP Ethernet
P1-T4 (HMC 2)	FSP Ethernet
P1-C3-T1, P1-C3-T2	PCIe to I/O enclosures (if C3 present)
P1-C5-T1, P1-C5-T2	PCIe to I/O enclosures (if C5 present)
P1-C6-T1, P1-C6-T2	PCIe to I/O enclosures
P1-C7-T1, P1-C7-T2	PCIe to I/O enclosures
P1-C8-T1, P1-C8-T2	i2c to RPCs
P1-C10-T1, P1-C10-T2	LPAR Ethernet
P1-C10-T3, P1-C10-T4	Customer network (optional feature, if used)
P1-C11-T1, P1-C11-T2 P1-C11-T3, P1-C11-T4	Customer network (optional feature, if used)
P1-C12-T1, P1-C12-T2	RS485 to RPCs

If you are removing a 4-port Ethernet adapter and filler plugs are present in unused Ethernet ports, remove the filler plugs.

Figure 6. CEC enclosure location codes (rear view) (Models 981, 985, and 986)
Remove the front cover.
1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
2. Remove the two shipping screws (if present) that secure the system to the rack.
3. Pull the cover away from the system. The cover has an indentation where you can hold onto it more easily.
Figure 7. Removing the front cover
Place the CEC enclosure into the service position.
1. Remove the front screws (if present) that secure the enclosure to the rack.
  Figure 8. Removing the front screws
2. Release the side latches and pull the latches to slide out the enclosure assembly.
  Figure 9. Releasing the side latches
Remove the service access cover.
1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
2. Release the latch by pushing the release latch in the direction shown.
3. Slide the cover off the system unit. When the front of the service access cover has cleared the upper frame ledge, lift the cover up and off the system unit.
  Attention: For proper cooling and airflow, replace the cover before turning on the system.
Figure 10. Removing the service access cover
Attach the electrostatic discharge (ESD) wrist strap. Your system has an ESD pin on the backplane as shown in Figure 11. Attach the ESD wrist strap to the ESD pin.
Attention:
- Attach an electrostatic discharge (ESD) wrist strap to an unpainted metal surface of your hardware to prevent the electrostatic discharge from damaging your hardware.
- When using an ESD wrist strap, follow all electrical safety procedures. An ESD wrist strap is used for static control. It does not increase or decrease your risk of receiving electric shock when using or working on electrical equipment.
- If you do not have an ESD wrist strap, just prior to removing the product from ESD packaging and installing or replacing hardware, touch an unpainted metal surface of the system for a minimum of 5 seconds.
Figure 11. Location of the ESD pin

Removing the CEC enclosure Ethernet adapter

About this task

To remove the CEC enclosure Ethernet adapter, complete the following steps:

Procedure

Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
To set the adapter latch at the target slot into the open position, rotate the latch on the rear of the system, in the direction shown in Figure 12.
Carefully grasp the adapter by its top edge or tailstock, and remove the adapter from the slot, as shown in Figure 12.
Attention: A pin on the tailstock of the adapter resembles a removable screw. Do not remove this pin. It is required for correct alignment and seating.

Figure 12. Removing a PCIe adapter from a rack-mounted system

Replacing the CEC enclosure Ethernet adapter

About this task

To replace the CEC enclosure Ethernet adapter, complete the following steps:

Procedure

Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
If necessary, remove the adapter from the antistatic package.
Attention: Avoid touching the components and gold connectors on the adapter.
Place the adapter, component-side up, on a flat, antistatic surface.
Attention: A pin on the tailstock of the adapter resembles a removable screw. Do not remove this pin. It is required for correct alignment and seating.
If you are replacing a 10 Gb Ethernet adapter, remove the PCI adapter divider at the right side of the PCIe slot.

Note: Removing the PCI adapter divider makes it easier to install the adapter.
1. Hold the top edge of the PCI adapter divider and flex the divider out of the bracket and toward the rest of the divider. See Figure 13.
2. Press down on the retaining latch at the back edge of the divider . Pull the divider away from the system chassis, then lift out to remove it from the system.
Figure 13. Removing the PCI adapter dividers
If the adapter latch at the target slot is not already in the open position, pull the latch into the open position by rotating the latch outwards from its clip on the back of the system, as shown in Figure 14.

Note: If filler plugs are present in the new Ethernet adapter, you might need to remove the filler plugs to install the adapter.
Carefully grasp the adapter by its top edge or tailstock, and align the adapter with the slot and its connector on the system backplane, as shown in Figure 14.
On the system, press the adapter firmly into its connector.
To lock the adapter in its slot, rotate the adapter latch in the direction that is shown in Figure 14.
Figure 14. Installing or replacing a PCIe adapter in a rack-mounted system
If you are replacing a 10 Gb Ethernet adapter, replace the PCI adapter divider at the right side of the PCIe slot.
1. Holding the top edge of the PCI adapter divider , align the divider with its slot in the system.
2. Slide the divider toward the retention notches as shown in Figure 15.
3. Ensure that the tabs on the divider align with the notches on the system chassis.
  
  Note: The light pipes below the light-pipe plate must fit through the holes in the plate.
4. Press on the divider until the lower edge guide pin slides into the slot to secure the divider.
Figure 15. Installing the PCI adapter dividers

Preparing the CEC enclosure for operation after removing and replacing the Ethernet adapter

About this task

To prepare the system for operation, complete the following steps:

Procedure

Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
Replace the service access cover.
1. Slide the cover on to the system unit.
2. Close the latch release by pushing it in the direction shown.
Figure 16. Installing the service access cover
Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
Place the CEC enclosure into the operating position.
1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
2. Unlock the blue rail safety latches by lifting them upward.
3. Push the system unit back into the rack until both system unit release latches lock into position.
4. Secure the enclosure to the rack with screws, if screws were removed when preparing the enclosure for service.
Figure 17. Placing the CEC enclosure into the operating position
Replace the front cover.
1. Push the cover onto the system.
2. Gently push the cover in until the cover clips are seated in their respective mounting posts as shown in Figure 73. The cover snaps into place and has an indentation where you can hold onto it more easily.
3. Replace the shipping screws .
Figure 18. Installing the front cover
Attach the electrostatic discharge (ESD) wrist strap.

Reconnect all cables, except for power cords. See Table 2 and Figure 19.

If optical Ethernet connections are used, use proper cleaning procedures.

Important: The optical cable plugs (LC connectors) and ports (SFPs) must be cleaned before connecting them. Use cleaning tool 54Y4392 or IBM-approved alternative. After cleaning SFPs with the tool, use air bulb 45D2645 or IBM-approved alternative. For detailed procedures, refer to current DS8000 Info Alerts or contact your next level of support.

Table 2. CEC enclosure cable connections
Connection	Description
P1-T3 (HMC 1)	FSP Ethernet
P1-T4 (HMC 2)	FSP Ethernet
P1-C3-T1, P1-C3-T2	PCIe to I/O enclosures (if C3 present)
P1-C5-T1, P1-C5-T2	PCIe to I/O enclosures (if C5 present)
P1-C6-T1, P1-C6-T2	PCIe to I/O enclosures
P1-C7-T1, P1-C7-T2	PCIe to I/O enclosures
P1-C8-T1, P1-C8-T2	i2c to RPCs
P1-C10-T1, P1-C10-T2	LPAR Ethernet
P1-C10-T3, P1-C10-T4	Customer network (optional feature, if used)
P1-C11-T1, P1-C11-T2 P1-C11-T3, P1-C11-T4	Customer network (optional feature, if used)
P1-C12-T1, P1-C12-T2	RS485 to RPCs

If you are replacing a 4-port Ethernet adapter and filler plugs were removed from unused Ethernet ports, replace the filler plugs.

Figure 19. CEC enclosure location codes (rear view) (Models 981, 985, and 986)
Reconnect the power cords to the CEC enclosure. See Figure 20.
Fasten the power cords to the enclosure using the hook-and-loop fasteners .
Figure 20. Connecting the power cords
Verify that the CEC enclosure has power available. See Figure 77.
1. At the rear of the CEC enclosure, view the CEC enclosure power supply DC LEDs.
2. Are all DC (output) LEDs flashing?
  - Yes, continue with the next step.
  - No, ensure the power cords are properly connected. If no connection problem is found, contact your next level of support.
Figure 21. Location of the power supplies and LEDs (Models 981, 985, 986)
Wait up to 5 minutes for the CEC enclosure control panel power button LED to flash. See Figure 78.
Note: This ensures the CEC enclosure is in the power-off state.

Is the power button LED flashing?
- Yes, go to the next step.
- No, ensure the CEC enclosure power supplies are fully seated. The possible failing FRUs are the CEC enclosure system backplane, I2C interface card and cables, and control panel. You can also call the next level of support.
Figure 22. Control panel LEDs
Close the rear door of the rack.
Exit this service information center parts exchange procedure and return to the procedure that sent you here.