Upgrading firmware on AP8981 (Switched Rack PDU)

[skendric]

BRIEF

I am upgrading APC AP8981 from AOS/RPDU2G 6.8.x and 6.9.x to 7.0.4.  Generally, works fine ... but for (2) units, they revert to the previous firmware version, after the process completes.  Tips on trouble-shooting?

The NMC Firmware Update Utility claims that the process has completed successfully.  And for most units, it has.  But for a couple of units, while the NMC Utility claims success:

[06/24/2022 09:25:52] NMC Firmware Update Utility v1.0.3 initialized.
[06/24/2022 09:26:06] Downloading and verifying configuration file from dc-705-pdu, please wait...
[06/24/2022 09:26:27] Uploading firmware file 1 of 3: Boot Monitor to dc-705-pdu, please wait...
[06/24/2022 09:26:39] Waiting for the network interface on dc-705-pdu to restart, please wait...
[06/24/2022 09:27:05] Uploading firmware file 2 of 3: APC Operating System to dc-705-pdu, please wait...
[06/24/2022 09:28:38] Waiting for the network interface on dc-705-pdu to restart, please wait...
[06/24/2022 09:29:59] Uploading firmware file 3 of 3: Application to dc-705-pdu, please wait...
[06/24/2022 09:31:22] Waiting for the network interface on dc-705-pdu to restart, please wait...
[06/24/2022 09:31:54] Entire update process has been completed.

Nevertheless, when I log back in, I see that while bootmon has been upgraded, that AOS and RPU2G remain back on the previous 6.8.2/6.8.0 versions

I have tried performing the process manually, i.e.

linux>:$ ftp dc-705-pdu

Connected to dc-705-pdu.
220 AP8981 Network Management Card AOS v6.8.2 FTP server ready.
Name (dc-705-pdu:tech): apc
331 User name okay, need password.
Password:
230 User logged in, proceed.
ftp> bin
200 TYPE Command okay.
ftp> hash
Hash mark printing on (1024 bytes/hash mark).
ftp> put apc_hw05_aos_704.bin
local: apc_hw05_aos_704.bin remote: apc_hw05_aos_704.bin
200 PORT Command okay.
150 File status okay; about to open data connection.
################################################################################

[...]

##########
226 Closing data connection.
3123200 bytes sent in 51.32 secs (59.4326 kB/s)
ftp>

Wait for the NMC to reboot, then ftp back in ... notice how the AOS upgrade has been successful (v7.0.4)

stuartk@indra:/tftpboot/APC$ ftp dc-701-pdu
Connected to dc-701-pdu.
220 AP8981 Network Management Card AOS v7.0.4 FTP server ready.
Name (dc-701-pdu:stuartk): apc
331 User name okay, need password.
Password:
230 User logged in, proceed.
ftp> bin
200 TYPE Command okay.
ftp> hash
Hash mark printing on (1024 bytes/hash mark).
ftp> put apc_hw05_rpdu2g_706.bin
local: apc_hw05_rpdu2g_706.bin remote: apc_hw05_rpdu2g_706.bin
200 PORT Command okay.
150 File status okay; about to open data connection.
################################################################################

[...]

########
226 Closing data connection.
2712100 bytes sent in 45.63 secs (58.0456 kB/s)
ftp>

But ... when log back in ... the device has reverted to the previous firmware

linux> ssh dc-705-pdu -l apc
apc@dc-705-pdu's password:

Schneider Electric Network Management Card AOS v6.9.6
(c) Copyright 2020 All Rights Reserved RPDU 2g APP v6.9.6

[...]

TROUBLE-SHOOTING

- I have tried resetting the configuration (except for TCIP/IP settings), same behavior

- The Event Log contains no suggestion of problems (records the file transfers but no discussion of an upgrade attempt)

NEXT STEPS

- Suggestions on how I might trouble-shoot this further?

--sk

Stuart Kendrick

[BrandonD]

Were you able to solve this issue?

[skendric]

No

Actually, the 2nd PDU now claims to be running AOS 1.5.1.1 and rPDU 1.2.0.2 (and BootMon 1.3.6.1) ... which is even more surprising than the previous behavior

I haven't figured out a different angle to take on this -- if you have suggestions, do let me know

--sk