SRT1500RMXLI-NC: In bypass in response to an internal hardware fault.

[Brumm]

We installed a SRT1500RMXLI-NC just yesterday and I observed a couple of these messages in the logs:

05/12/2022	09:11:14	Device	UPS: RFC1628 MIB alarm entry removed.	0x3605
05/12/2022	09:11:14	Device	UPS: Return from bypass, internal hardware fault no longer present.	0x01B2
05/12/2022	09:11:14	Device	UPS: RFC1628 MIB alarm entry added.	0x3604
05/12/2022	09:11:14	Device	UPS: In bypass in response to an internal hardware fault.	0x011B
05/12/2022	03:35:38	Device	UPS: RFC1628 MIB alarm entry removed.	0x3605
05/12/2022	03:35:38	Device	UPS: Return from bypass, internal hardware fault no longer present.	0x01B2
05/12/2022	03:35:38	Device	UPS: RFC1628 MIB alarm entry added.	0x3604
05/12/2022	03:35:38	Device	UPS: In bypass in response to an internal hardware fault.	0x011B
05/12/2022	01:43:19	Device	UPS: RFC1628 MIB alarm entry removed.	0x3605
05/12/2022	01:43:19	Device	UPS: Return from bypass, internal hardware fault no longer present.	0x01B2
05/12/2022	01:43:18	Device	UPS: RFC1628 MIB alarm entry added.	0x3604
05/12/2022	01:43:18	Device	UPS: In bypass in response to an internal hardware fault.	0x011B
05/12/2022	00:07:42	Device	UPS: RFC1628 MIB alarm entry removed.	0x3605
05/12/2022	00:07:42	Device	UPS: Return from bypass, internal hardware fault no longer present.	0x01B2
05/12/2022	00:07:41	Device	UPS: RFC1628 MIB alarm entry added.	0x3604
05/12/2022	00:07:41	Device	UPS: In bypass in response to an internal hardware fault.	0x011B

These are the most recent entries in the logs. There were two more occurences of this yesterday afternoon. It seems that this internal hardware fault is only occuring for a very short period. What should I do? Is that something to worry about?

[exHPguy]

I have a couple of SRT 3000s that just started with that error also

Critical - UPS: In bypass in response to an internal hardware fault.

then one second later

Informational - UPS: Return from bypass, internal hardware fault no longer present.

[Brumm]

A small update: I observed the logs of the last days. And these error messages keep appearing every couple of hours (so 5 -10 per day). This is really annoying as it clutters the event log. Is there anything to do about it?

[exHPguy · Accepted solution]

On my issue, I downgraded the network cards firmware and the problem went away

[jfrancis]

Interesting...

This error started after I upgraded the firmware on my PowerChute Network Management Card 3. 

[exHPguy · Accepted solution]

Same with me

Downgrading the AP9640 network card from 2.2.0.1  to 2.0.0.5 fixed the issue.

[jfrancis]

@exHPguy Thanks, as per your experience, I downgraded as well to resolve the problem.

[mkuhn22]

To add to this I can also confirm that after updating ~10 AP9640s to the 2.2.0.1 firmware and within 24 hours every one of them started throwing "In bypass in response to an internal hardware error.", with a return to normal state within the same second.  As mentioned in thread downgrading back to the 2.0.0.5 firmware has resolved the issue on all 10 devices.

Thanks, @exHPguy 

[Brumm]

Thanks, for all the replies. I was hoping to solve my issue, but where do I get the old version of the Firmware? I only seem to find v2.2.0.1 on https://www.apc.com/us/en/download/document/APC_NMC3_SU_2201_EN/ and that's what I have already.

[mkuhn22]

You may be able to reach out to support for it directly.  I know when I had to bring an old Struxureware install to current they provided me with direct links to some of the step upgrades I'd need that aren't available on the site via links any longer.  In this case I happened to still have my 2.0.0.5 download handy which is how I stepped back.  It'd be nice if they didn't remove previous versions once they mark them "obsolete".  Right here's a pretty clear example of a reason to keep at least one additional version available to download.

[JonPro]

Hi @Brumm,

Please share your email address via DM and I will send you the file.

[Brumm]

As others mentioned already, this solved the problem for me.

[BillP]

We have release firmware 2.2.1.1 to correct this issue. 

The firmware can be downloaded at

https://www.apc.com/us/en/product/SFNMC3SU221/ups-network-management-card-3-firmware-v2-2-1-for-smar...

https://www.se.com/us/en/product/SFNMC3SU221/ups-network-management-card-3-firmware-v2-2-1-for-smart...

The release not are at

Network Management Card 3 Firmware v2.2.1.1 Release Notes (schneider-electric.com)