Help
  • Get started
  • Ask the Community
  • How-To & Best Practices
  • Contact Support
Login / Register
Brand Logo
Help
  • Get started
  • Ask the Community
  • How-To & Best Practices
  • Contact Support
close
  • Community Home
  • Forums
    • By Topic
    • By Topic
      EcoStruxure Building
      • Field Devices Forum
      • SmartConnector Forum
      EcoStruxure Power & Grid
      • Gateways and Energy Servers
      • Metering & Power Quality
      APC UPS, Critical Power, Cooling and Racks
      • APC UPS Data Center & Enterprise Solutions Forum
      • APC UPS for Home and Office Forum
      EcoStruxure IT
      • EcoStruxure IT forum
      • EcoStruxure IT™ Advisor CFD
      Remote Operations
      • EcoStruxure Geo SCADA Expert Forum
      • Remote Operations Forum
      Industrial Automation
      • Alliance System Integrators Forum
      • AVEVA Plant SCADA Forum
      • CPG Expert Forum DACH
      • EcoStruxure Automation Expert / IEC 61499 Forum
      • Fabrika ve Makina Otomasyonu Çözümleri
      • Harmony Control Customization Forum
      • Industrial Edge Computing Forum
      • Industry Automation and Control Forum
      • Korea Industrial Automation Forum
      • Machine Automation Forum
      • Modicon PAC Forum
      • PLC Club Indonesia
      Schneider Electric Wiser
      • Schneider Electric Wiser Forum
      Power Distribution IEC
      • Eldistribution & Fastighetsautomation
      • Elektrik Tasarım Dağıtım ve Uygulama Çözümleri
      • Paneelbouw & Energie Distributie
      • Power Distribution and Digital
      • Solutions for Motor Management
      • Specifiers Club ZA Forum
      • Електропроектанти България
      Power Distribution NEMA
      • Power Monitoring and Energy Automation NAM
      Power Distribution Software
      • EcoStruxure Power Design Forum
      • LayoutFAST User Group Forum
      Energy & Sustainability Services
      • Green Building Scoring and Certification Forum
      Light and Room Control
      • SpaceLogic C-Bus Forum
      Solutions for your Business
      • Solutions for your Business Forum
      Support
      • Ask the Community
  • Knowledge Center
    • Building Automation Knowledge Base
    • Remote Operations Devices Knowledge Base
    • Geo SCADA Knowledge Base
    • Industrial Automation How-to videos
    • Digital E-books
    • Success Stories Corner
  • Events & Webinars
    • All Events
    • Innovation Talks
    • Innovation Summit
    • Let's Exchange Series
    • Partner Success
    • Process Automation Talks
    • Technology Partners
  • Ideas
    • EcoStruxure Building
      • EcoStruxure Building Advisor Ideas
      Remote Operations
      • EcoStruxure Geo SCADA Expert Ideas
      • Remote Operations Devices Ideas
      Industrial Automation
      • Modicon Ideas & new features
  • Blogs
    • By Topic
    • By Topic
      EcoStruxure Power & Grid
      • Backstage Access Resources
      EcoStruxure IT
      • EcoStruxure IT™ Advisor CFD
      Remote Operations
      • Remote Operations Blog
      Industrial Automation
      • Industrie du Futur France
      • Industry 4.0 Blog
      Power Distribution NEMA
      • NEMA Power Foundations Blog
      Energy & Sustainability Services
      • Active Energy Management Blog
      Light and Room Control
      • KNX Blog
      Knowledge Center
      • Digital E-books
      • Geo SCADA Knowledge Base
      • Industrial Automation How-to videos
      • Remote Operations Devices Knowledge Base
      • Success Stories Corner
  • companyImpact

All management cards stopped responding

APC UPS Data Center & Enterprise Solutions Forum

Schneider Electric support forum for our Data Center and Business Power UPS, UPS Accessories, Software, Services, and associated commercial products designed to share knowledge, installation, and configuration.

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Home
  • Communities
  • APC UPS, Critical Power, Cooling and Racks
  • APC UPS Data Center & Enterprise Solutions Forum
  • All management cards stopped responding
Options
  • Subscribe to RSS Feed
  • Mark Topic as New
  • Mark Topic as Read
  • Float this Topic for Current User
  • Bookmark
  • Subscribe
  • Mute
  • Printer Friendly Page
Invite a Co-worker
Send a co-worker an invite to the Exchange portal.Just enter their email address and we?ll connect them to register. After joining, they will belong to the same company.
You have entered an invalid email address. Please re-enter the email address.
This co-worker has already been invited to the Exchange portal. Please invite another co-worker.
Please enter email address
Send Invite Cancel
Invitation Sent
Your invitation was sent.Thanks for sharing Exchange with your co-worker.
Send New Invite Close
Top Experts
User Count
BillP
Administrator BillP Administrator
5026
voidstar_apc
Janeway voidstar_apc
195
Erasmus_apc
Sisko Erasmus_apc
111
TheNotoriousKMP_apc
Sisko TheNotoriousKMP_apc
108
View All

Invite a Colleague

Found this content useful? Share it with a Colleague!

Invite a Colleague Invite
Solved Go to Solution
Back to APC UPS Data Center & Enterprise Solutions Forum
Solved
jmiller31_apc
Crewman jmiller31_apc
Crewman

Posted: ‎2021-07-01 02:13 AM

0 Likes
4
362
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Posted: ‎2021-07-01 02:13 AM

All management cards stopped responding

This was originally posted on APC forums on 3/7/2013


The strangest thing just happened to me, I have 4 NMC 2's on two different models of UPS's. These cards have all been up and running without a problem for the last 10 months or so. We monitor them via an SNMP app, all at once all 4 dropped off the network. They continued to respond to pings but SNMP, telnet and HTTP all failed to access them. Initially I assumed a network problem but they are on at least two different switches, after eliminating all possible network issues I hit the reset button on one of the NMC's. After booting it started responding normally, the logs show no event at the time it stopped responding. I then did the same on the other 3 cards and everything is back to normal.

Anyone have any ideas on why 4 independent cards would all apparently lock up simultaneously like that?

Thanks,

John

Labels
  • Labels:
  • UPS Management Devices & PowerChute Software
Reply
  • All forum topics
  • Previous Topic
  • Next Topic

Accepted Solutions
jmiller31_apc
Crewman jmiller31_apc
Crewman

Posted: ‎2021-07-01 02:14 AM

0 Likes
0
361
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Posted: ‎2021-07-01 02:14 AM

This was originally posted on APC forums on 3/8/2013


Yeah I thought about the watchdog timer too but the cards didn't restart and as you pointed out the time before I rebooted them was far greater than the 9.5 minutes. Also we have two different monitoring systems, one does SNMP polls every 5 minutes so in theory if there was a delay there the timer could in theory expire but the other system does a ping every minute so that would stop the timer from expiring. 3 of the cards are on AOS 5.1.7 and 1 is on 5.1.6. The IPv6 is an interesting thought, if it reoccurs I might turn that off but as it stands now this is the only time it's happened in almost a year so it's definitely not something I can repeat and test against. I'm also not going to lose any sleep over this but it was just such a strange thing that I had to ask about it.

See Answer In Context

Reply
Replies 4
jmiller31_apc
Crewman jmiller31_apc
Crewman

Posted: ‎2021-07-01 02:13 AM

0 Likes
0
362
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Posted: ‎2021-07-01 02:13 AM

This was originally posted on APC forums on 3/8/2013


The strangest thing just happened to me, I have 4 NMC 2's on two different models of UPS's. These cards have all been up and running without a problem for the last 10 months or so. We monitor them via an SNMP app, all at once all 4 dropped off the network. They continued to respond to pings but SNMP, telnet and HTTP all failed to access them. Initially I assumed a network problem but they are on at least two different switches, after eliminating all possible network issues I hit the reset button on one of the NMC's. After booting it started responding normally, the logs show no event at the time it stopped responding. I then did the same on the other 3 cards and everything is back to normal.

Anyone have any ideas on why 4 independent cards would all apparently lock up simultaneously like that?

Thanks,

John

Reply
jmiller31_apc
Crewman jmiller31_apc
Crewman

Posted: ‎2021-07-01 02:13 AM

0 Likes
0
362
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Posted: ‎2021-07-01 02:13 AM

This was originally posted on APC forums on 3/8/2013


I was thinking the same thing and I suppose anything is possible but it was very odd. I waited about 45 minutes before rebooting them, pretty much after I had exhausted every other possibility I could think of.

Reply
BillP
Administrator BillP Administrator
Administrator

Posted: ‎2021-07-01 02:13 AM

0 Likes
0
362
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Posted: ‎2021-07-01 02:13 AM

This reply was originally posted by Angela on APC forums on 3/8/2013


I was only asking because I was curious if the watchdog timer kicked in that is outlined in the user's guide and knowledge base:

  • The default gateway is wrong or the network traffic is too heavy and the gateway can not be reached.

The default gateway can be any valid node's IP on the network management card's network. The Management Card implements internal watchdog mechanisms to protect itself from becoming inaccessible over the network. For example, if the Management Card does not receive any network traffic for 9.5 minutes (either direct traffic, such as SNMP,or broadcast traffic, such as an Address Resolution Protocol [ARP] request), it assumes that there is a problem with its network interface and restarts to prevent further problems. To ensure that the Management Card does not restart if the network is quiet for 9.5 minutes, the Management Card attempts to contact the default gateway every 4.5 minutes. If the gateway is present, it responds to the Management Card, and that response restarts the 9.5-minute timer. If your application does not require or have a gateway, specify the IP address of a computer that is running on the network most of the time and is on the same subnet. The network traffic of that computer will restart the 9.5-minute timer frequently enough to prevent the Management Card from restarting.

I was thinking this might have kicked in and the NMC would've rebooted itself but it is hard to say because of what caused the lock up in the first place. I have never really seen that before but as I am typing this, something did come to mind. Do you have IPv6 enabled on these cards? (It comes enabled by default on the newer firmware revisions as does IPv4). One customer I've worked with in the past claimed this caused a problem but I am not sure how that occurred - if it occurred because other devices on the network were using IPv6 and caused some type of storm but to me, it seems like it'd bring a lot of things down, not just the NMCs.

What firmware revisions do the cards have? (located under Administration->General->About in the web UI if you aren't sure) Also curious if they are all the same AOS rev.

Reply
jmiller31_apc
Crewman jmiller31_apc
Crewman

Posted: ‎2021-07-01 02:14 AM

0 Likes
0
362
  • Mark as New
  • Bookmark
  • Subscribe
  • Mute
  • Subscribe to RSS Feed
  • Permalink
  • Print
  • Email to a Friend
  • Report Inappropriate Content

Posted: ‎2021-07-01 02:14 AM

This was originally posted on APC forums on 3/8/2013


Yeah I thought about the watchdog timer too but the cards didn't restart and as you pointed out the time before I rebooted them was far greater than the 9.5 minutes. Also we have two different monitoring systems, one does SNMP polls every 5 minutes so in theory if there was a delay there the timer could in theory expire but the other system does a ping every minute so that would stop the timer from expiring. 3 of the cards are on AOS 5.1.7 and 1 is on 5.1.6. The IPv6 is an interesting thought, if it reoccurs I might turn that off but as it stands now this is the only time it's happened in almost a year so it's definitely not something I can repeat and test against. I'm also not going to lose any sleep over this but it was just such a strange thing that I had to ask about it.

Reply
Preview Exit Preview

never-displayed

You must be signed in to add attachments

never-displayed

Additional options
You do not have permission to remove this product association.
 
To The Top!

Forums

  • APC UPS Data Center Backup Solutions
  • EcoStruxure IT
  • EcoStruxure Geo SCADA Expert
  • Metering & Power Quality
  • Schneider Electric Wiser

Knowledge Center

Events & webinars

Ideas

Blogs

Get Started

  • Ask the Community
  • Community Guidelines
  • Community User Guide
  • How-To & Best Practice
  • Experts Leaderboard
  • Contact Support
Brand-Logo
Subscribing is a smart move!
You can subscribe to this forum after you log in or create your free account.
Forum-Icon

Create your free account or log in to subscribe to the forum - and gain access to more than 10,000+ support articles along with insights from experts and peers.

Register today for FREE

Register Now

Already have an account? Login

Terms & Conditions Privacy Notice Change your Cookie Settings © 2023 Schneider Electric, Inc