Welcome to the new Schneider Electric Community

It's your place to connect with experts and peers, get continuous support, and share knowledge.

  • Explore the new navigation for even easier access to your community.
  • Bookmark and use our new, easy-to-remember address (community.se.com).
  • Get ready for more content and an improved experience.

Contact SchneiderCommunity.Support@se.com if you have any questions.

Close
Invite a Co-worker
Send a co-worker an invite to the Exchange portal.Just enter their email address and we’ll connect them to register. After joining, they will belong to the same company.
Send Invite Cancel
84849members
354310posts

PME Web Application and web scraping

Archives: Power Management Systems

sesa105048_brid
Lieutenant Lieutenant
Lieutenant
0 Likes
7
101

PME Web Application and web scraping

Hi Everyone,

On PME 722 and PME 8 Web Application, I have some customers which reported a very high CPU load(almost close to 100%) by w3wp.exe process.

After a lot of investigations on systems found that no any problems are reported as PME Web Application issue or other PME components but some Real time trends or Dashboard are not refresh on time or are not refresh at all.

Further investigations with some help reports of it engineers, we found that these PME servers faced with web scarping issue.

I asked customers to implement something on IT environment to prevent  web scraping.

Additional I asked all to completely disable the Visitor login on PME Web and to change password for supervisor, guest and other PME application Engineering Clients and Web clients.

Fore some which do not have secure IT network asked to create insolated LAN for PME system and Clients.

Does any one faced with such issue?

Does any one have some specific ideas to prevent this issue for PME web?

At Continuous Engineering level, do we have a web scraping defending policy?

Thank you for any contribution.

Vasile Deaconescu

7 Replies 7
Malachi_Brown
Commander Commander
Commander
0 Likes
1
56

Re: PME Web Application and web scraping

Are these servers accessible on the public internet?

sesa111809_brid
Lt. Commander Lt. Commander
Lt. Commander

Re: PME Web Application and web scraping

I haven't experienced this problem, but there's a couple things you can try to resolve this:

1).  Install the latest Windows service pack and Windows security updates on the server and reboot the server.

2).  Limit the amount of data that can be queued by w3wp.exe file by making this registry entry.

         a). Click Start, click Run, type regedit, and then click OK.

         b). Locate and then click the following registry key:

               HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\ASP\Parameters

         c). On the Edit menu, point to New, and then click DWORD Value.

         d). Type VectorSendThrottleLimit, and then press ENTER.

         e). In the right pane, right-click VectorSendThrottleLimit, and then click Modify.

         f).  In the Value data box, type the value that you want, and then click OK.

*** make a backup of the Windows registry before making any changes to the registry.

sesa111809_brid
Lt. Commander Lt. Commander
Lt. Commander
0 Likes
0
56

Re: PME Web Application and web scraping

I do remember a situation on a customer's system where the CPU and RAM was heavily utilized and the w3wp.exe process was using a lot of resources.  The customer's server team added two additional quad- core processors to the server (which is a virtual machine) and this resolved the problem.    This gave the server a total of 4 quad-code processors.    The server has over 36,000 source/measurement pairs.

sesa105048_brid
Lieutenant Lieutenant
Lieutenant
0 Likes
0
56

Re: PME Web Application and web scraping

Hi,

Yes. They are with some specific security measures.

Thank you.

Vasile

sesa105048_brid
Lieutenant Lieutenant
Lieutenant
0 Likes
0
56

Re: PME Web Application and web scraping

Thank you Barry.

Sounds a good idea to limit the queue.

Any way, scraping can still work may be.

As i learned a few it is very difficult to prevent this issue to manifest if  PME system is not part of corporate entity with a professional IT secure environment.

The better an simple  i found is only  LAN with high restriction or forbidden Internet access.

Thank you.

Vasile

sesa140944_brid
Schneider Alumni (Retired)
Schneider Alumni (Retired)
0 Likes
1
56

Re: PME Web Application and web scraping

Hi Barry,

Thanks for the thorough recommendation.  I looked online and there is a range of recommendations.  I also found that the wrong throttle limit could cause IIS to hang.  Do you have a recommendation for the VectorSendThrottleLimit value? 

Also, I noticed that this issue primarily showed up in Server 2003 and IIS6.  The customer has Server 2012 with IIS 8 (image shows version below).  Do you still see this working for the newer versions of Windows and IIS?

iis.png

Thanks for the support!

Best Regards,
Besrat Ayalew

sesa111809_brid
Lt. Commander Lt. Commander
Lt. Commander

Re: PME Web Application and web scraping

Besrat

I understand Microsoft implemented multicore scaling in IIS 8.0.   You may want to read how-to configure the worker process in application pools.
IIS 8.0 Multicore Scaling on NUMA Hardware : The Official Microsoft IIS Site