RAM usage is rising continuously

Started by ronny

RAM usage is rising continuously   08 May 2016, 04:50

Hi Andrew,

I just need to confirm something please.

Windows Server 2003 + BWM 2.9.1 ran for 23 days.
Ram Usage: 14-15MB, never seems to go higher than 18MB.
SoftPerfect support forum

Windows Server 2012 R2 + BWM 3.1.6 running for almost 7 days.
Ram Usage: 280MB and growing at rate of 30-40MB per Day and never drops, just rises.
SoftPerfect support forum

I am using both with the exact same rule-set, on the same network, currently testing 3.1.6 before I buy it.
So the 2003 server is currently offline as the 2012 server is in it's place.

Now my question is, I have run 2.9.1 once for over 300 days without a reboot and never encountered any problems I have also never seen the ram usage go over 18MB.

In 3.1.6 I can understand the RAM usage being higher with all the new features, I am just concerned that number in 3.1.6 just keeps climbing.
What will happen when I get to 4GB after 100 Days or 8GB after 200 Days of up-time? (I have 8GB of RAM in the Server)
Does 3.1.6 have any recovery or refresh procedure should it exhaust all available RAM?

I am running it in production to stress test, and keeping a close eye, ready to switch back to the old server in case something goes wrong.
So far so good, everything seems to be running flawlessly, but the RAM usage has me concerned.
Attachments:
open | download – 2003.jpg (34.4 KB)
open | download – 2012.jpg (43.5 KB)
SoftPerfect Support forum - Andrew avatar image

Re: RAM usage is rising continuously   08 May 2016, 17:35

I'd like to see your entire ruleset from version 3.1.6. You can save to a DB file, compress and e-mail me through this link.

As far as I can tell there aren't any memory leaks, but you may have a cache building up or something like that. With your ruleset I can see what features are used and where the growing memory usage might come from.

Re: RAM usage is rising continuously   08 May 2016, 18:08

Hi Andrew,

I have sent my Backup of the rule set.

Thank you smile
SoftPerfect Support forum - Andrew avatar image

Re: RAM usage is rising continuously   09 May 2016, 16:22

I have reviewed your ruleset and found two features in use that could potentially consume memory in a long run:
  • P2P filter in the P2P Off-Peak rule. This filter uses the open source NDPI library that allocates on its own and may be a reason of this growth.
  • Using domain names in some rules. When domain names are in use, BM maintains a cache of what IP address maps to what domain name. With a number of users constantly browsing, the cache will grow.

The domain names cache is cleaned up periodically and the entries that have been there longer than 60 x DNS TTL are purged. I am not sure how exactly this number was chosen, but it's not necessary to keep them for that long. In the worst case scenario where TTL is 86 400 (1 day), the entries would be kept for 2 months! For practical purposes keeping the records for 2 x TTL should be good enough.

Please try the new build with shorter DNS cache expiry time and let me know if the memory consumption pattern changes. If not, try also turning off the P2P filter, but I think the culprit is the DNS cache and the new build should resolve it.
Johnny

Re: RAM usage is rising continuously   09 September 2016, 07:25

Hi,

I have been having this issues for years and tried all your solutions.

Only happens on servers above Win2003. Like now my 2008 just went offline after one day, just consumes all memory and crashes. Takes a day or two. I will try latest builds to see if the DNS changes helps.

/J

Reply to this topic

Sometimes you can find a solution faster if you try the forum search, have a look at the knowledge base, or check the software user manual to see if your question has already been answered.

Our forum rules are simple:

  • Be polite.
  • Do not spam.
  • Write in English. If possible, check your spelling and grammar.

Author:

Email:

Subject

A brief and informative title for your message, approximately 4–8 words:

     

Spam prevention: please enter the following code in the input field below.

 ********   ******   ********  **     **   *******  
    **     **    **  **        **     **  **     ** 
    **     **        **        **     **         ** 
    **     **        ******    *********   *******  
    **     **        **        **     **         ** 
    **     **    **  **        **     **  **     ** 
    **      ******   **        **     **   *******  

Message: