Increasing memory use over time

[stm]

I am using v6.0.6 and I've noticed that over time the memory use of MezzmoMediaServer.exe process just keeps growing. Once I see it nearing 2GB (as it appears to bit a 32bit non LAA exe) I restart the Mezzmo server and it goes back to under 100MB and the cycle repeats over a number of days/weeks.

This installation is almost never used as I've moved my main media type which is photos to IMatch photo web server. This only leaves a few rarely viewed videos and a small amount of music which even when not accessed for weeks on end makes no difference to this behaviour. I don't know if this is a memory leak or whatever memory management it uses just suffering from increased memory fragmentation or not releasing memory back to the OS.

I've not had time to check for more detailed windows resource use yet but is this process expected to max out its process space? As I run other key services on the machine in question I haven't left it longer to see what happens, and I could schedule a service restart every night but that isn't ideal.

Any thoughts?

[Peter]

Mezzmo media server has a number of worker threads that will update the library in the background, when opening files Windows will indicate the memory size of the process including the size of the opened file so possibly Mezzmo server is reading from 2Gb files at this time?

[stm]

Mezzmo media server has a number of worker threads that will update the library in the background, when opening files Windows will indicate the memory size of the process including the size of the opened file so possibly Mezzmo server is reading from 2Gb files at this time?

Just before I last restarted the MezzmoMediaServer.exe process I checked with Process Monitor and Process Explorer and although the process had a number of files open (mostly its database), no file I/O was taking place. The size of all the Mezzmo database files in the root folder combined is just 12MB. The items I have left in Mezzmo are just 200 very small videos (short exported clips of notable events from my home CCTV) and around 3000 mp3 tracks.

When the process size grows again, is there anything useful I can check before restarting the process?

[Peter]

You could create a dump of the process from Windows task manager so that we could try to see where the memory is allocated? Go to task manager and find MezzmoMediaServer.exe in the list and right-click and select to create a dump file. Then zip it up and send it to us.

[stm]

You could create a dump of the process from Windows task manager so that we could try to see where the memory is allocated? Go to task manager and find MezzmoMediaServer.exe in the list and right-click and select to create a dump file. Then zip it up and send it to us.

While I am waiting for the MezzmoMediaServer.exe process to hit nearly 2GB again for a process dump (currently just over 1GB) I've been watching some process resource usage and it has over 5500 file handles open.

Although that's possible for some applications with many data/resource/dll files, what's odd here is there are well over 600 handles for each of the files: Mezzmo.db, Mezzmo.dm-wal, MezzmoPluginMetadata.db, MezzmoPluginMetadata.db-wal, MezzmoStreamingStatus.db, MezzmoStreamingStatus.db-wal, MezzmoTranscode.db. This makes it look like its failing to close the files and release the handles so that could be one issue of increasing memory use.

I'll keep monitoring for anything else that looks suspicious as its memory use grows.

[Peter]

MezzmoMediaServer.exe opens multiple connections to the database and keeps them open from different parts of the server so it is not unusual to have multiple connections open. How long do you have MezzmoMediaServer.exe running before the memory usage increases?

[stm]

MezzmoMediaServer.exe opens multiple connections to the database and keeps them open from different parts of the server so it is not unusual to have multiple connections open. How long do you have MezzmoMediaServer.exe running before the memory usage increases?

I still think 600 file handles per file and growing is excessive. It's only using a bit over 30+ threads.

The current instance has been up 9 days and since my last post another 290 handles in total are now permanently open by that process (so 5790 total) so that's now over 650 for each of the files I listed earlier. It's using 1.1GB memory and still rising.

[stm]

Just an update that memory use is still climbing as are handles for Mezzmo.db, Mezzmo.dm-wal, MezzmoPluginMetadata.db, MezzmoPluginMetadata.db-wal, MezzmoStreamingStatus.db, MezzmoStreamingStatus.db-wal and MezzmoTranscode.db.

Each of those files now has over file 760 handles open on them, and total process memory is 1.3GB. Since the process was started it hasn't served any content so that's no a factor.

Some current process details:
Process details-1.jpg

[Peter]

Are you running the latest version of Mezzmo or an older version? We did have handle leaks in the past but have fixed them since then. We will try running the server for an extended period to see if any leaks occur.

[Peter]

I have had MezzmoMediaServer.exe running for several hours now. The memory use is sitting on 43, 476 K and the handles is 2,931 (2,804 was the value when I first checked). Threads is 49, when I first checked it was 47 so there are two new worker threads running. Memory use dropped to 15, 620 K while I was typing this so maintenance or another process just ended.