Vengala Vinay

Having 9+ Years of Experience in Software Development

Home » How to Debug and Fix memory leaks and socket exhaustion in daemon processes in Modern C++ Applications

How to Debug and Fix memory leaks and socket exhaustion in daemon processes in Modern C++ Applications

Diagnosing Memory Leaks in C++ Daemons

Memory leaks in long-running daemon processes are insidious. They manifest as a gradual increase in memory consumption, eventually leading to performance degradation, OOM (Out Of Memory) killer invocation, or outright crashes. In C++, these leaks often stem from unmanaged dynamic memory allocations, particularly within complex object lifecycles or when dealing with external libraries that don’t adhere to RAII (Resource Acquisition Is Initialization) principles.

The first step in diagnosing a memory leak is to establish a baseline and monitor the process’s memory footprint over time. Tools like top, htop, or even simple shell scripting can provide a high-level view. However, for precise leak detection, we need more granular tools.

Leveraging Valgrind for Memory Analysis

Valgrind’s Memcheck tool is the de facto standard for detecting memory errors, including leaks, in C++ applications. It instruments your code at runtime, tracking every memory allocation and deallocation. Running your daemon under Valgrind can be resource-intensive, so it’s best performed in a staging or development environment that closely mirrors production.

To run your daemon with Valgrind, you’ll typically execute it via the valgrind command. For daemons, it’s often necessary to prevent them from forking and detaching from the terminal, as this can interfere with Valgrind’s output. You might need to modify your daemon’s startup logic to run in the foreground for debugging purposes.

Consider a simplified example of a daemon that might leak memory:

#include <iostream>
#include <vector>
#include <thread>
#include <chrono>

// Simulate a resource that is allocated but not freed
class LeakyResource {
public:
    LeakyResource() {
        data = new int[1024]; // Allocate 1KB of memory
        std::cout << "LeakyResource allocated." << std::endl;
    }
    ~LeakyResource() {
        // Missing delete[] data; is the leak source
        std::cout << "LeakyResource destroyed (but memory might be leaked)." << std::endl;
    }
private:
    int* data;
};

void worker_thread() {
    while (true) {
        // This object is created and goes out of scope, but its memory is leaked
        LeakyResource* resource = new LeakyResource();
        // In a real scenario, this might be a more complex object or data structure
        // and the 'delete resource;' call might be missing due to logic errors.
        // For this example, we'll explicitly leak it to demonstrate Valgrind.
        // delete resource; // This line is intentionally commented out for leak demonstration.

        std::this_thread::sleep_for(std::chrono::seconds(1));
    }
}

int main() {
    std::cout << "Daemon starting..." << std::endl;

    // In a real daemon, you'd fork, set up signal handlers, etc.
    // For debugging, we'll run in the foreground.

    std::thread t(worker_thread);
    t.join(); // Keep the main thread alive

    std::cout << "Daemon exiting." << std::endl;
    return 0;
}

To compile this for debugging with Valgrind, use:

g++ -g -O0 -o leaky_daemon leaky_daemon.cpp -std=c++11 -pthread

Now, run it under Valgrind. To see leak reports, you’ll want to let the process run for a while and then exit gracefully (e.g., by sending a SIGTERM). Valgrind’s --leak-check=full option is crucial.

valgrind --leak-check=full --show-leak-kinds=all ./leaky_daemon

Valgrind’s output will be verbose. Look for sections marked “definitely lost,” “indirectly lost,” and “possibly lost.” The “definitely lost” category is the most critical, indicating memory that was allocated but never freed, and no pointers to it remain.

The output will point to the allocation site. For our example, you’d see something like:

==12345== HEAP SUMMARY:
==12345==     in use at exit: 1.00 KiB in 1 blocks
==12345==   total heap usage: 2 allocs, 1 frees, 1,024 bytes allocated
==12345==
==12345== 1.00 KiB in 1 blocks are definitely lost in loss record 1 of 1
==12345==    at 0x4C31B0F: operator new[](unsigned long) (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==12345==    by 0x400F30: LeakyResource::LeakyResource() (leaky_daemon.cpp:13)
==12345==    by 0x400F9A: LeakyResource::LeakyResource() (leaky_daemon.cpp:13) // Note: This might show up if the constructor itself allocates
==12345==    by 0x400F9A: LeakyResource::LeakyResource() (leaky_daemon.cpp:13) // Repeated lines indicate constructor calls
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29) // Repeated lines indicate loop iterations
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E4C: worker_thread() (leaky_daemon.cpp:29)
==12345==    by 0x400E