[Aide] memory consumption

[Nicolae Mihalache]

Richard van den Berg wrote:
> Nicolae Mihalache wrote:
>   
>> The problem is that my database gets about 260MB in size (about 2.6M
>> lines), and when comparing the databases aide consumes quite a lot of
>> memory (I stopped it when it consumed all 512MB I have :( ).
>> Is there a reason for consuming so much memory?
>>     
>
> IIRC the database is completely read into memory. Then all files are
> checked, with the results again stored in memory. Then the compare is
> done between those 2 databases in memory. If you cannot simplify your
> database, you can try integrit at http://integrit.sourceforge.net/ which
> claims to have a small memory footprint.
>
>   

The database is not complex, only that there are plenty of files inside.
When comparing two databases I don't see the point in reading them
completely in memory. If they are sorted in some manner (and they should
be if  the configuration file is not changed), they could easily be
incrementally compared and maybe only the differences kept in memory.
For now, I can solve the problem by spliting the configuration file in
many smaller parts limited to specific sections of the directory tree,
but it would be nice if AIDE manged this by itself.

Regards,
nicolae


PS:
I quickly checked integrit, they don't support comparision of two
databases and I don't know if I can trust them for the memory footprint.