I'll have to double-check with mdwhatcott about the exact details of the open files problem, but I believe it had to do with "ulimit".

Yes, directories are walked continuously, with 250ms between each scan. So far this has worked pretty well (maybe on slower systems it should be slowed down). Over time I hope we'll get performance tweaked to an optimum.