Presumably, it's somewhat expensive to run face recognition on all of your photos. When you turn it off, they have to throw away the index (they'd better be doing this for privacy reasons), and then rebuild it from scratch when you turn the feature on again.
The hard problem then is not to eliminate non-deterministic behavior, but find a way to control it so that it produces what you want.