Modulation for OSC & Sample "Fine"

I like the idea of drift which changes the fine every time hiring a new note. With a pad or sustain sound it would be nice to modulate the “Fine” over time or implement additional to the actual “Note Drift” a “Modulation Drift” means modulation drift over time.
What is the reason that it is not possible to modulate “Fine”?