Dirty Eyes

I grabbed some video this week and ran them through my filter and found an interesting issue.
The camera I used had small hair follicle and dirt on it. This caused the KLT feature selection to select the features of the dirt over the imagery behind it.

I need to either to ignore this by cleaning the lens or take this into consideration by thinking differently about what behaviors am I interested in from the set of features.

1. I want features that are initially translative in "nature" to become fixed (stabilization).
   
2. Initially, I want to ignore stationary features with the assumption that there is no feature I'm interested in having the nature of being perfectly stationary. i.e. A stationary feature must be from dirt or an object stuck to the viewing apparatus that is of no interest.

Of course, the big issue is that once we are tracked, we then fall into category two where the objects on the lens are moving and the interesting features are stationary. Yikes.