Spatial-Temporal III

Above are spatio-temporal plots of features acquired for 86 frames from ship video. For each frame a new set of features were computed and the top 10 were selected. Therefore there are 10 features for each frame. There are no correspondence assignments from frame to frame. These plots show how some features come and go as time progresses as well as the "wiggling" from an unstable video.

The idea now is to use RANSAC on these feature points to generate a delta matrix containing all the translations for any 2 frames. From that matrix we should be able to stabilize a buffered video sequence.

On a logistical note, I used matlab surface plotting to generate this:

FRAMES = 86;
mov = aviread('rdr.avi',1);
I = double(rgb2gray(mov.cdata));
[x, y, val] = klt_read_featuretable('Featgen.ft');

hold on

for k = 1:FRAMES
plot3(y(:,k),x(:,k),ones(1,10)*k,'r.')
end
legend('Feature Point')
grid on

surface(ones(720,480),flipud(I),...
'FaceColor','texturemap',...
'EdgeColor','none',...
'CDataMapping','scaled');
view(-18,72);
colormap gray

xlabel('x')
ylabel('y')
zlabel('frame')