I am in the process of setting up Ubuntu 9.04 on my Linode instance. Looks like Vi was behaving screwy (Keys did not work as expected). Luckily there is Google and the following link helped.
I created a .vimrc file in my home directory:
and added the following line to it:
That worked for me.