That Balrogs were ever killed at all indicates that they were incarnate, and thus susceptible to attacks with sharp things. For more on Balrog incarnation, see
this thread.
Edit: Gandalf was not relatively 'little' (that is, relative to the Balrog's attributes), either in spiritual potency or in physical size.
[ January 03, 2003: Message edited by: obloquy ]