You can put Debian on a memory stick (keydrive) and boot it directly from the memory stick.

See also: Keydrive