With a little practice you can quickly move columns or rows.
Select the entire column or row you want to move
The move will effect whatever is selected; cells, or columns, or rows
Move your mouse pointer to the edge of the selection until it changes from a normal pointer cross to an arrow (four headed arrow in 2007+).
(Put the pointer on the selected cells, not the Row or Column indicators.)
Hold down the shift key and click the left mouse button and drag the column/row to the new position.
Release the mouse button before releasing the shift key