On the outbreak of the American Civil War he joined the Confederate Army and was given command of the Department of Norfolk. in May, 1862, he withdrew to join the forces defending Richmond. Blamed for the loss of Roanoke Island, he was relieved of his command.
After the war Huger he worked as a farmer in Virginia and North Carolina.
Benjamin Huger died in 1877.