A man was arrested for setting a home on fire after an argument, the Spartanburg County Sheriff's Office said.