A man was arrested in New Jersey weeks after he allegedly set a fire in a Maryland Walmart and stole from the store, according to State Police.