Why were southern slaveholders anxious about the loyalty of white southerners who did not own slaves?