“Thus all [Frederick Douglass’s] life he had to fall back...