Duff Anderson works on a railroad gandy dancer near Birmingham, Alabama, earning a good wage and living an itinerant life with his black co-workers. On their night off, while the other men drink and visit a pool hall, Duff decides to walk into the nearby small town, and ends up at a church meeting featuring good food and lively gospel music. There, Duff meets the pretty and genteel schoolteacher Josie, the daughter of Preacher Dawson. They begin to date against the wishes of Josie's father and stepmother, who think the relatively uneducated, non-religious, and (to them) arrogant Duff is not good enough for Josie. Despite her parents' objections, Josie continues to see Duff, partly because Duff shows himself willing to resist and challenge the social conventions that oppress black people, rather than just accepting the status quo in order to get along with white people, as Josie's father has done.