Consider these two stories:
Alice grew up in a terrible home. Her mother abused her. Her father taught her by word and deed that morality is the advantage of the stronger. Her parents forced her to join them in their manifold criminal enterprises. Alice lacked good role models. When Alice turned 17, she grew wings and flew away.
Bob grew up in a terrible home. His father abused him. His mother taught him by word and deed that morality is the advantage of the stronger. His parents forced him to join them in their manifold criminal enterprises. Bob lacked good role models. When Bob turned 17, he rebelled and turned away from the life of crime.
The first story is unlikely and unbelievable. The second is unlikely but believable. This suggests that we don’t literally think that a really bad upbringing makes it literally impossible to do the right thing.
As an argument against determinism, this is rather weak, though. For even the determinist will say that there are many factors left out of story (2), and it could be that one of those left out factors that caused Bob to rebel.