Name of a movie made about 1960?

It was a film noir, and the line I remember was a narration by the protagonist when he walks or drives in New York City, upon seeing some black people: "You hate them, and they hate you". What was this movie?