It's about a Frenchman who kills a man because he's so alienated from other people. I don't know for sure that the Billy Joel song isn't based on it, but I'd be shocked if it were.
Billy Joel perhaps took a hint from the Camus story, The Stranger. The book is about a young Algerian man who takes up with the wrong company and kills someone.
