It shouldn't be books as I see it but articles, short texts, essays(maybe books of articles, like "97 Things Every Programmer Should Know")
What I came up by now is this: "Go To Statement considered harmful" - by E. W. Dijkstra "Can Programming Be Liberated from the von Neumann Style? A Functional Style and Its Algebra of Programs" - by J.Backus "No Silver Bullet - Essence and Accident in Software Engineering" - by Frederick P. Brooks, Jr. "Out of the Tar Pit" - by Ben Moseley and Peter Marks "The roots of LISP" - by Paul Graham
Please, help me fill this list if you know any good articles like this(maybe from ACM or other magazine, maybe from some random blog)
I created a repo for this, feel free to make a pull request: https://github.com/reflechant/major_programming_articles