A guide for engineers and scientists

Because programming has become an essential component of engineering, science, medicine, media, business, finance, and many other fields, it is important for scientists and engineers to have a basic foundation in computer programming to be competitive.

Tolstoy’s coding advice

You should only code when you feel within you some completely new and important idea, clear to you but unintelligible to others, and when the need to express this idea gives you no peace.

(code, idea) = (write, content)

Invert, always, invert

...it is in the nature of things that many hard problems are best solved when they are addressed backward.

"It is remarkable how much long-term advantage people like us have gotten by trying to be consistently not stupid, instead of trying to be very intelligent." — Charlie Munger

I am a strange loop

In the end, we are self-perceiving, self-inventing, locked-in mirages that are little miracles of self-reference.

Future is defined by things we want to improve from our past.

Habits of high-functioning teams

Our communications with each other should be guided by the robustness principle: Be conservative in what you send, be liberal in what you accept.

Functional code is honest code

That’s the goal, really. Simplify understanding. No surprises. Honest code.

Output depends only on input.

Advanced usage of requests

BaseUrlSession allows you to specify the base URL for the HTTP client and to only specify the resource path at the time of the request.

The opposite of requests is Falcon which lets you speak HTTP.

Hadoop with Python

Spark can read files residing on the local filesystem, any storage source supported by Hadoop, Amazon S3, and so on. Spark supports text files, SequenceFiles, any other Hadoop Input‐ Format, directories, compressed files and wildcards.

I should I knew Spark can read compressed gigabyte CSVs.

1 2 3 4 5 6 7 8 9