Apache Spark, Python and Pandas, Columnar data formats, migrating away from Excel: It’s essential you get familiar with these topics if you’re beginning to grapple with challenging amounts of data. Before immediately jumping to the conclusion that “The Cloud” is the only next step– and getting lost in studying all the services out there – consider what you can do on your own laptop. Good data engineering will take you far. This post is an abbreviated version of three detailed articles I posted last year on the ISRDI Tech Blog.
[Read More]
Free Historical Stock Data Getting Hard to Find
Yesterday I went looking for free historical data for small cap companies only to find the Yahoo! Finance API had been turned off more than a year ago. Hmm, well on to Google Finance then… also turned off their API sometime in 2018. Darn, this was supposed to be a quick project.
[Read More]
What's the Healthiest Diet?
A few years ago I fasted every other day for a month to try out a human version of an experiment involving rats, to see if doing so would improve my vision. Read full details and results.
[Read More]
Brain Plasticity and Diet
Can change in diet or restricted eating / fasting effect human brain plasticity?
[Read More]
Colin or Collin?
Over the years a lot of people have had trouble spelling my name. When I was younger I assumed they hadn’t heard the name “Colin.” It was pretty unusual where I lived. Over the past twenty years the name has become more popular but the spelling trouble hasn’t improved. It turns out these days there’s another problem: an alternative spelling. Could “Collin” really be as common as “Colin”? I didn’t believe it.
[Read More]
Ruby with Parquet and Arrow on Ubuntu
Read and write Parquet files in Ruby with the ‘red-parquet’ gem; store data in memory with Arrow using the ‘red-arrow’ gem.
[Read More]
Everything is Terrible
It doesn’t get any easier, you just get faster
Greg LeMond
[Read More]
Why Turbo Pascal was Great
It’s been nearly twenty-eight years since the release of Turbo Pascal 6.0 on October 4 1990. Sometimes it feels to me like the evolution of programming languages and development environments has been a down hill slide ever since.
[Read More]
Notes on Writing and Reading Parquet Files in C++
Introduction
[Read More]
Agile Methodology Applied to House Flipping
Managing a House Renovation as an Agile Software Project
[Read More]