Introduction A few weeks ago I saw comments between @Sondy and @JLGalache talking about getting a list of asteroids with their date of discovery. The main data file lists the year of discovery but not the actual date. I thought there was a way to get this information by looking at the observation file and joining it to the main data file. Todo this I decided to use Apache Spark. In this post I’ll go through setting up the spark environment and reading the json object file....

Hello World I’m Emily Selwood. Every so often I get the urge to try and start a blog again. Here is iteration 235. What do I do? I build systems for a living. Mostly data processing but I’ll happily get my hands dirty doing anything that needs to get done. I’ve worked many things from Unity and C# to C, Groovy, Go, Javascript, and Big data things like Accumulo and Spark....