180 Degrees

Note: This post started out as a thread on mastodon. Please follow me there if you’d like to see this sort of thing early Lets start talking about something I wish I didn’t know as much about as I do. The 180 degree line! +/-180 degrees longitude. It is not the same thing as the international date line, that’s defined politically which lots of wiggles through the pacific islands. The 180 degree line only crosses two countries, Russia and Fiji....

2022 November 14 · Emily Selwood

Announcing a new me

Hi. My name is Emily. No I’ve not taken over this blog for the day. I’m still the same author but a while ago I came to realize I’m a woman so my old name didn’t fit any more. Don’t panic I’m still doing mostly the same things as before. Just with less background noise in my head so things are a lot better. Family, friends, and colleagues reading this Waves....

2019 September 6 · Emily Selwood

Golang Resparse

A little while ago I found my self needing to be able to parse screen resolutions when generating some images in a golang program. I created a library to do this and had a bit of fun optimising it. The result is open source on github. It is a very simple library with a single function but I thought it might be interesting to walk you through the process. What we need to build is a function that takes a string like “1080p”, “800x600”, or “4K” and returns a width and height value....

2018 December 8 · Emily Selwood

Windows Subsystem for Linux Dot files

I’ve been using the Windows Subsystem for Linux (WSL) for a while at work. It’s been something of a radical improvement over cygwin for most of my use cases. A couple of weeks ago my installation got borked by the work Antivirus (AV) system. So I’ve created an automated script to set up my environment just how I currently like it. Before we start lets get one thing out the way....

2018 August 9 · Emily Selwood

Finding flatroofs with QGIS

A little while ago I attended the Climathon kic event/hackathon in Bristol at my old university. The event was to come up with solutions that could help with pollution in the city. There were not a lot of people who turned up so we formed a single team. The idea we came up with was to create an incentive for people with flat roofs to put plants on them. This meant we needed to be able to find flat roofs in the city....

2018 January 26 · Emily Selwood

Spark and the Minor Planet Center data part 3

In the last post we read the minor planet center observation file. This was a fixed width text file. We only pulled a couple of columns out of it, but we learnt to use User Defined Functions, groupBy and select. In the first post of this series we covered reading a json file which contained information about all the asteroids we know about. This time we are going to join the two data sets together and finally solve our original problem, which was to find the full date of the earliest observation of each un-numbered object....

2017 December 5 · Emily Selwood

Spark and the Minor Planet Center data part 2

In the last post we read the minor planet center orbit file. This was a JSON text file. This time we are going to look at a bit more complex file to process. If you haven’t read the first post in this series I recommend starting there before reading this. In this post we are going to be looking at the Observation file. There are two parts to this file. One is for the numbered objects and other other for the un-numbered objects....

2017 December 3 · Emily Selwood

Spark and the Minor Planet Center data

Introduction A few weeks ago I saw comments between @Sondy and @JLGalache talking about getting a list of asteroids with their date of discovery. The main data file lists the year of discovery but not the actual date. I thought there was a way to get this information by looking at the observation file and joining it to the main data file. Todo this I decided to use Apache Spark. In this post I’ll go through setting up the spark environment and reading the json object file....

2017 December 2 · Emily Selwood

Introduction

Hello World I’m Emily Selwood. Every so often I get the urge to try and start a blog again. Here is iteration 235. What do I do? I build systems for a living. Mostly data processing but I’ll happily get my hands dirty doing anything that needs to get done. I’ve worked many things from Unity and C# to C, Groovy, Go, Javascript, and Big data things like Accumulo and Spark....

2017 December 2 · Emily Selwood