Data

So far, fingers crossed, so I managed to avoid an COVID-19 infection. While home office helped a lot, I took care when meeting other people. During the pandemic, I was taking the train to visit family, though, and, when preparing for the trip, I found myself browsing through seven-day-incidence data across Germany, manually overlaying it… Read More »InfoViz: COVID-19 Situation when Taking Trains

Well, we know the answer, it’s climate change. But, what exactly, is causing the record breaking events in the past few years, such as the 2012 Watson River (Akuliarusiarsuup Kuua) event, where the bridge got washed away? The mechanism (and here is where I apologize to arctic climatologists for the comparison) is much like what… Read More »Why Greenland is Melting

I am sure you have had that odd feeling after you bought a special piece of fashion from a major brand, only to discover, when looking at the label, that it was not produced anywhere near the location you had expected it to be produced. There is an exciting registry, OpenApparel, which sheds some light… Read More »Where your T-Shirts are Made

This is just a very short blog around how to store data in a SQL database without having to worry too much about continual schema changes. Most people will know about different flavours of storing data, flat files (csv, hdf, parquet, which is my favourite), SQL, or NoSQL datastores. I shall skip graph stores in… Read More »Storing structured data without schema changes

For the Arctic Risk data repository I decided to use a standard architecture often referred to as a data lake. we ingest live, soft real time data, using a suite of ingestion scripts (Continual or Warm), and we do one-off imports (Batch or Cold) The tool suite is centred around available open source tools. While… Read More »The FREEZE Data Pipeline