Note to self: Changing loglevel in apache Spark

Very quick note for future reference. Please ignore. Change loglevel in spark Easy peasy, you can do it programatically in the application like: spark.sparkContext.setLogLevel("WARN") Change loglevel in yarn This one took a while to find, you can just run spark-submit while previously exporting this envvar: export YARN…

How to reuse HTTP response body in Golang

Took me a while to figure it out, but it seems that in golang you cant re-read from an http response. I found here a way to solve it. For debugging purposes, I had to be able to print the raw response as well as decoding it to json, to…

Making a Beautiful Map of Spain in ggplot2

A few weeks ago I read an article in which Timo Grossenbacher showed how he managed to plot, in my opinion, one of the most beautiful maps I have ever seen. So I went and tried to replicate it. First of all, here is the map. As usual, you can…

How to mock http endpoints in Golang with custom ports

So I was updating the testing suite in one of Tribe's microservices. This one in particular deals with sending the postbacks to the right endpoints. If you search for testing http requests, chances are you will almost always stumble upon an example like: import ( "log" "net/http" "net/http/httptest…