Python Pickling in the cloud (or how to get python to execute code it hasn’t seen yet)

Problem - What are we trying to solve? Let's assume you have the beginnings of a simple distributed system: You use redis as your event queueYou have a "master" python script that pickles a python class, and sends it to your redis queueYou have a "worker" python script that waits for a new event, unpickles … Continue reading Python Pickling in the cloud (or how to get python to execute code it hasn’t seen yet)

Exploring Gaussian Process vs Linear Regression

Linear regression is often one of the first algorithms that data analysts are introduced to. The intuition is simple: find the best line that fits a given data set. For example, given the below data set: you'd probably answer with something along these lines: That is, in fact, the answer given by Linear Regression. However, … Continue reading Exploring Gaussian Process vs Linear Regression

Voice Controlled Christmas Tree Lights

What we're building: https://youtu.be/Lgtpi0k7FD8 It's a great project to get started with learning about IoT, and Alexa. Hardware Particle Photon micro-controllerAdafruit Featherwing mini-relay (https://learn.adafruit.com/mini-relay-featherwings/overview)Amazon Alexa (Dot in my case...)Optional for some extra holiday cheer: Adafruit NeoPixel Stick (https://www.adafruit.com/product/1426) Circuit Diagram Fritzing file can be found here: https://github.com/dvas0004/SmartMote/blob/master/SmartMote_v1.fzz Notes, tips and tricks about the Hardware The … Continue reading Voice Controlled Christmas Tree Lights

Scraping real estate prices using python and visualization using maps

TL;DR An interactive map, accurate as of 13/08/2018 showing property prices per square meter in various areas of Tallin: https://dvas0004.github.io/TallinnRealEstate/ Data shown is for 3-bedroom apartments (resource limitations). Green is less expensive, red is more expensive. Clicking on a data point will show a popup containing the actual price per square meter for that data … Continue reading Scraping real estate prices using python and visualization using maps

Developing Alexa Skills

In this article we'll explore how to add some custom skills to your Alexa powered device. The material in this blog post was tested on an Echo Dot - however Amazon recently enabled Alexa on most Android powered smartphones so the barrier for entry to developing these skills has been lowered significantly. I actually ended … Continue reading Developing Alexa Skills

Nugget Post: Reactive Functions to parse nested objects

Note this article assumes familiarity with the Observer Pattern / Reactive Programming as described here: http://reactivex.io/ Some APIs return complex nested JSON objects. For example, take this cleaned up sample response from ElasticSearch (which incidentally is used to build the "Data Table" visualization): https://gist.github.com/dvas0004/8f3427955a5bb21213c864d30094d072 Note the structure of the object. Within the top level "aggregations" object … Continue reading Nugget Post: Reactive Functions to parse nested objects

How we built the CyberSift Attack Map

Recently we launched a small site called the "CyberSift Attack Map" hosted at http://attack-map.cybersift.io. Any one involved in the InfoSec industry will be instantly familiar with the site:   It's basically a map of attacks which either trip some rule in a signature based IPS such as SNORT, or land in a honeypot. In this article we'll list … Continue reading How we built the CyberSift Attack Map