Scraping real estate prices using python and visualization using maps

TL;DR An interactive map, accurate as of 13/08/2018 showing property prices per square meter in various areas of Tallin: https://dvas0004.github.io/TallinnRealEstate/ Data shown is for 3-bedroom apartments (resource limitations). Green is less expensive, red is more expensive. Clicking on a data point will show a popup containing the actual price per square meter for that data … Continue reading Scraping real estate prices using python and visualization using maps

Advertisements

Developing Alexa Skills

In this article we'll explore how to add some custom skills to your Alexa powered device. The material in this blog post was tested on an Echo Dot - however Amazon recently enabled Alexa on most Android powered smartphones so the barrier for entry to developing these skills has been lowered significantly. I actually ended … Continue reading Developing Alexa Skills

Nugget Post: Reactive Functions to parse nested objects

Note this article assumes familiarity with the Observer Pattern / Reactive Programming as described here: http://reactivex.io/ Some APIs return complex nested JSON objects. For example, take this cleaned up sample response from ElasticSearch (which incidentally is used to build the "Data Table" visualization): https://gist.github.com/dvas0004/8f3427955a5bb21213c864d30094d072 Note the structure of the object. Within the top level "aggregations" object … Continue reading Nugget Post: Reactive Functions to parse nested objects

How we built the CyberSift Attack Map

Recently we launched a small site called the "CyberSift Attack Map" hosted at http://attack-map.cybersift.io. Any one involved in the InfoSec industry will be instantly familiar with the site:   It's basically a map of attacks which either trip some rule in a signature based IPS such as SNORT, or land in a honeypot. In this article we'll list … Continue reading How we built the CyberSift Attack Map

Elasticsearch & Python: Tips for faster re-indexing

Some valuable lessons learned while going through an elasticsearch re-indexing exercise. (For the uninitiated, re-indexing data basically means getting large volumes of documents from elasticsearch, enriching or changing the data within each document, and then sending these back). The below assume python and the use of the python elasticsearch client (https://elasticsearch-py.readthedocs.io/en/master/). 1. When retrieving data, use the … Continue reading Elasticsearch & Python: Tips for faster re-indexing

Notes on Google Firebase Cloud Messaging

I'm a huge fan of Firebase, so I'm very excited that Google Cloud Messaging [GCM] has been re-branded Firebase Cloud Messaging [FCM], which can be used for cross platform messaging. It's actually very simple to set this up on Android and IOS, but what's more interesting is the web client. I was really hoping things … Continue reading Notes on Google Firebase Cloud Messaging

Signing GMail Messages with the Estonian eID PKI Card (Part 2)

In a previous blog post we explored how to sign messages using the Estonian eID card. In this video, we demonstrate how a receiver who got a signed email message would be able to verify that the email really did come from the advertised sender. https://youtu.be/Nx-jRPIAyEM I have uploaded the revised code to github, please … Continue reading Signing GMail Messages with the Estonian eID PKI Card (Part 2)