Is it Elastalert? No – it’s NiFi!!

One common requirement for users of Elasticsearch is to have automatic alerts sent out whenever some query gets matched, or when some other condition gets satisfied. In fact, Yelp have come up with a python-based solution for this in the form of Elastalert, which at time of writing, is extremely popular with over 5.5K stars … Continue reading Is it Elastalert? No – it’s NiFi!!

Advertisements

Consuming Netflow using NiFi

The problem Several network devices (especially Cisco) tend to use netflow for auditing network connections. It would be useful to log these connections in a structured data store (Elasticsearch is my data store of choice). Alternative Solutions Using the elasticsearch netflow module: https://www.elastic.co/guide/en/logstash/current/netflow-module.htmlThis works well right out of the box, and supports all netflow versions. … Continue reading Consuming Netflow using NiFi

Lessons Learned: GoLang GORM – filtering associations

The problem Given the following code: type User struct { gorm.Model Username string Orders []Order } type Order struct { gorm.Model UserID uint Foobar string } The above Golang code defines a "Has Many" association, leading to a schema where a "User" "has many" "Orders", with the "user_id" key acting as a foreign key. How … Continue reading Lessons Learned: GoLang GORM – filtering associations

Python Pickling in the cloud (or how to get python to execute code it hasn’t seen yet)

Problem - What are we trying to solve? Let's assume you have the beginnings of a simple distributed system: You use redis as your event queueYou have a "master" python script that pickles a python class, and sends it to your redis queueYou have a "worker" python script that waits for a new event, unpickles … Continue reading Python Pickling in the cloud (or how to get python to execute code it hasn’t seen yet)

Embedding Bokeh into a ReactJS app using BokehJS

This project highlights how to use BokehJS to (very) easily include Bokeh visualizations in an HTML webpage. The project uses the following tech: Bootstrapped with Create React App. Bokeh is an excellent python vizualization library that is quite popular among data scientists. Bokeh Homepage Flask is a python webserver microframework that allows you to quickly … Continue reading Embedding Bokeh into a ReactJS app using BokehJS

Exploring the WebAuthn API; a bare-bones JS app

I had no idea the WebAuthn API even existed until I came across this article by @herrjemand. In that article, the author used WebAuthn to automatically generate and save passwords in the Chrome credential manager. What more can this browser API do? How would you use it? What is WebAuthn - and why the buzz? We know passwords are a necessary evil. Credential managers are a hassle to setup and use, passwords are re-used across sites and applications - and we often choose weak or easily-guessed passwords. WebAuthn is oft touted as a "password killer". We've seen … Continue reading Exploring the WebAuthn API; a bare-bones JS app

Part 2 – Inspired by Gatsby.js : Rolling your own GraphQL powered WordPress API (this time with Spring Boot)

In the first part of this two-article series, we explored rolling your own WordPress GraphQL adapter, inspired by the work done by GatsbyJS, written in Javascript and hosted on GraphCool. In this article, we'll build the same thing, this time using Java. Spring Boot and GraphQL Java Kickstart make this quite easy. Pre-requisites For anyone … Continue reading Part 2 – Inspired by Gatsby.js : Rolling your own GraphQL powered WordPress API (this time with Spring Boot)