Apache NiFi: Custom Web Scraper Processor – Powered by Selenium

Posted on by David Vassallo

In this article we explore how to build a custom Apache Nifi processor. Our objective is to build a custom NiFi processor, written in Java, that uses Selenium to scrape an arbitrary piece of information off a web-page. The end result will look like this: https://www.youtube.com/watch?v=alRC8owgjl4&feature=youtu.be This highlights the flexibility of Apache NiFi, showing off … Continue reading Apache NiFi: Custom Web Scraper Processor – Powered by Selenium

Advertisement

Lessons learned: Gephi not starting up

Posted on by David Vassallo

Scenario: When using Ubuntu Trusty (14.04.3LTS) Gephi 0.82 initializes but gets stuck on "Loading Cached Objects" Solution: The default Gephi startup bash script does not correctly initialize the JAVA path (it uses $jdkhome) The solution is simply to add the following to the beginning of the startup script (~/gephi/bin/gephi) export JAVA_HOME=/usr/lib/jvm/default-java jdkhome=$JAVA_HOME The full script is … Continue reading Lessons learned: Gephi not starting up