Our use case Here at Fexco, a fundamental part of our architecture requires real time stream processing. Specifically, the fast lane stream processing. To know what I’m talking about, please…
I recently configured a Kafka enabled Event Hub in Azure. I used a Spark Scala cluster to stream these events. The following are my findings. Kafka Enabled Event Hub First…
The following is a guideline for code reviewing Spark Applications. The code review doesn’t just end at the code, there are several configurations to review too. A clean configuration is…
While working on the Benchmark tool, we wanted a way to visualize the results. Visualizations would allow us to view benchmark results. We could compare results. And view performance over…
BACKGROUND This post is intended to go deep in the topics discussed on this post: https://techblog.fexcofts.com/2018/06/07/software-delivery-analytics-2/ The first step to build a any kind of software, consist in define what…
Following on from the benchmarking overview post, the following post will go into more detail on what metrics we are capturing, how we consume, and how we will intend to…
You don’t just want to do know that your system is working, you want to know that your system is working well. Gathering performance metrics is essential in knowing this.…
..or how to work with Spark Applications Abstract This article contains a description of procedures for best practices and Continuous Delivery processes with Spark Applications. Since there is basically three…
This post picks a side in the whole “is software development art or science?” discussion. By no means it has the ambition to be the final saying, nor we are…
Last week, the Spark Summit 2017 took place at the Dublin Convention Center. A lot of useful presentations are worth mentioning. Some of the main themes include Data Science, Machine…