The following is a guideline for code reviewing Spark Applications. The code review doesn’t just end at the code, there are several configurations to review too. A clean configuration is…
While working on the Benchmark tool, we wanted a way to visualize the results. Visualizations would allow us to view benchmark results. We could compare results. And view performance over…
BACKGROUND This post is intended to go deep in the topics discussed on this post: https://techblog.fexcofts.com/2018/06/07/software-delivery-analytics-2/ The first step to build a any kind of software, consist in define what…
Following on from the benchmarking overview post, the following post will go into more detail on what metrics we are capturing, how we consume, and how we will intend to…
You don’t just want to do know that your system is working, you want to know that your system is working well. Gathering performance metrics is essential in knowing this.…
..or how to work with Spark Applications Abstract This article contains a description of procedures for best practices and Continuous Delivery processes with Spark Applications. Since there is basically three…
This post picks a side in the whole “is software development art or science?” discussion. By no means it has the ambition to be the final saying, nor we are…
Last week, the Spark Summit 2017 took place at the Dublin Convention Center. A lot of useful presentations are worth mentioning. Some of the main themes include Data Science, Machine…
Figure 1: Apache Spark architecture overview (courtesy of databricks) Software Engineering and juggling have some interesting similarities. Both activities must be broken down into simple easy to follow tasks, or…
In this post we’ll compare only the most recent version of Spring Boot (1.5.2-RELEASE) and the custom JEE microservice based on reference implementations we built two years ago. This microservice was created…