The following is a guideline for code reviewing Spark Applications. The code review doesn’t just end at the code, there are several configurations to review too. A clean configuration is…
Category: Development
Introduction This is the second part of a series of posts about how to develop Spark Applications. The first post was about working with notebooks. Objectives As we move forward…
Background This post aims to give an in-depth description about our continuous deployment pipeline. We are going to use the Continuous Deployment term as Martin Flower defined in this post,…
When talking about Angular, one of the biggest challenge that we used to have is with the SEO. Actually, is not a problem only with Angular, but it is a…
While working on the Benchmark tool, we wanted a way to visualize the results. Visualizations would allow us to view benchmark results. We could compare results. And view performance over…
In this article we are going to create a different chat using NodeJS and gRPC. But before we start, if you don’t know what is gRPC, I strongly recommend you…
Following on from the benchmarking overview post, the following post will go into more detail on what metrics we are capturing, how we consume, and how we will intend to…
Introduction This blog post details how to develop Spark Applications. Part I is related to Databricks Notebook development. Background As explained in the previous posts, Computing Platform will support two…
Worried about how to provide a quality SDLC to Databricks based Spark applications? REQUIREMENTS FOR THE READER Please read first this post previously to understand the current topic. Have a…
You don’t just want to do know that your system is working, you want to know that your system is working well. Gathering performance metrics is essential in knowing this.…