I recently configured a Kafka enabled Event Hub in Azure. I used a Spark Scala cluster to stream these events. The following are my findings. Kafka Enabled Event Hub First…
We need to capture requirements in a clear and consistent manner. We will be using Gherkin syntax for doing this. Gherkin syntax provides a structured way to writing requirements for…
The following is a guideline for code reviewing Spark Applications. The code review doesn’t just end at the code, there are several configurations to review too. A clean configuration is…
While working on the Benchmark tool, we wanted a way to visualize the results. Visualizations would allow us to view benchmark results. We could compare results. And view performance over…
Following on from the benchmarking overview post, the following post will go into more detail on what metrics we are capturing, how we consume, and how we will intend to…
You don’t just want to do know that your system is working, you want to know that your system is working well. Gathering performance metrics is essential in knowing this.…
BACKGROUND While working on modelling a schema in Cassandra I encountered the concept of Materialized Views (MV). MVs are basically a view of another table. So any CRUD operations performed…
The following are some guidelines to be used when developing API’s. Keeping methods and responses consistent is very important for the consumers to understand the API. HTTP Methods GET: GET…
Azure allows you to purchase/manage SSL certificates through the Azure portal. The service is call App Service Certificates. However, the portal only accommodates using the SSL cert for other Azure…