Performance benchmarking b/w AWS EC2 and GCP VMs for start-stopBenchmark time to start and stop instanceMar 22Mar 22
Optimisations and checkpointing for spark streaming jobI currently work at HackerRank, we collect data points from various sources of our platform, enterprise and community(developers). We…Mar 15, 2021Mar 15, 2021
Spark Streaming MonitoringSpark Streaming is an extension of the core Spark API that enables scalable, high-throughput, fault-tolerant stream processing of live…Oct 8, 2020Oct 8, 2020
Publish/Subscribe (Pub/Sub) Pattern in BashWhen a Bash project turns into a library, it can become difficult to add new functionality. Function names, variables and parameters…Apr 14, 2019Apr 14, 2019
Pitfalls in BashWhitespaces when assigning variables Whitespace matters when assigning variables.Apr 14, 2019Apr 14, 2019