Optimisations and checkpointing for spark streaming jobI currently work at HackerRank, we collect data points from various sources of our platform, enterprise and community(developers). We…Mar 15, 2021Mar 15, 2021
Spark Streaming MonitoringSpark Streaming is an extension of the core Spark API that enables scalable, high-throughput, fault-tolerant stream processing of live…Oct 8, 2020Oct 8, 2020
Publish/Subscribe (Pub/Sub) Pattern in BashWhen a Bash project turns into a library, it can become difficult to add new functionality. Function names, variables and parameters…Apr 14, 2019Apr 14, 2019
Pitfalls in BashWhitespaces when assigning variables Whitespace matters when assigning variables.Apr 14, 2019Apr 14, 2019
File execution sequence.bash_profile, .bash_login, .bashrc and .profile all do pretty much the same thing: set up and define functions, variables and the sorts.Apr 13, 2019Apr 13, 2019
Change Shell in Mac/LinuxFind the current shell: There are a few ways to determine the current shellApr 13, 2019Apr 13, 2019