May 23Consolidated list of papers on distributed database systems and parallel computing papers from Google ResearchMapReduce programming model fundamentally changed the data processing world. The MapReduce pattern may be older, but Google’s MapReduce seminal paper and the Hadoop open-source distribution enabled programmers to run analysis on large data sets without having expertise in distributed servers and cluster management. Google published many such papers over some…Google Research2 min read
May 196 simple things that you can do right now to get unstuck in your job and careerOnce in a while, we get stuck in our job and career. It doesn’t happen in a day but over some time. Work becomes monotonous, meaningless, with no sense of accomplishment, and neither engaging nor challenging. With no recognition and promotion, the salary hikes have no considerable impact on our…Personal Development3 min read
Feb 12How to change the habit of wanting to learn everything to achieve better results?What you want to be when you grow up, is the single most question that gets asked when we were a child. Last week I was reading a lesson in Hindi for my 4th grader ‘papa jab bacche the’ — ‘When dad was a kid’. Narrated from the perspective of…Learning5 min read
Feb 5A Systematic approach, tips, techniques, and best practices to enhance Apache Spark job performanceFollow a systematic approach to optimize spark job performance instead of randomly tuning different parameters and wasting an endless amount of time. A 5 step approach for tuning performance from quality assurance: Measure and capture the performance metrics before optimization. (Use Spark UI) Identify the highest bottleneck that can improve the performance (Use Spark UI to identify bottleneck is it…Apache Spark15 min read
Dec 9, 2021Three simple things you can do to ensure you make the best choice and emerge strong during ‘The Great Resignation’ Wave?The pandemic had created uncertainty in our lives. It has been a difficult period for everyone, and some of us are lucky to have our jobs intact. There was no predefined recipe to get through this uncertainty, and none of us prepared for this kind of event. We spent most…Great Resignation3 min read
Dec 4, 2021Why it is essential to have an external perspective in your decision-making process, and how to get a useful one?A critical aspect of quality decision-making is learning from experience. Our learnings are our internal views of the world and reality. But our learnings lead to unintentional biases and provide incorrect inputs to our decision-making process. …Decision Making6 min read
Nov 21, 20213 simple steps to achieve your goals any timeA simple 3 step approach to achieving your goals, a) clarify b) plan d) execute It’s the time of year when you are looking to set new resolutions. But mostly we don’t follow through. According to a psychology study out of 200 new year’s resolvers 77% maintained for 1 week…Personal Development4 min read
Nov 19, 2021Objectivity does not exist, just as the sun does not rise or set.There is no such thing as objectivity, just as there is no such thing as the sun rises in the east and sets in the west, in fact, the sun neither rises nor sets. — We all truly believe that “the sun rises in the east and sets in the west”. It’s obvious for us regardless of the place and time on earth this holds true and this is the most fundamental aspect for us human beings on earth. …Decision Making4 min read
Aug 24, 2021“How dumb I could be to not know this”, “I told you so”,” I didn’t see this coming”— how to avoid bias when learning from past decisions?We all made some of the below statements on our decisions or on someone else decision, after outcomes were known “I told you so” “I knew it” “I should have known this” “How dumb I could be to not know this” “I didn’t see this coming” An important aspect of…Decision Making4 min read
Aug 20, 2021Good decisions will always result in good outcomes, and I was wrong.Good decisions will always result in good outcomes, and I was wrong. First, I have long believed that good decisions will result in good outcomes, and I am wrong. Second, I believed it is simple to decide provided we have the necessary facts at a decent confidence level. I didn’t…Decision Making2 min read