F. what is UDF; F. given a piece of pyspark code, what are the bugs, what can be improved.
Big Data Engineer Interview Questions
1,228 big data engineer interview questions shared by candidates
A couple of basic technology-related questions and then asked for the solution to their recent challenge.
Phone Screen: Basic behavioral questions. Nothing you wouldn't expect. On-site interview: Hadoop architecture Hive, Pig questions Speculative execution How to handle NameNode failure? Find second highest salary(SQL) Why Medidata? Where do you see yourself in 5 years? Discussed at length about the volunteer/social work experience from resume Bubble sort code Find pairs in an array whose sum is divisible by a certain number. Find number of occurrences of a character in a character array. How do you check the task ID of a process? How do you check if a service is installed in windows? What is MUTEX and semaphore? Was asked to answer a few Java questions on paper.(Most were basic questions) * What are web services? * What is Maven? Something about Maven targets was also asked. * What is the use of volatile keyword? * What are atomic classes in Java concurrency API? * Difference between final/finally/finalize * Name three design patterns
Spark Architecture and Optimization Techniques
Design LRU cache
Connect nodes of a binary tree at each levels
Search an element in the binary tree in a constant time
Python Sql
SQL query debugging, fairly easy if you know joins, aggregate functions etc
HDFS, HIVE, SPARK
Viewing 491 - 500 interview questions