What are the different types of slowly changing dimensions?
Sr Data Engineer Interview Questions
2,599 sr data engineer interview questions shared by candidates
Implement scalable topK words for Amazon product descriptions using count-min sketch.
Questions are mostly on optimization and product sense
About project design and implementation
A: They asked me to walk through a real-world Spark use case I’d implemented—building a streaming ETL for clickstream data—detailing how I managed stateful windowed aggregations, tuned `spark.sql.shuffle.partitions`, and fixed data skew with a custom partitioner.
What are your experiences in data engineering?
"They asked me to design an end-to-end data pipeline that supports both batch and real-time processing using tools like Kafka, Spark, and a cloud platform like AWS or Azure. They were particularly interested in how I’d handle schema evolution and ensure data quality at each stage."
What is your background in Python, AWS, and Glue?
Implement iterator which take 3 iterator as Input and sort it out.
Explain the differences between a analytics modeling and transactional modeling
Viewing 2061 - 2070 interview questions