When writing streaming data, Spark’s structured stream supports the below write modes

When writing streaming data, Spark’s structured stream supports the below write modes
A . Append, Delta, Complete
B. Delta, Complete, Continuous
C. Append, Complete, Update
D. Complete, Incremental, Update
E. Append, overwrite, Continuous

View Answer

Answer: C

Explanation:

The answer is Append, Complete, Update

•Append mode (default) – This is the default mode, where only the new rows added to the Result Table since the last trigger will be outputted to the sink. This is supported for only those queries where rows added to the Result Table is never going to change. Hence, this mode guarantees that each row will be output only once (assuming fault-tolerant sink). For example, queries with only select, where, map, flatMap, filter, join, etc. will support Append mode.

• Complete mode – The whole Result Table will be outputted to the sink after every trigger.

This is supported for aggregation queries.

• Update mode – (Available since Spark 2.1.1) Only the rows in the Result Table that were updated since the last trigger will be outputted to the sink. More information to be added in future releases.