Which of the following commands could the data engineering team use to access sales in PySpark?

A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL.

Which of the following commands could the data engineering team use to access sales in PySpark?
A . SELECT * FROM sales
B . There is no way to share data between PySpark and SQL.
C . spark.sql("sales")
D . spark.delta.table("sales")
E . spark.table("sales")

Answer: E

Explanation:

https://spark.apache.org/docs/3.2.1/api/python/reference/api/pyspark.sql.SparkSession.table.html

Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments