flytekitplugins.spark.SparkDataFrameSchemaReader#

class flytekitplugins.spark.SparkDataFrameSchemaReader(from_path, cols, fmt)#

Implements how SparkDataFrame should be read using the open method of FlyteSchema

Methods

Parameters:
all(**kwargs)#
Return type:

DataFrame

iter(**kwargs)#
Return type:

Generator[T, None, None]

Attributes

column_names
from_path