pyspark.sql.datasource.DataSourceWriter#

class pyspark.sql.datasource.DataSourceWriter[source]#

A base class for data source writers. Data source writers are responsible for saving the data to the data source.

Methods

abort(messages)

Aborts this writing job due to task failures.

commit(messages)

Commits this writing job with a list of commit messages.

write(iterator)

Writes data into the data source.