pyspark.sql.streaming.StreamingQuery.lastProgress#
- property StreamingQuery.lastProgress#
Returns the most recent
StreamingQueryProgressupdate of this streaming query or None if there were no progress updatesNew in version 2.1.0.
Changed in version 3.5.0: Supports Spark Connect.
- Returns
- dict, optional
The most recent
StreamingQueryProgressupdate of this streaming query or None if there were no progress updates.
Examples
>>> sdf = spark.readStream.format("rate").load() >>> sq = sdf.writeStream.format('memory').queryName('this_query').start()
Get the most recent query progress updates for this query
>>> sq.lastProgress >>> sq.stop()