Dev Weekly · Diagram Design

Spark 与 Snowpark Python 执行模型

Spark and Snowpark execution modelsSpark runs distributed tasks on a Spark cluster over external data sources; Snowpark sends a DataFrame plan to Snowflake for execution in a virtual warehouse.SAME DATAFRAME STYLE · DIFFERENT EXECUTION OWNERApache Spark / PySparkPython clientBuild DataFrame planSpark DriverOptimize / scheduleExecutor clusterTasksTasksTasksPartitions · Shuffle · Executor resourcesSnowpark PythonPython clientBuild Snowpark planSnowflake SQLOptimize / executeVirtual WarehouseComputeComputeComputeWarehouse sizing · Query History · Snowflake governance

Diagram is provided as standalone SVG for embedding and this HTML page for full-size viewing.