Operations like .filter() or .select() don’t execute immediately. Spark builds a logical plan.
Operations like .count() or .show() trigger the actual computation. Big Data Analytics: A Hands-On Approach
Try loading a 1GB dataset as a CSV and then as a Parquet file in Spark. You’ll see an immediate difference in load times and memory usage. 3. Processing: Thinking in Transformations Operations like