What do you want to save?
Add Code snippet
New code examples
-
Other 2021-09-07 09:55:02
What are optimization technique in spark or what optimization you have done during your spark project .
>>>df = spark.createDataFrame( [('1', 'true'),('2', 'false'), ('1', 'true'),('2', 'false'), ('1', 'true'),('2', 'false'), ('1', 'true'),('2', 'false'), ('1', 'true'),('2', 'false'), ])>>> df.rdd.getNumPartitions()8#Now... Add solution