What is spark.driver.maxResultSize?

assuming that a worker wants to send 4G of data to the driver, then having spark.driver.maxResultSize=1G, will cause the worker to send 4 messages (instead of 1 with unlimited spark.driver.maxResultSize). No. If estimated size of the data is larger than maxResultSize given job will be aborted. The goal here is to protect your application from driver loss, … Read more

Environment variable to control java.io.tmpdir?

Hmmm — since this is handled by the JVM, I delved into the OpenJDK VM source code a little bit, thinking that maybe what’s done by OpenJDK mimics what’s done by Java 6 and prior. It isn’t reassuring that there’s a way to do this other than on Windows. On Windows, OpenJDK’s get_temp_directory() function makes a Win32 API … Read more

ssl_error_rx_record_too_long and Apache SSL [closed]

The link mentioned by Subimage was right on the money for me. It suggested changing the virtual host tag, ie, from <VirtualHost myserver.example.com:443> to <VirtualHost _default_:443> Error code: ssl_error_rx_record_too_long This usually means the implementation of SSL on your server is not correct. The error is usually caused by a server side problem which the server … Read more