I have a web development project using local install of Tomcat 7. I am trying to connect to SQL Server 2012 using Microsoft’s driver for jdbc (sqljdbc41.jar). The sqljdbc41.jar is in my application build path: and I am exporting it. Furthermore, in the Tomcat application directory lib folder I have also placed a copy of … Read more
assuming that a worker wants to send 4G of data to the driver, then having spark.driver.maxResultSize=1G, will cause the worker to send 4 messages (instead of 1 with unlimited spark.driver.maxResultSize). No. If estimated size of the data is larger than maxResultSize given job will be aborted. The goal here is to protect your application from driver loss, … Read more
Surprise surprise, rebooting solved the issue (I thought I had already tried that). The solution Robert Crovella mentioned in the comments may also be useful to someone else, since it’s pretty similar to what I did to solve the issue the first time I had it.