WordPress admin is not designed to scale. If you are managing some resource which is 100x more than the average site, you need to be prepared to either develop your own solution to admin it or learn to live with it.
In the case of widgets you should try the customizer or the accessibility mode of the widget screen (the link to it is hidden in the “screen options”)