I agree absolutely on analysing the residuals. In fact, this is obligatory when using linear regression in statistical inference. On the other hand, I think EDA on the explanatory variables is always useful, not for their correlations with the dependent variable (target), but to identify multi-collinearity among the explanatory variables themselves. Once identified, how you deal with it should ideally be guided by logic and domain expertise.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store