The English language has 100,000+ words. Most native speakers know less than 10% of them. You'll probably be less, not more, easily understood, if every time your instinct is to use "very", you replace it with a hyper-specific adjective or adverb. In most cases, all you'll achieve is snobbery.
TL;DR: keep calm and very on.