Cacheing Issues

HI Everyone!

I have a super crappy Internet connection 1 mb down (as high as 3 on occasion) and .8 up.
I know nothing I do to/with KODI will change that so please don’t tell me about that.
I have advanced settings enabled,

<advancedsettings>
<network>
<buffermode>1</buffermode>
<readbufferfactor>99</readbufferfactor>
<cachemembuffersize>34359738368</cachemembuffersize>
</network>
</advancedsettings>

I know about the ram requirements,I’m on a Server/Workstation with a ton of ram. I rarely ever hit 50% usage.
Depending on the server, I can usually watch SD shows as a stream with out much issue.
Also depending on server some stream fill cache as your watching and some have to be paused to fill.
My issue seeing as I have Buffer all filesystems, both internet and local in Advanced settings is that not all streams cache.
out of a list of sources some cache others do not.
One other weird thing is some stream fine but no sound?
Can someone explain why KODI is not using cache for all streams also I don’t believe these to be live streams.
Really with out caching my viewing is more pain then pleasure.
I don’t mind starting a show and walking away well the cache fills.
TYIA for any insight to this.