The Fed may already be too late in hiking interest rates — which is bad news for these borrowers