In fact, Fannie Mae and Freddie Mac are now the leading sources of non-conventional loans, thereby making the process of buying a home a lot easier for more people – but not necessarily cheaper. The interest rates on these loans are much higher than rates on conventional mortgages.