HUD offers several programs through the FHA that require down payments of as little as 3 percent. Veterans can get loans from the VA to buy, build, or improve a home, as well as refinance an existing loan at interest rates that are usually lower than those on conventional loans.