To be sure, the overall number of millionaires rose, by 0.8 percent. But the higher you go on the wealth scale, the more that people felt the economic downturn. Worldwide, people with more than $30 million in investable assets saw their wealth decline by 4.9 percent. The raw number of people with $30 million or more declined by 2.5 percent.