Acccording to the Wizard of Odds, your expected return from hitting A-4 against 4,5,and 6 is .06, .09, and .12 respectively (rounded to the nearest hundredth.) In other words, on a $10 wager, if you played the hands many thousands of times, you'd average out to a profit of 6 cents, 9 cents, and 12 cents respectively for each time the hand is played.
On the other hand, if you double, your expectation is .06, .13, and .18. So that is why basic strategy calls for a double in that situation. Over time, it makes more money than hitting. In fact, doubling A-4 against a 6 is about 50% better over time than hitting.
I just realized that the numbers are very close on doubling A-4 against a 4 on this chart; and my rounding made them look exactly the same. The actual expectation is .0593 for hitting and .0584 for doubling (carrying the decimal out four places as the site does.) This would appear to me to be a mistake. Unless I am reading something wrong, you'd do slightly better by hitting against the four. This is probably an issue of something that is rule-specific, or specific to the number of decks in play.
This chart is at
http://wizardofodds.com/blackjack/bjapx1.html and is based on an infinite deck.