Counting cards is a sure way to increase that bankroll. With $50,000, $25-300 spread and Pennsylvania rules playing an average of 5 hours a day (with 30 days a year off), one can make $100,000 a year with a .8% risk of ruin. Or make $50,000 a year with half as much play. That's enough to make card counting a full time job.
If you have a $50,000 bankroll and want to earn the same as the average long term stock portfolio (10% a year), you'd only need to play 90 hours a year. You could easily spend more than 90 hours a year trying to figure out which stocks to buy and sell. With that little amount of time spent playing, heat will be minimal. Card counting only has variance as a risk factor, it isn't tied to the economy since there will always be casinos. In 10 years, you would have doubled your initial investment. When your bankroll grows, you can raise your stakes and earn more residual tax-free income. It doesn't matter if you lose money in a given year, since you'll make it back in the long run. It's similar to a stock portfolio losing value one year, then gaining its value back.
In fact, the return will be slightly higher because the money will earn interest while it's sitting in your savings account since you won't have all $50,000 in cash with you. I would rather not invest in stocks and use that money to play blackjack. 100 hours of blackjack a year for several decades will be more fun and more rewarding than trading stocks 100 hours a year (I would consider the time spent reading The Wall Street Journal, watching CNBC, and worrying about your stock portfolio as time spent trading. Plus at those stakes you'd get some nice comps.