No, the others at the table don't cause you any disadvantage. There are players who are superstitious about playing with what they preceive to be "bad players". They feel that their bad decisions foul up the flow of the cards. This, however, is just nonsense and ignorance. Other people's decisions, good or bad, will help you as often as they hurt you, on average. So in and of itself, playing with idiots doesn't hurt your chances of winning.
On the other hand, if it gets under your skin somehow, or throws off your attitude or concentration to be with the other players, then you might be better off playing by yourself. That has nothing to do with their decisions. It has to do with your reaction to their decisions.
One other factor to consider is the speed of the game. If you have more people at the table, especially idiots, the game will be slower. Some people prefer the game slower, others faster.
But you should decide where to play based on your own comfort with the other players and the speed of the game, not based on the other players causing a disadvantage for you with bad play.