Well, that's easily disproved. You're telling me that if I walk into any gym or YMCA in my town where they offer a yoga class, all I'll find are Hindus? QED.

Just because Yoga is a component of certain religions does not mean that everyone that chooses to practice Yoga is a follower of that religion. Religion is about belief and intent, not about physical movement.