Mathematics is a very essential tool to use in Physics . But if you have only passion for Physics , you might be able to go well with Physics for Class 9 and Class 10 without worrying about Mathematics.  But the basic Mathematics which is taught in Class 9 and Class 10 is very crucial for higher classes . So it is advised that you should study Mathematics too along with Physics.