That is indeed the ideal course of action. The other course, which is more pragmatic, is to continue and finish your course and get a good job in banking or some other sector while pursuing philosophy as a side dish. As you get steady on your feet economically, slowly replace the side dish as the main course menu of your life.
Affectionately,
Alok Da