Is the problem from the CPU or the Graphic card?

Yes it is most definitely the power supply. If you cannot give it adequate juice, it will not function properly. And even if you have enough open plugs, you need to be sure that your PSU is putting out enough wattage.