The PWM Drive (pulse-width modulated drive) to motor power conductors are typically the most intense noise source in a system. Proper implementation of shielding, grounding, splicing, and treatment of excess cable is essential to reducing noise in your system.
A simple, experimental motor such as this is not capable of making much power. We can increase the turning force (or torque) that the motor can create in three ways: either we can have a more powerful permanent magnet, or we can increase the electric current flowing through the wire, or we can make the coil so it has many "turns" (loops) of very thin wire instead of one "turn" of thick wire. In practice, a motor also has the permanent magnet curved in a circular shape so it almost touches the coil of wire that rotates inside it. The closer together the magnet and the coil, the greater the force the motor can produce.
Think of the atoms of magnetic material as an unruly herd of cattle. Running electric current through the material will polarize these atoms, creating the magnetic field. But as I mentioned, this is an unruly herd, so it takes time for the current to bring all those atoms into formation.
One way to overcome this situation is by using "magnetically soft" material. Magnetically soft material has atoms that readily reverse polarity (a docile herd?) when exposed to alternating current. Naturally, since the reversing process happens more quickly, there is less wasted energy.