Do this few things,
1 Clean hole with blade knife. Cut at an angle so the exterior of the hole is bigger than the interior.
2 Fill the hole with painter's putty.
3 Let it dry.
4 Spackle over the putty.
5 For medium holes, use a drywall metal patch.
6 Sand the surface smooth...