Find some matching siding and remove enough of the existing stuff to weave in the replacements and not have it look like a patch.
If you can't find any matching then maybe there is small wall on the back of the house that is out of the way. Remove all the siding and use it patch hole and then reside entire small wall with new stuff.