When you have another spot there, look up and underneath the gutter directly above. I will bet the wood and gutter are both dripp zones. The water is probably going behind the gutter from the roof every morning as the "dew" comes off the roof. It may be minimal, but that asbestose type siding does not absorb any water, it just stays on the surface.
Let us know what happens.