Thanks for the file, picturedrift.
Please no worries, I get often files without the assets, that happens often.
My suggestion, Cache the Object, use a Connection Object above the Hair, [as parent]. Then export as Alembic [abc]. For the Connect Object, perhaps uncheck the Weld option.
For a better collision performance, Hair> Attribute Manager> Dynamics> Advanced. Perhaps start with Steps 20 and Iteration 20. Not to forget the Hair> Dynamics> Properties, Radius;
Have an eye as well on the Collider Radius, perhaps add an extra Torus [to hide the effect of the radius, slightly different in size, to really catch all, just an idea. The problem is certain given that the Spline/guid is calculated, but the shape is different.
Since this is an example file, the values for your scene might vary.
Please note that your setting with the Hair>Guides Segments amount should work fine. It is all about the vertices that the segments create, not so much the spline that evaluated. If you had a long guide with only a few segments, chances are that it will collide are pretty large.
Here are some files:
The two EXha_01/_02 are examples with and without the Connector. The HAex_ files are the files that hopefully come closer to your needs.
My best wishes