Welcome,
How old is the system? Is it possible that the CMOS battery is weak? That would explain whey all is well for short peeriods but start failing when the system is on for an extended peeriod.
Depending on the time server you are using you should never be more than a few [2 to 3] seconds off the master clock.
Keep us posted