timekeeping: Cap adjustments so they don't exceede the maxadj value
RFC PATCH 1/1 timekeeping: Cap adjustments so they don't exceede the maxadj value
Thus its been occasionally noted that users have seen confusing warnings like:
Adjusting tsc more than 11% (5941981 vs 7759439)
We try to limit the maximum total adjustment to 11% (10% tick adjustment + 0.5% frequency adjustment). But this is done by bounding the requested adjustment values, and the internal steering that is done by tracking the error from what was requested and what was applied, does not have any such limits.
This is usually not problematic, but in some cases has a risk that an adjustment could cause the clocksource mult value to overflow, so its an indication things are outside of what is expected.
It ends up most of the reports of this 11% warning are on systems using chrony, which utilizes the adjtimex() ADJ_TICK interface (which allows a +-10% adjustment). The original ratonal for ADJ_TICK unlcear to me but my assumption it was originally added to allow broken systems to get a big constant correction at boot (see adjtimex userspace package for an example) which would allow the system to work w/ ntpd's 0.5% adjustment limit.
Chrony uses ADJ_TICK to make very aggressive short term corrections (usually right at startup). Which push us close enough to the max bound that a few late ticks can cause the internal steering to push past the max adjust value (tripping the warning).
Thus this patch adds some extra logic to enforce the max adjustment cap in the internal steering.
Note: This has the potential to slow corrections when the ADJ_TICK value is furthest away from the default value. So it would be good to get some testing from folks using Chrony, to make sure we don't cause any troubles there.
--- kernel/time/timekeeping.c | 25 +++++++++++++++++++++---- 1 file changed, 21 insertions(+), 4 deletions(-)
kernel/time/timekeeping.c +21 -4
@@ -1593,7 +1593,7 @@ static __always_inline void timekeeping_freqadjust(struct timekeeper *tk,s64 xinterval = tk->xtime_interval;s64 tick_error;bool negative; -u32 adj; +u32 adj_scale;/* Remove any current error adj from freq calculation */ if (tk->ntp_err_mult)
@@ -1612,13 +1612,30 @@ static __always_inline void timekeeping_freqadjust(struct timekeeper *tk,/* preserve the direction of correction */ negative = (tick_error <0 ); -/* Sort out the magnitude of the correction */ +/* +* Sort out the magnitude of the correction, but +* avoid making so large a correction that we go +* over the max adjustment. +*/ + adj_scale =0 ; tick_error =abs (tick_error); -for (adj =0 ; tick_error > interval; adj++) +while (tick_error > interval) { +u32 base = tk->tkr_mono.clock->mult; +u32 max = tk->tkr_mono.clock->maxadj; +u32 cur_adj = tk->tkr_mono.mult; +u32 adj =1 << (adj_scale +1 ); + +if (negative && (cur_adj - adj) < (base - max)) +break ; +if (!negative && (cur_adj + adj) > (base + max)) +break ; + + adj_scale++; tick_error >>=1 ; + }/* scale the corrections */ -timekeeping_apply_adjustment (tk, offset, negative, adj); +timekeeping_apply_adjustment (tk, offset, negative, adj_scale); }/*
Signature · 1 line
1.9.1
Miroslav Lichvar
reviewerQuoted 4 lines · John Stultz
Thus its been occasionally noted that users have seen confusing warnings like:
Adjusting tsc more than 11% (5941981 vs 7759439)
Thanks for looking into this, John.
Quoted 7 lines
Thus this patch adds some extra logic to enforce the max adjustment cap in the internal steering.
Note: This has the potential to slow corrections when the
ADJ_TICKvalue is furthest away from the default value. So it would be good to get some testing from folks using Chrony, to make sure we don't cause any troubles there.
I ran few tests with chronyd, forcing it to make the largest possible adjustment of the tick and it seems to work fine.
However, I'm still able to trigger the warning by feeding a large offset to the NTP PLL using a short time constant. When the multiplier is already at the maximum and it wants to move it even further, there should be no timekeeping_apply_adjustment() call as it always adjusts the multiplier at least by one.
Quoted 21 lines
kernel/time/timekeeping.c +15
-2+ adj_scale =0 ; tick_error =abs (tick_error); -for (adj =0 ; tick_error > interval; adj++) +while (tick_error > interval) { +u32 base = tk->tkr_mono.clock->mult; +u32 max = tk->tkr_mono.clock->maxadj; +u32 cur_adj = tk->tkr_mono.mult; +u32 adj =1 << (adj_scale +1 ); + +if (negative && (cur_adj - adj) < (base - max)) +break ; +if (!negative && (cur_adj + adj) > (base + max)) +break ; + + adj_scale++; tick_error >>=1 ; + }/* scale the corrections */ -timekeeping_apply_adjustment (tk, offset, negative, adj); +timekeeping_apply_adjustment (tk, offset, negative, adj_scale);
Signature · 1 line
Miroslav Lichvar
Quoted 16 lines · Miroslav Lichvar
Quoted 4 lines · John Stultz
Thus its been occasionally noted that users have seen confusing warnings like:
Adjusting tsc more than 11% (5941981 vs 7759439)Thanks for looking into this, John.
Quoted 7 lines
Thus this patch adds some extra logic to enforce the max adjustment cap in the internal steering.
Note: This has the potential to slow corrections when the
ADJ_TICKvalue is furthest away from the default value. So it would be good to get some testing from folks using Chrony, to make sure we don't cause any troubles there.
Quoted 8 lines
I ran few tests with chronyd, forcing it to make the largest possible adjustment of the tick and it seems to work fine.
However, I'm still able to trigger the warning by feeding a large offset to the NTP PLL using a short time constant. When the multiplier is already at the maximum and it wants to move it even further, there should be no
timekeeping_apply_adjustment()call as it always adjusts the multiplier at least by one.
Ack. Thanks for noticing this. I could reproduce it and have a fix. Will send an update out later.
thanks
-john