White Rabbit, BuTiS, Clocks and Time

Introduction

With respect to time stamps and clock distribution, two things should not be mixed up.
  1. The General Machine Timing System provides the following.
    1. A distributed 125 MHz clock via the Ethernet carrier of White Rabbit, see ingredients of White Rabbit.
    2. Timing Receivers also synthesize the 100kHz T0 and 200MHz c2 clocks of BuTiS (at reduced quality compared to BuTiS).
    3. UTC time stamps are available at the timing receivers
    4. Time stamps and clock signals will have an accuracy in the low nanosecond range and a jitter in the picosecond range.
    5. Timing receiver boards are available in several form factors (PCIe, PMC, AMC and other) and of moderate price.
  2. The Bunch Timing System BuTiS provides the following.
    1. Clock trains (T0: 100kHz ident pulse, C2: 200 MHz sine) that are phase locked over the whole campus.
    2. BuTiS does not provide time stamps.
    3. An accuray of about 100 picoseconds per kilometer and a jitter in the low femtosecond range is achieved.
    4. BuTiS hardware is available but a complete BuTiS receiver station is significantly more expensive than timing receivers of the GMT.

BuTiS

For high-precision synchronization beyond the parameters of the GMT (e.g. distributed rf- and kicker-control, bunch-to-bucket transfers, time-of-flight measurements) a Bunch Timing System (BuTiS) will distribute high precision clock trains (100 kHz ident pulse, 10 MHz sine). A propagation delay compensation is achieved by the use of a local reference synthesizer whose internal reference oscillator is phase locked to the distributed 10 MHz sine. A phase-locked 200 MHz clock is generated inside as well as the delayed ident pulse. The phase of the 200 MHz sine-wave clock is precisely adjustable in 1 degree steps (approx 14 picoseconds). Adjustments can be done locally or via ethernet data connection. The phase shift data is derived from the propagation delay measurement system residing at the BuTiS center. An accuracy of about 100 picosends per kilometer and a jitter in the low femtosecond range is achieved.

timeSystem butisLink.JPG
Figure: An overview on BuTiS and the GMT. A GPSDO serves as reference clock for BuTiS and the GMT.

A combination of a GPS Disciplined Oscillator (GPSDO) receiver and dedicated reference synthesizers is used to create a 10 MHz S1 sine. The S1 signal has a perfect long-term stability combined with a relative short-term (seconds) stability of about 10e-12. In addition, a 100 kHz ident pulse P0 is produced. Both signals S1 and P0 are sent to optical receivers (DWDM) over long distances. The bi-directional optical link allows measuring the link delays precisely. At the BuTiS center, correction data are calculated for each optical link and distributed via an Ethernet network (grey arrows) to so called local reference synthesizers (Ref. Synth.). Short copper links are used to transmit local clocks LP0 and LS1 from the optical receiver the reference synthesizer. At the reference synthesizer, a delay corrected C2 200 MHz sine and T0 100 kHz ident clocks are generated. Both clocks do not only have the same quality as the clocks provided at the BuTiS center but their phase is moreover locked and adjustable relative to the master clock at the BuTiS center. For more information on the reference synthesizer, please have a look here.

More information on BuTiS is given here.

BuTiS and GMT Clock Alignment

The clock master shown in the figure above is basically a White Rabbit switch. As reference clock input, it uses the physically same GPSDO as BuTiS. controlSystemClocksWithoutSCUBackplane.jpg
Figure: Alignment of BuTiS and White Rabbit clocks.

The figure above shows the alignment of BuTiS and White Rabbit clocks. The rising edges of the White Rabbit generated PPS pulse, 10 MHz clock and 125 MHz clock are aligned. All FAIR Timing Receivers (FTRN) are able to generate BuTiS-like clocks such as T0' and c2' (not shown). By appropriate adjustments in the GPSDO as well as the BuTiS center, the rising edges of the BuTiS T0 and FTRN T0' clocks are are aligned with a skew better than 1 ns. This allows for an unambiguous identification of individual BuTiS c2 clock cycles.

GMT: White Rabbit Based Clocks and Timestamps

Clocks
The generic clock of the timing system is the 125 MHz system clock of White Rabbit. The following gives an overview on clocks that could be connected to output pins.
  • Defined (almost) by configuration
    • 125 MHz clock
    • PPS pulse
    • clocks with a period of 16 ns
  • Defined by synthesis, availability not guaranteed
    • clocks with a period of 1 ns,
    • example: BuTiS 200 MHz clock
  • Special case, defined by synthesis, availability unlikely
    • other clocks
Important: A timing receiver can only generate clocks, that have a defined relationship to the White Rabbit clock.

Time Stamps
Time stamps distribution is an intrinsic property of White Rabbit. On all timing receivers, time stamps can be read from a couple of Wishbone devices:
  • PPS Generator
  • Time Stamp Latch Unit
  • ECA Unit

-- DietrichBeck - 8 Nov 2018
Topic revision: r17 - 07 Nov 2018, DietrichBeck
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback