Solving problems using time travel

Beryl @ Fifty

Tomas Robertson (team ACE-OL) & Simeon Simeonov (team Forecasts)

What is time travel???

Time travel - our ability to look at our input data at the state it was at a specific point in time (not only at its last state).

Time travel is achieved by adding the record_created_time column to our DB tables and storing Kafka's created_time value (converted to UTC).

The main concepts around how and why were presented by Peter Sandberg.

Solving problems

The following spike was observed 2021-10-06 around 10:15 CET @ NO4

Solving problems (cont)

No spikes shown in Grafana

Solving problems with time travel

            
              SELECT record_created_time, start_time, value
              FROM misc.app_odin_ace_ol_ba_10s_avro_v01
              WHERE bidding_area_name = 'NO4' AND start_time = '2021-10-06 08:14:10'
              ORDER BY record_created_time;