From 29c52d98bf7feb132a1857cce2058ec7134e4b0f Mon Sep 17 00:00:00 2001 From: Simeon Simeonov Date: Wed, 26 Jan 2022 18:46:50 +0100 Subject: Add postgresql_tuning.html python.html timetravel.html and update sqlalchemy.html and demo.html --- reveal.js/timetravel.html | 127 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 127 insertions(+) create mode 100644 reveal.js/timetravel.html (limited to 'reveal.js/timetravel.html') diff --git a/reveal.js/timetravel.html b/reveal.js/timetravel.html new file mode 100644 index 0000000..e073f92 --- /dev/null +++ b/reveal.js/timetravel.html @@ -0,0 +1,127 @@ + + + + + Solving problems using time travel + + + + + + + + + + + + + + + +
+ + +
+ +
+

Solving problems using time travel

+

Beryl @ Fifty

+
+

Tomas Robertson (team ACE-OL) & Simeon Simeonov (team Forecasts)

+
+ + +
+

What is time travel???

+
+

Time travel - our ability to look at our input data at the state it was at a specific point in time (not only at its last state).

+

Time travel is achieved by adding the record_created_time column to our DB tables and storing Kafka's created_time value (converted to UTC).

+
+

The main concepts around how and why were presented by Peter Sandberg.

+
+ +
+

Solving problems

+
+

The following spike was observed 2021-10-06 around 10:15 CET @ NO4

+ +
+ +
+

Solving problems (cont)

+
+

No spikes shown in Grafana

+ +
+ +
+

Solving problems with time travel

+
+
+            
+              SELECT record_created_time, start_time, value
+              FROM misc.app_odin_ace_ol_ba_10s_avro_v01
+              WHERE bidding_area_name = 'NO4' AND start_time = '2021-10-06 08:14:10'
+              ORDER BY record_created_time;
+            
+          
+ + + + + + + + + + + + + + + + + + + + + + + + + + +
record_created_timestart_timevalue
2021-10-06 08:15:52.2582021-10-06 08:14:10-370.37683609008127
2021-10-06 08:19:06.2222021-10-06 08:14:1025.183745117193457
2021-10-06 08:21:56.2072021-10-06 08:14:1034.78731922151518
+
+ +
+

Q & A

+
+ +
+
+ + + + + + + + + + + -- cgit v1.3