OWOX BI uses the at-least-once delivery concept to ensure collecting all events you send to our endpoint. It means in some cases it may be duplicates of events with the same 'owox.event_id'. Typically, the share of these events is less than 0.1%.
Best effort de-duplication
Thus, if you operate with data in tables like 'events_intraday_YYYYMMDD', we recommend adding a specific condition to your SQL query to exclude duplicates.
Example:
WITH unique_events_intraday_table AS (
SELECT
* EXCEPT(row_number)
FROM (
SELECT
*,
ROW_NUMBER() OVER (PARTITION BY owox.event_id) row_number
FROM
EVENTS_INTRADAY_TABLE
)
WHERE
row_number = 1
)
SELECT
*
FROM
unique_events_intraday_table
0 Comments