What does the at-least-once delivery principle mean while collecting events?

NEW documentation: This article covers setup for OWOX BI. For the latest guides on setting up FREE connectors and Data Marts, visit the new OWOX Data Marts documentation.

OWOX BI uses the at-least-once delivery concept to ensure collecting all events you send to our endpoint. It means in some cases it may be duplicates of events with the same 'owox.event_id'. Typically, the share of these events is less than 0.1%.

Best effort de-duplication

Thus, if you operate with data in tables like 'events_intraday_YYYYMMDD', we recommend adding a specific condition to your SQL query to exclude duplicates.

Example:

WITH unique_events_intraday_table AS (
  SELECT
    * EXCEPT(row_number)
  FROM (
    SELECT
      *,
      ROW_NUMBER() OVER (PARTITION BY owox.event_id) row_number
    FROM
      EVENTS_INTRADAY_TABLE
  )
  WHERE
    row_number = 1
)
SELECT
  *
FROM
  unique_events_intraday_table