The access to our API for logging services will change from 2020/01/03. Currently we are storring 200,000,000 records per index which is fine for most customers, since it can hold from a couple of months to a couple of weeks of records, the record size though can be as little as 8 hours for an increasing amount of customers.
For this reason we are increasing our records to 2,500,000,000 per index, we expect the new record size to hold over 96 hours of logs for all clients and over 1.5 years for slow log ones (note that records older than 24 months get purged automatically, unless a custom limit is set).
Why does this matter?
Due to the way you access our logs, you have faster access to the indice that you activate for queries (including the current open indice), this means that any of your queries will not need to do much if any disk I/O making them instant. From our own metrics we see that over 90% of the daily queries are run on the last 48 hours of accrued data, thus making access faster for you and minimizing the computational load on our servers.
Wednesday, November 20, 2019
