Shredding JSON columns gave Logfire up to 1000x faster queries

Automated excerpt

OpenTelemetry data (the data that Logfire ingests) is semi-structured data. This is the layout detailed above (attributes: Utf8View (JSON)). This query needs to scan the entire attributes JSON column since my_llm_response is not shredded.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.