This story was originally published on HackerNoon at:
https://hackernoon.com/i-built-an-open-source-firebase-analytics-alternative-because-i-hit-1m-eventsday-once-too-many.
After hitting Firebase Analytics 1M events/day cap during a mobile game softlaunch, I built an open-source self-hosted analytics pipeline. Here's how.
Check more stories related to data-science at:
https://hackernoon.com/c/data-science.
You can also check exclusive content about
#data-engineering,
#game-development,
#analytics-pipeline,
#self-hosted-analytics,
#event-streaming,
#event-tracking,
#product-analytics,
#firebase-analytics, and more.
This story was written by:
@rawbbit. Learn more about this writer by checking
@rawbbit's about page,
and for more stories, please visit
hackernoon.com.
A few years ago I was the data engineer on a mobile game soft launch when Firebase Analytics quietly started dropping events past its 1M/day cap. We didn't catch it for days. That experience pushed me to build Rawbbit — an open-source, Apache 2.0, self-hosted analytics pipeline that lands raw events as Parquet in your own object storage. This is the story of why hosted analytics fails at scale, why I chose NATS + Parquet + BigQuery external tables, and what I deliberately left out.