---
title: "Ingesting Billions of Events: How Heap Scaled Data Pipelines"
url: https://stacklist.com/card/976e4802-1a99-45f1-8430-1f517925a7ae
source_url: "https://www.codestory.co/episodes/s4-e7-ingesting-billions-of-events-how-heap-scaled-real-time-data-pipelines-with-dan-robinson/"
stack: https://stacklist.com/c/podcast/stack/fec60e9c-742b-444c-add8-c9302a96c479
summary: "Code Story podcast episode S4 E7 features Dan Robinson discussing how Heap scaled real-time data pipelines to ingest billions of events, born from frustrations at Facebook and Palantir with getting basic analytics answers. The episode covers Dan's journey from aspiring mathematician at Stanford to co-building Heap, an analytics platform designed to make product usage data more accessible."
tags: "data-pipelines, startup, podcast, heap, real-time-data, scaling, technical-founders"
key_entities: "Dan Robinson (person), Noah Labhart (person), Heap (organization), Facebook (organization), Palantir (organization), Stanford (organization), real-time data pipelines (concept), event ingestion (concept), Boston (location), Code Story (organization)"
classification: "transcript"
content_hash: "sha256:bd8bb5a7e907e389f8c7dc79f05702ae21fcbfd0172b8cc47f3dd7e8b21c55dd"
acp_version: "0.2"
token_counts_approximate: 618
visibility: public
agent_accessible: true
status: "final"
---

# Ingesting Billions of Events: How Heap Scaled Data Pipelines

Code Story | Startup Podcast for Technical Founders — S4 E7: Ingesting Billions of Events: How Heap Scaled Real-Time Data Pipelines with Dan Robinson Press Play to Listen While You Browse S4 E7: Ingesting Billions of Events: How Heap Scaled Real-Time Data Pipelines with Dan Robinson Code Story | Startup Podcast for Technical Founders 0:00 39:55 1× At 18 years old, Dan Robinson was 100% convinced that he was going to be a mathematician. He went to college at Stanford, and when he got there, he realized that math beyond high school was very different.. and as such, he didn't want to make that his day job. He always enjoyed making stuff, specifically with computers, and he started leaning into computer science and deep learning projects. He loves to hike, and be outside with his friends. Recently, he has gotten addicted to chess online - though he claims he's not any good at it. So addicted, that he had to have his close friend hold onto his account password for him. Dan is originally from Boston, which is his excuse for being direct and difficult to work with. In fact, he finds it so strange that people don't interrupt others more in the bay area. Previously, the CEO of Dan's current venture was a PM at Facebook - and he couldn't get basic answers to how people used the platform. Similar problems were popping up for Dan at Palantir, causing long cycles just to get a single question answered. They both were thinking - there HAS to be a better way. This is the creation story of Heap. Sponsors Podcorn Unidragon Links Website: https://heap.io/ LinkedIn: https://www.linkedin.com/in/dan-robinson-a6930726/ Leave us a review on Apple Podcasts Amazing tools we use: If you want the best publishing platform for your podcast, with amazing support & people - use Transistor.fm Want to record your remote interviews with class? Then, you need to use Squadcast . Code Story uses the 1-click product ClipGain , sign up now to get 3hrs of podcast processing time FREE Credits: Code Story is hosted and produced by Noah Labhart. Be sure to subscribe on Apple Podcasts , Spotify , Pocket Casts , Google Play , Breaker , Youtube , or the podcasting app of your choice. Checkout our episode stacks on Stacklist! https://stacks.codestory.co/ Hosted by Noah Labhart | Technical Founder & Startup Mentor. Advertising Inquiries: https://redcircle.com/brands Privacy & Opt-Out: https://redcircle.com/privacy Latest Season of the Podcast is Sponsored By