.csv

Search services

Search tools and open pages quickly

Inzichten · 6 min lezen

IoT and telemetry sample CSVs: device IDs, timestamps, and gaps

Engineers often snapshot device telemetry as CSV before Parquet or time-series stores. Here is how to read bursts, missing readings, and clock skew in flat files.

Gepubliceerd op 19 maart 2025 · Table

Firmware and gateway teams dump sample windows to CSV for support tickets and algorithm tuning. Rows usually include device ID, sensor channel, timestamp, and reading. Real-world files mix UTC and local time, duplicate samples, and null placeholders that are not true numeric gaps.

What to inspect

  • Timestamp format and timezone: ISO-8601 with offset is safest.
  • Device ID cardinality versus row count to spot accidental cartesian explosions from joins.
  • Sentinel values like -999 that mean offline instead of measurement.
  • Gap detection by sorting on time per device and eyeballing jumps larger than the expected sampling interval.

Table for ad hoc slices

Paste or load a CSV slice into Table, sort by timestamp, filter to one device ID, and scroll without standing up a notebook. Export a cleaned subset once outliers are removed.

← Alle artikelen

Gebruikt door toonaangevende teams

Logo's in een rij (elk opent de merksite in een nieuw tabblad): Google, Apple, Meta, GitHub, Stripe, Shopify, Databricks, Snowflake, Notion, Vercel, Intel, NVIDIA, Netflix, Spotify, Airbnb, Yale, Harvard University, Massachusetts Institute of Technology, Stanford University, University of California, Berkeley, Princeton University, California Institute of Technology, Columbia University, University of Chicago, Cornell University, Duke University, Carnegie Mellon University, Georgia Institute of Technology, Johns Hopkins University, Northwestern University, University of Toronto, McGill University, University of Oxford, University of Cambridge, Imperial College London, University College London, ETH Zurich, EPFL, Technical University of Munich, Sorbonne University, KU Leuven, National University of Singapore, Nanyang Technological University, Tsinghua University, Peking University, The University of Tokyo, KAIST, Seoul National University, University of Melbourne, Australian National University, University of Sydney, The University of Hong Kong.