Data Profiling Isn't Optional: What We Check Before You Build a Workflow
The report that looked right
The most dangerous data quality problems aren't the ones that crash a query — they're the ones that quietly produce a plausible-looking wrong number. A "unique customer ID" column with duplicates. A "signup date" column that's 30% null. A report can run cleanly and still be wrong.
What we check, and when
DataQloo profiles a dataset automatically at two points. First, in the Import Wizard, before you commit to saving a new dataset — you see each column's fill rate, unique value count, null percentage, and an average or top value, so problems are visible before anything is built on top of them. Second, in every workflow's Profile tab — a richer version of the same idea, including min/max/average/median and a distribution for numeric columns, or top-value bars for categorical ones.
What profiling doesn't do
This is descriptive profiling, computed from the data you're actually looking at — it's not a rules engine. DataQloo doesn't (yet) let you define an assertion like "this column must never be null" and get alerted when it's violated on a schedule; there's no scheduled monitoring at all today, since scheduled runs aren't built yet either. What exists is a fast, automatic sanity check at the two points where you're most likely to make a decision based on the data: importing it, and building on it.
A habit worth keeping
Even with tooling, the fastest data quality check is still asking "does this fill rate look right for this column" before you trust the number downstream.
Related reading
PostgreSQL Data Types, and How DataQloo Infers Them
A column's declared PostgreSQL type is only half the story. Here's how DataQloo's Schema tab infers the more useful, semantic type underneath.
PostgreSQL vs. MySQL for Analytical Workflows
Both are solid relational databases. Here's how they actually differ for the kind of filtering and aggregation work a visual workflow tool does.
"Coming Soon" Means Coming Soon: Why Our Roadmap Is Public
Every unfinished feature on this site is labeled, not hidden. Here's why we built it that way from the start.
Get new posts by email
Engineering notes and product updates from the DataQloo team, occasionally.