Repository navigation
[bug] Companies table and developers table have different data for the same period #51
Description
@lukaszgryglicki has regenerated our database as of ~15 minutes ago, so this data is as fresh as it comes.
The companies table reports the top 5 contributors to Istio in the last 12 months as:
| Rank | Company | Contributions |
|---|---|---|
| 1 | Google LLC | 12738 |
| 2 | Solo.io | 8402 |
| 3 | DaoCloud Network Technology Co. Ltd. | 8229 |
| 4 | International Business Machines Corporation | 7461 |
| 5 | Huawei Technologies Co. Ltd | 6593 |
However, if one exports the data from the Developer activity counts by company view for the same period, the summation is this:
| Rank | Company | Contributions |
|---|---|---|
| 1 | Google LLC | 12615 |
| 2 | Solo.io | 8605 |
| 3 | DaoCloud Network Technology Co. Ltd. | 7936 |
| 4 | International Business Machines Corporation | 7509 |
| 5 | Huawei Technologies Co. Ltd | 6605 |
Note how some companies show fewer contributions in the second list, and some have more.
Istio uses this data as part of its governance process, and last week, the order of the top 5 results shown here actually differed depending on which metric you used.
Can you help us understand why these values are different?
Activity
lukaszgryglicki commentedon Feb 1, 2024
This could be due to HLL (hyper log log) - I can change metrics (for Istio only) to use exact count distincts instead of approximate counts that HLL gives - but this will require creating custom SQLs just for Istio usage, can be done in a day or two, but not earlier than about week or two from now.
lukaszgryglicki commentedon May 7, 2024
Can you recheck and LMK if this is still needed? I've optimised some metrics recently and they no longer use HLL, so this might be Ok already. If not LMK, I'll iterate on this when I can.
craigbox commentedon May 16, 2024
Companies table:
Sum of developers table:
Closer, and current in the same order/ballpark.
(Edit: initial miscalculation around Google was my error.)
lukaszgryglicki commentedon May 16, 2024
I will TAL on Friday or Monday.
craigbox commentedon May 16, 2024
lukaszgryglicki commentedon May 17, 2024
Hmm the first link is giving sum of all contributions (this one) while another) is giving values per developer and you are summing them manually, right?
I'll check if both use HLL or doth don't use it - actually I will also update to use exact counts in case of Istio - because HLL was used to save cycles, but it makes more sense in
All CNCFinstance which has a lot of data, and here we can use justexactcounts approach 9asIstioisn't as huge asAll CNCFinstance) - let me dive into it - maybe query conditions are slightly different on those two dashboards too?lukaszgryglicki commentedon May 17, 2024
One was using HLL while another not, I will sync them now and regenerate data, then I'll let you know when finished.
Also pls note that all statistics across DevStats are not calculated "on the fly" but synced at a given point in time and saved in tables (so later Grafana UI does just a simple select to those "calculated" tables) - if calculation for "last year" happened on different tome for two metrics - they can be slightly out of sync, but the difference shouldn't be hight - after this manual sync that I'll do now - they should be as close to each other as possible.
lukaszgryglicki commentedon May 17, 2024
I've regenerated data, I don't have a script to sum all developers to check those value, PTAL again pls. Hope this is OK now.
Arunodoy18 commentedon Nov 25, 2025
Hi, i am gonna love solving this issue.
.take-issue
lukaszgryglicki commentedon Nov 26, 2025
Sure, go ahead.