You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge?
DataFusion doesn't have a great statistics infrastructure, which will be long project to fix. Luckily, we have begun the process to implement an extensible statistics infrastructure, and we have already merged a new low-level framework to evaluate expressions in a probabilistic context (i.e. the evaluate_statistics and propagate_statistics API introduced in #14699). The next step in this project is to switch from the old Precision object to the new Distribution object across the DataFusion codebase. This way, we will be able to use the existing mechanism around the ColumnStatistics and Statistics (maybe we should rename this to TableStatistics?) objects to handle statistics.
Describe the solution you'd like
Deprecating/removing Precision, updating its usages with Distribution.
Describe alternatives you've considered
N/A.
Additional context
No response
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem or challenge?
DataFusion doesn't have a great statistics infrastructure, which will be long project to fix. Luckily, we have begun the process to implement an extensible statistics infrastructure, and we have already merged a new low-level framework to evaluate expressions in a probabilistic context (i.e. the
evaluate_statistics
andpropagate_statistics
API introduced in #14699). The next step in this project is to switch from the oldPrecision
object to the newDistribution
object across the DataFusion codebase. This way, we will be able to use the existing mechanism around theColumnStatistics
andStatistics
(maybe we should rename this toTableStatistics
?) objects to handle statistics.Describe the solution you'd like
Deprecating/removing
Precision
, updating its usages withDistribution
.Describe alternatives you've considered
N/A.
Additional context
No response
The text was updated successfully, but these errors were encountered: