[FLINK-31010] Add Transformer and Estimator for GBTClassifier and GBTRegressor - #210

Open

Fanoid wants to merge 47 commits into

apache:masterfrom

Fanoid:FLINK-31010

Commits on Aug 9, 2023

Add preprocess for GBT algorithms
Fanoid
committed
cde4b9c
Add training and prediction
Fanoid
committed
7d561c3
Support checkpoint for operator states
Fanoid
committed
ee76f33
Add GBTClassifier
Fanoid
committed
69e0774
Add GBTRegressor
Fanoid
committed
2c43fa6
Fixing some missing Javadoc comment.
Fanoid
committed
2fe1f72
[NO MERGE] Ad-hoc fix of KBinsDiscretizer
Fanoid
committed
dbe0009
Fix tests according to ad-hoc fix of KBinsDiscretizer.
Fanoid
committed
638ebee
Change LocalState datastream to JVM static memory
Fanoid
committed
34797f0
Change features storage in BinnedInstance
Fanoid
committed
4a76eda
[NO MERGE] Ignore GBT operators to pass Python completeness tests.
Fanoid
committed
4b97064
Improve feature splitter.
Fanoid
committed
c7156a4
Improve hist builder when no feature subsampling.
Fanoid
committed
5525b85
Add optimized serializer for double arrays.
Fanoid
committed
8932392
Fixed checkpoint problem.
Fanoid
committed
74fb657
Rewrite shared storage.
Fanoid
committed
99061bc
Replace inputCols and featuresCol with featuresCols.
Fanoid
committed
ad8d4a7
Fix cases when reading a shared item earlier than its initialization.
Fanoid
committed
b0309e4
Improve GBT params.
Fanoid
committed
9d3f10f
Remove unused HasLossType.
Fanoid
committed
1f592eb
Improve loss func.
Fanoid
committed
bd79176
Refactor params, BoostingStrategy, and Distributor.
Fanoid
committed
fdaa732
Remove GBTRunnerTest.
Fanoid
committed
f236703
Only call ListStateWithCache#update just before snapshot.
Fanoid
committed
b21a23b
Refine some TODOs.
Fanoid
committed
768820a
Improve javadoc for GBTClassifier and GBTRegressor.
Fanoid
committed
132cca8
Improve categorical feature splitter by ignoring less frequent categories.
Fanoid
committed
546591e
Change PredGradHess to double[].
Fanoid
committed
5562e80
Improve Histogram to remove scattering.
Fanoid
committed
01c4211
Add eclipse collection jars to uber jar
Fanoid
committed
7f73aa1
Support output feature importance
Fanoid
committed
075262d
Update setModelData to support featureImportanceTable.
Fanoid
committed
28cdd28
Remove duplicated model data
Fanoid
committed
bc6465d
Fix save/load for feature importance.
Fanoid
committed
d4f1dd5
Fix get label when type is not double.
Fanoid
committed
d8c71fc
Reduce computation for nodes with max depth.
Fanoid
committed
adf3115
[NO MERGE] Ad-hoc fix for NaN values in KBinsDiscretizer
Fanoid
committed
a105e35
Fix out-of-bound exception for nodeFeaturePairs
Fanoid
committed
1006812
Change to streaming processing from histogram building to global splitting
Fanoid
committed
ad646c4
Simplify APIs in SharedStorageContext
Fanoid
committed
513ed96
Fix after merging master
Fanoid
committed
e709a35
Fix SharedStorageUtilsTest
Fanoid
committed
c109c76
Rename shared storage to shared objects and change according to comments
Fanoid
committed
5313d51
Update codes according to comments.
Fanoid
committed
e098994
Refactor share objects infra to resolve challenges.
Fanoid
committed
233b885
Remove unused files.
Fanoid
committed
4db52f3

Commits on Aug 15, 2023

Fix imports.
Fanoid
committed
0109bb8