Skip to content

meta-issue: frameless-ml #215

Description

@atamborrino

Meta-issue to list what has been done in frameless-ml and what remains to be done.

Spark ML docs: https://spark.apache.org/docs/latest/ml-guide.html

Abstractions

  • TypedTransformer, the type-safe equivalent of Spark ML Transformer
  • TypedEstimator, the type-safe equivalent of Spark ML Estimator
  • TypedPipeline, the type-safe equivalent of Spark ML Pipeline
  • TypedEvaluator, the type-safe equivalent of Spark ML Evaluator

Typed transformers

  • TF-IDF
  • Word2Vec
  • CountVectorizer
  • Tokenizer
  • StopWordsRemover
  • nn-gram
  • Binarizer
  • PCA
  • PolynomialExpansion
  • Discrete Cosine Transform (DCT)
  • StringIndexer
  • IndexToString
  • OneHotEncoder
  • VectorIndexer
  • Interaction
  • Normalizer
  • StandardScaler
  • MinMaxScaler
  • MaxAbsScaler
  • Bucketizer
  • ElementwiseProduct
  • SQLTransformer
  • VectorAssembler
  • QuantileDiscretizer
  • Imputer
  • Feature Selectors
  • VectorSlicer
  • RFormula
  • ChiSqSelector
  • Locality Sensitive Hashing
  • LSH Operations
  • Approximate Similarity Join
  • Approximate Nearest Neighbor Search
  • LSH Algorithms
  • Bucketed Random Projection for Euclidean Distance
  • MinHash for Jaccard Distance

Typed estimators

  • Binomial logistic regression
  • Multinomial logistic regression
  • Decision tree classifier
  • Random forest classifier
  • Gradient-boosted tree classifier
  • Multilayer perceptron classifier
  • Linear Support Vector Machine
  • One-vs-Rest classifier (a.k.a. One-vs-All)
  • Naive Bayes
  • Linear regression
  • Generalized linear regression
  • Available families
  • Decision tree regression
  • Random forest regression
  • Gradient-boosted tree regression
  • Survival regression
  • Isotonic regression
  • K-means
  • Latent Dirichlet allocation (LDA)
  • Bisecting k-means
  • Gaussian Mixture Model (GMM)
  • ALS
  • FP-Growth
  • CrossValidator
  • TrainValidationSplit

Typed evaluators

  • RegressionEvaluator
  • BinaryClassificationEvaluator
  • MulticlassClassificationEvaluator

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions