"GaussianProcess" (Machine Learning Method)

Details & Suboptions

  • The "GaussianProcess" method assumes that the function to be modeled has been generated from a Gaussian process. The Gaussian process is defined by its covariance function (also called kernel). In the training phase, the method will estimate the parameters of this covariance function. The Gaussian process is then conditioned on the training data and used to infer the value of a new example using a Bayesian inference.
  • The following options can be given:
  • AssumeDeterministicFalsewhether or not the function should be assumed to be deterministic
    "CovarianceType"Automaticthe covariance type to use
    "EstimationMethod""MaximumPosterior"the method to infer the values
    "OptimizationMethod"Automaticthe optimization method to estimate parameters
  • Possible settings for "CovarianceType" include:
  • "SquaredExponential"exponential kernel
    "HammingDistance"exponential kernel for nominal variables
    "Periodic"periodic kernel
    "RationalQuadratic"rational quadratic kernel
    "Linear"linear kernel
    "Matern5/2"Matérn kernel with exponent 5/2
    "Matern3/2"Matérn kernel with exponent 3/2
    "Composite"a composition of the previous kernels
    assocspecify a different kernel for each feature type
  • In Method{"GaussianProcess", "CovarianceType"assoc}, assoc needs to be of the form <|"Numerical" kernel1,"Nominal"kernel2|>.
  • Possible settings for "EstimationMethod" include:
  • "MaximumPosterior"maximize the posterior distribution
    "MaximumLikelihood"maximize the likelihood
    "MeanPosterior"mean of the posterior distribution
  • Possible settings for "OptimizationMethod" include:
  • "SimulatedAnnealing"uses simulated annealing to find the minimum
    "FindMinimum"uses FindMinimum to find the minimum


open all close all

Basic Examples  (2)

Train a classifier function on labeled examples:

Click for copyable input

Obtain information about the predictor:

Click for copyable input

Predict a new example:

Click for copyable input

Train a predictor on labeled examples:

Click for copyable input

Compare the data with the predicted values and look at the standard deviation:

Click for copyable input

Options  (4)