Java GradientNormalization类代码示例

OStack程序员社区-中国程序员成长平台 › 门户 › 编程› Java›Java编程经验

原作者: [db:作者] 来自: [db:来源] 收藏邀请

本文整理汇总了Java中org.deeplearning4j.nn.conf.GradientNormalization类的典型用法代码示例。如果您正苦于以下问题：Java GradientNormalization类的具体用法？Java GradientNormalization怎么用？Java GradientNormalization使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。

GradientNormalization类属于org.deeplearning4j.nn.conf包，在下文中一共展示了GradientNormalization类的20个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: softMaxRegression

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
private static MultiLayerNetwork softMaxRegression(int seed,
		int iterations, int numRows, int numColumns, int outputNum) {
	MultiLayerConfiguration conf = new NeuralNetConfiguration.Builder()
			.seed(seed)
			.gradientNormalization(
					GradientNormalization.ClipElementWiseAbsoluteValue)
			.gradientNormalizationThreshold(1.0)
			.iterations(iterations)
			.momentum(0.5)
			.momentumAfter(Collections.singletonMap(3, 0.9))
			.optimizationAlgo(OptimizationAlgorithm.CONJUGATE_GRADIENT)
			.list(1)
			.layer(0,
					new OutputLayer.Builder(
							LossFunction.NEGATIVELOGLIKELIHOOD)
							.activation("softmax")
							.nIn(numColumns * numRows).nOut(outputNum)
							.build()).pretrain(true).backprop(false)
			.build();

	MultiLayerNetwork model = new MultiLayerNetwork(conf);

	return model;
}

开发者ID:PacktPublishing，项目名称:Machine-Learning-End-to-Endguide-for-Java-developers，代码行数:25，代码来源:NeuralNetworks.java

示例2: getConfiguration

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Override
   protected MultiLayerConfiguration getConfiguration()
   {
return new NeuralNetConfiguration.Builder().seed(parameters.getSeed())
	.gradientNormalization(GradientNormalization.ClipElementWiseAbsoluteValue)
	.gradientNormalizationThreshold(1.0).iterations(parameters.getIterations()).momentum(0.5)
	.momentumAfter(Collections.singletonMap(3, 0.9))
	.optimizationAlgo(OptimizationAlgorithm.CONJUGATE_GRADIENT).list(4)
	.layer(0,
		new AutoEncoder.Builder().nIn(parameters.getInputSize()).nOut(500).weightInit(WeightInit.XAVIER)
			.lossFunction(LossFunction.RMSE_XENT).corruptionLevel(0.3).build())
	.layer(1, new AutoEncoder.Builder().nIn(500).nOut(250).weightInit(WeightInit.XAVIER)
		.lossFunction(LossFunction.RMSE_XENT).corruptionLevel(0.3)

		.build())
	.layer(2,
		new AutoEncoder.Builder().nIn(250).nOut(200).weightInit(WeightInit.XAVIER)
			.lossFunction(LossFunction.RMSE_XENT).corruptionLevel(0.3).build())
	.layer(3, new OutputLayer.Builder(LossFunction.NEGATIVELOGLIKELIHOOD).activation("softmax").nIn(200)
		.nOut(parameters.getOutputSize()).build())
	.pretrain(true).backprop(false).build();
   }

开发者ID:amrabed，项目名称:DL4J，代码行数:23，代码来源:StackedAutoEncoderModel.java

示例3: getConfiguration

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Override
   protected MultiLayerConfiguration getConfiguration()
   {
final ConvulationalNetParameters parameters = (ConvulationalNetParameters) this.parameters;
final MultiLayerConfiguration.Builder builder = new NeuralNetConfiguration.Builder().seed(parameters.getSeed())
	.iterations(parameters.getIterations())
	.gradientNormalization(GradientNormalization.RenormalizeL2PerLayer)
	.optimizationAlgo(OptimizationAlgorithm.STOCHASTIC_GRADIENT_DESCENT).list(3)
	.layer(0,
		new ConvolutionLayer.Builder(10, 10).stride(2, 2).nIn(parameters.getChannels()).nOut(6)
			.weightInit(WeightInit.XAVIER).activation("relu").build())
	.layer(1, new SubsamplingLayer.Builder(SubsamplingLayer.PoolingType.MAX, new int[] { 2, 2 }).build())
	.layer(2, new OutputLayer.Builder(LossFunctions.LossFunction.NEGATIVELOGLIKELIHOOD)
		.nOut(parameters.getOutputSize()).weightInit(WeightInit.XAVIER).activation("softmax").build())
	.backprop(true).pretrain(false);

new ConvolutionLayerSetup(builder, parameters.getRows(), parameters.getColumns(), parameters.getChannels());

return builder.build();
   }

开发者ID:amrabed，项目名称:DL4J，代码行数:21，代码来源:ConvolutionalNetModel.java

示例4: method

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@OptionMetadata(
  displayName = "gradient normalization method",
  description = "The gradient normalization method (default = None).",
  commandLineParamName = "gradientNormalization",
  commandLineParamSynopsis = "-gradientNormalization <specification>",
  displayOrder = 22
)
public GradientNormalization getGradientNormalization() {
  return this.gradientNormalization;
}

开发者ID:Waikato，项目名称:wekaDeeplearning4j，代码行数:11，代码来源:NeuralNetConfiguration.java

示例5: testImdbClassification

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void testImdbClassification() throws Exception {

  // Init data
  data = DatasetLoader.loadImdb();

  // Define layers
  LSTM lstm1 = new LSTM();
  lstm1.setNOut(3);
  lstm1.setActivationFunction(new ActivationTanH());

  RnnOutputLayer rnnOut = new RnnOutputLayer();

  // Network config
  NeuralNetConfiguration nnc = new NeuralNetConfiguration();
  nnc.setL2(1e-5);
  nnc.setUseRegularization(true);
  nnc.setGradientNormalization(GradientNormalization.ClipElementWiseAbsoluteValue);
  nnc.setGradientNormalizationThreshold(1.0);
  nnc.setLearningRate(0.02);

  // Config classifier
  clf.setLayers(lstm1, rnnOut);
  clf.setNeuralNetConfiguration(nnc);
  clf.settBPTTbackwardLength(20);
  clf.settBPTTforwardLength(20);
  clf.setQueueSize(0);

  // Randomize data
  data.randomize(new Random(42));

  // Reduce datasize
  RemovePercentage rp = new RemovePercentage();
  rp.setPercentage(95);
  rp.setInputFormat(data);
  data = Filter.useFilter(data, rp);

  TestUtil.holdout(clf, data, 50, tii);
}

开发者ID:Waikato，项目名称:wekaDeeplearning4j，代码行数:40，代码来源:RnnSequenceClassifierTest.java

示例6: testAngerRegression

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void testAngerRegression() throws Exception {
  // Define layers
  LSTM lstm1 = new LSTM();
  lstm1.setNOut(32);
  lstm1.setActivationFunction(new ActivationTanH());

  RnnOutputLayer rnnOut = new RnnOutputLayer();
  rnnOut.setLossFn(new LossMSE());
  rnnOut.setActivationFunction(new ActivationIdentity());

  // Network config
  NeuralNetConfiguration nnc = new NeuralNetConfiguration();
  nnc.setL2(1e-5);
  nnc.setUseRegularization(true);
  nnc.setGradientNormalization(GradientNormalization.ClipElementWiseAbsoluteValue);
  nnc.setGradientNormalizationThreshold(1.0);
  nnc.setLearningRate(0.02);

  tii.setTruncateLength(80);
  // Config classifier
  clf.setLayers(lstm1, rnnOut);
  clf.setNeuralNetConfiguration(nnc);
  clf.settBPTTbackwardLength(20);
  clf.settBPTTforwardLength(20);
  //    clf.setQueueSize(4);
  clf.setNumEpochs(3);
  final EpochListener l = new EpochListener();
  l.setN(1);
  clf.setIterationListener(l);
  data = DatasetLoader.loadAnger();
  // Randomize data
  data.randomize(new Random(42));
  TestUtil.holdout(clf, data, 33);
}

开发者ID:Waikato，项目名称:wekaDeeplearning4j，代码行数:36，代码来源:RnnSequenceClassifierTest.java

示例7: getModel

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
public static MultiLayerNetwork getModel(int numInputs) {
    MultiLayerConfiguration conf =  new NeuralNetConfiguration.Builder()
            .seed(seed)
            .iterations(iterations)
            .gradientNormalization(GradientNormalization.ClipElementWiseAbsoluteValue)
            .gradientNormalizationThreshold(1.0)
            .regularization(true)
            .dropOut(Config.DROPOUT)
            .updater(Config.UPDATER)
            .adamMeanDecay(0.5)
            .adamVarDecay(0.5)
            .weightInit(WeightInit.XAVIER)
            .optimizationAlgo(OptimizationAlgorithm.STOCHASTIC_GRADIENT_DESCENT)
            .list()
            .layer(0, new RBM.Builder(RBM.HiddenUnit.BINARY, RBM.VisibleUnit.GAUSSIAN)
                    .nIn(numInputs).nOut(2750).dropOut(0.75)
                    .activation(Activation.RELU).build())
            .layer(1, new RBM.Builder(RBM.HiddenUnit.BINARY, RBM.VisibleUnit.BINARY)
                    .nIn(2750).nOut(2000)
                    .activation(Activation.RELU).build())
            .layer(2, new RBM.Builder(RBM.HiddenUnit.BINARY, RBM.VisibleUnit.BINARY)
                    .nIn(2000).nOut(1000)
                    .activation(Activation.RELU).build())
            .layer(3, new RBM.Builder(RBM.HiddenUnit.BINARY, RBM.VisibleUnit.BINARY)
                    .nIn(1000).nOut(200)
                    .activation(Activation.RELU).build())
            .layer(4, new OutputLayer.Builder(Config.LOSS_FUNCTION)
                    .nIn(200).nOut(Config.NUM_OUTPUTS).updater(Config.UPDATER)
                    .adamMeanDecay(0.6).adamVarDecay(0.7)
                    .build())
            .pretrain(true).backprop(true)
            .build();
    return new MultiLayerNetwork(conf);
}

开发者ID:madeleine789，项目名称:dl4j-apr，代码行数:35，代码来源:DBN.java

示例8: resetLayerDefaultConfig

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
/**
 * Reset the learning related configs of the layer to default. When instantiated with a global neural network configuration
 * the parameters specified in the neural network configuration will be used.
 * For internal use with the transfer learning API. Users should not have to call this method directly.
 */
public void resetLayerDefaultConfig() {
    //clear the learning related params for all layers in the origConf and set to defaults
    this.setIUpdater(null);
    this.setWeightInit(null);
    this.setBiasInit(Double.NaN);
    this.setDist(null);
    this.setL1(Double.NaN);
    this.setL2(Double.NaN);
    this.setGradientNormalization(GradientNormalization.None);
    this.setGradientNormalizationThreshold(1.0);
    this.iUpdater = null;
    this.biasUpdater = null;
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:19，代码来源:BaseLayer.java

示例9: regressionTestLSTM1

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void regressionTestLSTM1() throws Exception {

    File f = new ClassPathResource("regression_testing/080/080_ModelSerializer_Regression_LSTM_1.zip")
                    .getTempFileFromArchive();

    MultiLayerNetwork net = ModelSerializer.restoreMultiLayerNetwork(f, true);

    MultiLayerConfiguration conf = net.getLayerWiseConfigurations();
    assertEquals(3, conf.getConfs().size());

    assertTrue(conf.isBackprop());
    assertFalse(conf.isPretrain());

    GravesLSTM l0 = (GravesLSTM) conf.getConf(0).getLayer();
    assertTrue(l0.getActivationFn() instanceof ActivationTanH);
    assertEquals(3, l0.getNIn());
    assertEquals(4, l0.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l0.getGradientNormalization());
    assertEquals(1.5, l0.getGradientNormalizationThreshold(), 1e-5);

    GravesBidirectionalLSTM l1 = (GravesBidirectionalLSTM) conf.getConf(1).getLayer();
    assertTrue(l1.getActivationFn() instanceof ActivationSoftSign);
    assertEquals(4, l1.getNIn());
    assertEquals(4, l1.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l1.getGradientNormalization());
    assertEquals(1.5, l1.getGradientNormalizationThreshold(), 1e-5);

    RnnOutputLayer l2 = (RnnOutputLayer) conf.getConf(2).getLayer();
    assertEquals(4, l2.getNIn());
    assertEquals(5, l2.getNOut());
    assertTrue(l2.getActivationFn() instanceof ActivationSoftmax);
    assertTrue(l2.getLossFn() instanceof LossMCXENT);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:35，代码来源:RegressionTest080.java

示例10: regressionTestCGLSTM1

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void regressionTestCGLSTM1() throws Exception {

    File f = new ClassPathResource("regression_testing/080/080_ModelSerializer_Regression_CG_LSTM_1.zip")
                    .getTempFileFromArchive();

    ComputationGraph net = ModelSerializer.restoreComputationGraph(f, true);

    ComputationGraphConfiguration conf = net.getConfiguration();
    assertEquals(3, conf.getVertices().size());

    assertTrue(conf.isBackprop());
    assertFalse(conf.isPretrain());

    GravesLSTM l0 = (GravesLSTM) ((LayerVertex) conf.getVertices().get("0")).getLayerConf().getLayer();
    assertTrue(l0.getActivationFn() instanceof ActivationTanH);
    assertEquals(3, l0.getNIn());
    assertEquals(4, l0.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l0.getGradientNormalization());
    assertEquals(1.5, l0.getGradientNormalizationThreshold(), 1e-5);

    GravesBidirectionalLSTM l1 =
                    (GravesBidirectionalLSTM) ((LayerVertex) conf.getVertices().get("1")).getLayerConf().getLayer();
    assertTrue(l1.getActivationFn() instanceof ActivationSoftSign);
    assertEquals(4, l1.getNIn());
    assertEquals(4, l1.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l1.getGradientNormalization());
    assertEquals(1.5, l1.getGradientNormalizationThreshold(), 1e-5);

    RnnOutputLayer l2 = (RnnOutputLayer) ((LayerVertex) conf.getVertices().get("2")).getLayerConf().getLayer();
    assertEquals(4, l2.getNIn());
    assertEquals(5, l2.getNOut());
    assertTrue(l2.getActivationFn() instanceof ActivationSoftmax);
    assertTrue(l2.getLossFn() instanceof LossMCXENT);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:36，代码来源:RegressionTest080.java

示例11: regressionTestLSTM1

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void regressionTestLSTM1() throws Exception {

    File f = new ClassPathResource("regression_testing/071/071_ModelSerializer_Regression_LSTM_1.zip")
                    .getTempFileFromArchive();

    MultiLayerNetwork net = ModelSerializer.restoreMultiLayerNetwork(f, true);

    MultiLayerConfiguration conf = net.getLayerWiseConfigurations();
    assertEquals(3, conf.getConfs().size());

    assertTrue(conf.isBackprop());
    assertFalse(conf.isPretrain());

    GravesLSTM l0 = (GravesLSTM) conf.getConf(0).getLayer();
    assertEquals("tanh", l0.getActivationFn().toString());
    assertEquals(3, l0.getNIn());
    assertEquals(4, l0.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l0.getGradientNormalization());
    assertEquals(1.5, l0.getGradientNormalizationThreshold(), 1e-5);

    GravesBidirectionalLSTM l1 = (GravesBidirectionalLSTM) conf.getConf(1).getLayer();
    assertEquals("softsign", l1.getActivationFn().toString());
    assertEquals(4, l1.getNIn());
    assertEquals(4, l1.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l1.getGradientNormalization());
    assertEquals(1.5, l1.getGradientNormalizationThreshold(), 1e-5);

    RnnOutputLayer l2 = (RnnOutputLayer) conf.getConf(2).getLayer();
    assertEquals(4, l2.getNIn());
    assertEquals(5, l2.getNOut());
    assertEquals("softmax", l2.getActivationFn().toString());
    assertTrue(l2.getLossFn() instanceof LossMCXENT);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:35，代码来源:RegressionTest071.java

示例12: regressionTestCGLSTM1

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void regressionTestCGLSTM1() throws Exception {

    File f = new ClassPathResource("regression_testing/071/071_ModelSerializer_Regression_CG_LSTM_1.zip")
                    .getTempFileFromArchive();

    ComputationGraph net = ModelSerializer.restoreComputationGraph(f, true);

    ComputationGraphConfiguration conf = net.getConfiguration();
    assertEquals(3, conf.getVertices().size());

    assertTrue(conf.isBackprop());
    assertFalse(conf.isPretrain());

    GravesLSTM l0 = (GravesLSTM) ((LayerVertex) conf.getVertices().get("0")).getLayerConf().getLayer();
    assertEquals("tanh", l0.getActivationFn().toString());
    assertEquals(3, l0.getNIn());
    assertEquals(4, l0.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l0.getGradientNormalization());
    assertEquals(1.5, l0.getGradientNormalizationThreshold(), 1e-5);

    GravesBidirectionalLSTM l1 =
                    (GravesBidirectionalLSTM) ((LayerVertex) conf.getVertices().get("1")).getLayerConf().getLayer();
    assertEquals("softsign", l1.getActivationFn().toString());
    assertEquals(4, l1.getNIn());
    assertEquals(4, l1.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l1.getGradientNormalization());
    assertEquals(1.5, l1.getGradientNormalizationThreshold(), 1e-5);

    RnnOutputLayer l2 = (RnnOutputLayer) ((LayerVertex) conf.getVertices().get("2")).getLayerConf().getLayer();
    assertEquals(4, l2.getNIn());
    assertEquals(5, l2.getNOut());
    assertEquals("softmax", l2.getActivationFn().toString());
    assertTrue(l2.getLossFn() instanceof LossMCXENT);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:36，代码来源:RegressionTest071.java

示例13: regressionTestLSTM1

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void regressionTestLSTM1() throws Exception {

    File f = new ClassPathResource("regression_testing/060/060_ModelSerializer_Regression_LSTM_1.zip")
                    .getTempFileFromArchive();

    MultiLayerNetwork net = ModelSerializer.restoreMultiLayerNetwork(f, true);

    MultiLayerConfiguration conf = net.getLayerWiseConfigurations();
    assertEquals(3, conf.getConfs().size());

    assertTrue(conf.isBackprop());
    assertFalse(conf.isPretrain());

    GravesLSTM l0 = (GravesLSTM) conf.getConf(0).getLayer();
    assertEquals("tanh", l0.getActivationFn().toString());
    assertEquals(3, l0.getNIn());
    assertEquals(4, l0.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l0.getGradientNormalization());
    assertEquals(1.5, l0.getGradientNormalizationThreshold(), 1e-5);

    GravesBidirectionalLSTM l1 = (GravesBidirectionalLSTM) conf.getConf(1).getLayer();
    assertEquals("softsign", l1.getActivationFn().toString());
    assertEquals(4, l1.getNIn());
    assertEquals(4, l1.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l1.getGradientNormalization());
    assertEquals(1.5, l1.getGradientNormalizationThreshold(), 1e-5);

    RnnOutputLayer l2 = (RnnOutputLayer) conf.getConf(2).getLayer();
    assertEquals(4, l2.getNIn());
    assertEquals(5, l2.getNOut());
    assertEquals("softmax", l2.getActivationFn().toString());
    assertTrue(l2.getLossFn() instanceof LossMCXENT);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:35，代码来源:RegressionTest060.java

示例14: regressionTestCGLSTM1

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void regressionTestCGLSTM1() throws Exception {

    File f = new ClassPathResource("regression_testing/060/060_ModelSerializer_Regression_CG_LSTM_1.zip")
                    .getTempFileFromArchive();

    ComputationGraph net = ModelSerializer.restoreComputationGraph(f, true);

    ComputationGraphConfiguration conf = net.getConfiguration();
    assertEquals(3, conf.getVertices().size());

    assertTrue(conf.isBackprop());
    assertFalse(conf.isPretrain());

    GravesLSTM l0 = (GravesLSTM) ((LayerVertex) conf.getVertices().get("0")).getLayerConf().getLayer();
    assertEquals("tanh", l0.getActivationFn().toString());
    assertEquals(3, l0.getNIn());
    assertEquals(4, l0.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l0.getGradientNormalization());
    assertEquals(1.5, l0.getGradientNormalizationThreshold(), 1e-5);

    GravesBidirectionalLSTM l1 =
                    (GravesBidirectionalLSTM) ((LayerVertex) conf.getVertices().get("1")).getLayerConf().getLayer();
    assertEquals("softsign", l1.getActivationFn().toString());
    assertEquals(4, l1.getNIn());
    assertEquals(4, l1.getNOut());
    assertEquals(GradientNormalization.ClipElementWiseAbsoluteValue, l1.getGradientNormalization());
    assertEquals(1.5, l1.getGradientNormalizationThreshold(), 1e-5);

    RnnOutputLayer l2 = (RnnOutputLayer) ((LayerVertex) conf.getVertices().get("2")).getLayerConf().getLayer();
    assertEquals(4, l2.getNIn());
    assertEquals(5, l2.getNOut());
    assertEquals("softmax", l2.getActivationFn().toString());
    assertTrue(l2.getLossFn() instanceof LossMCXENT);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:36，代码来源:RegressionTest060.java

示例15: doBefore

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Before
public void doBefore() {
    NeuralNetConfiguration conf = new NeuralNetConfiguration.Builder()
                    .gradientNormalization(GradientNormalization.RenormalizeL2PerLayer).seed(123)
                    .layer(new LocalResponseNormalization.Builder().k(2).n(5).alpha(1e-4).beta(0.75).build())
                    .build();

    layer = new LocalResponseNormalization().instantiate(conf, null, 0, null, false);
    activationsActual = layer.activate(x);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:11，代码来源:LocalResponseTest.java

示例16: testRegularization

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void testRegularization() {
    // Confirm a structure with regularization true will not throw an error

    NeuralNetConfiguration conf = new NeuralNetConfiguration.Builder()
                    .gradientNormalization(GradientNormalization.RenormalizeL2PerLayer).l1(0.2)
                    .l2(0.1).seed(123)
                    .layer(new LocalResponseNormalization.Builder().k(2).n(5).alpha(1e-4).beta(0.75).build())
                    .build();
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:11，代码来源:LocalResponseTest.java

示例17: getUpsampling1DLayer

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
private Layer getUpsampling1DLayer() {
    NeuralNetConfiguration conf = new NeuralNetConfiguration.Builder()
                    .gradientNormalization(GradientNormalization.RenormalizeL2PerLayer).seed(123)
                    .layer(new Upsampling1D.Builder(size).build()).build();
    return conf.getLayer().instantiate(conf, null, 0,
            null, true);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:8，代码来源:Upsampling1DTest.java

示例18: getSubsamplingLayer

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
private Layer getSubsamplingLayer(SubsamplingLayer.PoolingType pooling) {
    NeuralNetConfiguration conf = new NeuralNetConfiguration.Builder()
                    .gradientNormalization(GradientNormalization.RenormalizeL2PerLayer).seed(123)
                    .layer(new SubsamplingLayer.Builder(pooling, new int[] {2, 2}).build()).build();

    return conf.getLayer().instantiate(conf, null, 0, null, true);
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:8，代码来源:SubsamplingLayerTest.java

示例19: testLfwModel

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
@Test
public void testLfwModel() throws Exception {
    final int numRows = 28;
    final int numColumns = 28;
    int numChannels = 3;
    int outputNum = LFWLoader.NUM_LABELS;
    int numSamples = LFWLoader.NUM_IMAGES;
    int batchSize = 2;
    int seed = 123;
    int listenerFreq = 1;

    LFWDataSetIterator lfw = new LFWDataSetIterator(batchSize, numSamples,
                    new int[] {numRows, numColumns, numChannels}, outputNum, false, true, 1.0, new Random(seed));

    MultiLayerConfiguration.Builder builder = new NeuralNetConfiguration.Builder().seed(seed)
                    .gradientNormalization(GradientNormalization.RenormalizeL2PerLayer)
                    .optimizationAlgo(OptimizationAlgorithm.STOCHASTIC_GRADIENT_DESCENT).list()
                    .layer(0, new ConvolutionLayer.Builder(5, 5).nIn(numChannels).nOut(6)
                                    .weightInit(WeightInit.XAVIER).activation(Activation.RELU).build())
                    .layer(1, new SubsamplingLayer.Builder(SubsamplingLayer.PoolingType.MAX, new int[] {2, 2})
                                    .stride(1, 1).build())
                    .layer(2, new OutputLayer.Builder(LossFunctions.LossFunction.NEGATIVELOGLIKELIHOOD)
                                    .nOut(outputNum).weightInit(WeightInit.XAVIER).activation(Activation.SOFTMAX)
                                    .build())
                    .setInputType(InputType.convolutionalFlat(numRows, numColumns, numChannels)).backprop(true)
                    .pretrain(false);

    MultiLayerNetwork model = new MultiLayerNetwork(builder.build());
    model.init();

    model.setListeners(new ScoreIterationListener(listenerFreq));

    model.fit(lfw.next());

    DataSet dataTest = lfw.next();
    INDArray output = model.output(dataTest.getFeatureMatrix());
    Evaluation eval = new Evaluation(outputNum);
    eval.eval(dataTest.getLabels(), output);
    System.out.println(eval.stats());
}

开发者ID:deeplearning4j，项目名称:deeplearning4j，代码行数:41，代码来源:DataSetIteratorTest.java

示例20: deepBeliefNetwork

import org.deeplearning4j.nn.conf.GradientNormalization; //导入依赖的package包/类
private static MultiLayerNetwork deepBeliefNetwork(int seed,
		int iterations, int numRows, int numColumns, int outputNum) {
	MultiLayerConfiguration conf = new NeuralNetConfiguration.Builder()
			.seed(seed)
			.gradientNormalization(
					GradientNormalization.ClipElementWiseAbsoluteValue)
			.gradientNormalizationThreshold(1.0)
			.iterations(iterations)
			.momentum(0.5)
			.momentumAfter(Collections.singletonMap(3, 0.9))
			.optimizationAlgo(OptimizationAlgorithm.CONJUGATE_GRADIENT)
			.list(4)
			.layer(0,
					new RBM.Builder().nIn(numRows * numColumns).nOut(500)
							.weightInit(WeightInit.XAVIER)
							.lossFunction(LossFunction.RMSE_XENT)
							.visibleUnit(RBM.VisibleUnit.BINARY)
							.hiddenUnit(RBM.HiddenUnit.BINARY).build())
			.layer(1,
					new RBM.Builder().nIn(500).nOut(250)
							.weightInit(WeightInit.XAVIER)
							.lossFunction(LossFunction.RMSE_XENT)
							.visibleUnit(RBM.VisibleUnit.BINARY)
							.hiddenUnit(RBM.HiddenUnit.BINARY).build())
			.layer(2,
					new RBM.Builder().nIn(250).nOut(200)
							.weightInit(WeightInit.XAVIER)
							.lossFunction(LossFunction.RMSE_XENT)
							.visibleUnit(RBM.VisibleUnit.BINARY)
							.hiddenUnit(RBM.HiddenUnit.BINARY).build())
			.layer(3,
					new OutputLayer.Builder(
							LossFunction.NEGATIVELOGLIKELIHOOD)
							.activation("softmax").nIn(200).nOut(outputNum)
							.build()).pretrain(true).backprop(false)
			.build();

	MultiLayerNetwork model = new MultiLayerNetwork(conf);

	return model;
}

开发者ID:PacktPublishing，项目名称:Machine-Learning-End-to-Endguide-for-Java-developers，代码行数:42，代码来源:NeuralNetworks.java

注：本文中的org.deeplearning4j.nn.conf.GradientNormalization类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。

鲜花

握手

雷人

路过

鸡蛋

该文章已有0人参与评论

请发表评论

全部评论

专题导读

More+

10-27 六六分期app的软件客服如何联系？(六六分期

11-06 可心卡盟:win10系统火狐flash插件崩溃怎么

11-06 亲亲特价:怎么删除回收站图标

11-06 济南大学虚拟社区:鲁大师节能降温的具体办

11-06 xlueops.exe:无线网络安装向导

11-06 女斗合众国:win7系统cf与主机连接不稳定怎

11-06 0xc000022-[cf烟雾头]cf怎么调烟雾头

11-06 qizideyouhuo:应用程序无法正常启动0xc0000

11-06 ipz-185:win7系统vcf文件怎么打开

11-06 傻哥蹦迪:win10系统s4怎么打开usb调试

11-06 八神浩树gtaste:回收站清空了怎么恢复

11-06 妖尾之黑色守护:win10系统电脑没有1440x900

11-06 校园至尊魔王小说:win7系统浏览网页时字体

11-06 女斗合众国:win10系统访问共享文件夹提示请

11-06 tokyo hot n0654:恢复win7系统默认字体一招

11-06 雨酷仙境:设置win7系统转移临时文件夹腾出

11-06 阿穆纳伊之杖:win7系统开始菜单在右边还原

11-06 tunespotting:win10系统火狐flash插件总是

11-06 甘尔葛分析师：计谋网站seo关键词暴涨有什

11-06 蔡贵霖: 计谋网站seo关键词暴涨有什么秘密

11-06 博益网首页:ao3网页版进入不了解决方法

11-06 漏斗子专栏: 网站数据分析小白易懂精华篇

11-06 见证双虹怎么做:win7系统开启telnet命令的

11-06 颾狐蝶蜋:系统资源不足无法完成请求的服务

11-06 国光中学校歌:提交网站到alexa查询详细步骤

11-06 西安有情天:静态网页和动态网页的区别

11-06 红木雅尚斋:外部链接构造对网站的好处

11-06 前官礼遇：防止域名劫持–增强域安全性的10

11-06 密传二转答案: 中文分词算法有哪些

11-06 金泉家园邮编:百度快照劫持的表现及应对方

Java AttributeSet类代码示例发布时间：2022-05-21

Java Event类代码示例发布时间：2022-05-21

剪的笔顺,诠释剪的笔画,认识剪的部首

1 六六分期app的软件客服如何联系？(六六分期

六六分期app的软件客服如何联系？不知道吗？加qq群【895510560】即可！标题：六六分期

阅读：19143|2023-10-27

2 可心卡盟:win10系统火狐flash插件崩溃怎么

今天小编告诉大家如何处理win10系统火狐flash插件总是崩溃的问题，可能很多用户都不知

阅读：9973|2022-11-06

3 亲亲特价:怎么删除回收站图标

今天小编告诉大家如何对win10系统删除桌面回收站图标进行设置，可能很多用户都不知道

阅读：8317|2022-11-06

4 济南大学虚拟社区:鲁大师节能降温的具体办

今天小编告诉大家如何对win10系统电脑设置节能降温的设置方法，想必大家都遇到过需要

阅读：8686|2022-11-06

5 xlueops.exe:无线网络安装向导

我们在使用xp系统的过程中,经常需要对xp系统无线网络安装向导设置进行设置，可能很多

阅读：8627|2022-11-06

6 女斗合众国:win7系统cf与主机连接不稳定怎

今天小编告诉大家如何处理win7系统玩cf老是与主机连接不稳定的问题，可能很多用户都不

阅读：9643|2022-11-06

7 0xc000022-[cf烟雾头]cf怎么调烟雾头

电脑对日常生活的重要性小编就不多说了，可是一旦碰到win7系统设置cf烟雾头的问题，很

阅读：8611|2022-11-06

8 qizideyouhuo:应用程序无法正常启动0xc0000

我们在日常使用电脑的时候，有的小伙伴们可能在打开应用的时候会遇见提示应用程序无法

阅读：7991|2022-11-06

9 ipz-185:win7系统vcf文件怎么打开

今天小编告诉大家如何对win7系统打开vcf文件进行设置，可能很多用户都不知道怎么对win

阅读：8642|2022-11-06

10 傻哥蹦迪:win10系统s4怎么打开usb调试

今天小编告诉大家如何对win10系统s4开启USB调试模式进行设置，可能很多用户都不知道怎

阅读：7527|2022-11-06

客服电话

电子邮件

Java GradientNormalization类代码示例

示例1: softMaxRegression

示例2: getConfiguration

示例3: getConfiguration

示例4: method

示例5: testImdbClassification

示例6: testAngerRegression

示例7: getModel

示例8: resetLayerDefaultConfig

示例9: regressionTestLSTM1

示例10: regressionTestCGLSTM1

示例11: regressionTestLSTM1

示例12: regressionTestCGLSTM1

示例13: regressionTestLSTM1

示例14: regressionTestCGLSTM1

示例15: doBefore

示例16: testRegularization

示例17: getUpsampling1DLayer

示例18: getSubsamplingLayer

示例19: testLfwModel

示例20: deepBeliefNetwork

请发表评论

全部评论

上一篇：

下一篇：

tunespotting:win10系统火狐flash插件总是

CVE-2022-35378

watterott/Arduino-Libs: Arduino Libs &am

armancodv/building-energy-model-matlab:

FGRibreau/import-tweets-to-mastodon: How

剪的笔顺,诠释剪的笔画,认识剪的部首

六六分期app的软件客服如何联系？(六六分期

florent37/ViewAnimator: A fluent Android

florent37/Shrine-MaterialDesign2: implem

CVE-2020-36276

SimpleSoftwareIO/simple-sms: Send and re

关于我们

产品与服务

解决方案

139-2527-9053