Python - tensorflow.GradientTape.reset()

Python – tensorflow.GradientTape.gradient()

Last Updated : 10 Jul, 2020

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks.

gradient() is used to computes the gradient using operations recorded in context of this tape.

Syntax: gradient(target, sources, output_gradients, unconnected_gradients)

Parameters:

target: It is Tensor or list of Tensor to be differentiated.

sources: It is Tensor or list of Tensor. Target values are differentiated against the source.

output_gradients: It is a list of gradients with default value None.

unconnected_gradients: It’s value can be either none or zero with default value none.

Returns: It returns a list or nested structure of Tensor.

Example 1:

Python3

# Importing the library 
import tensorflow as tf 
  
x = tf.constant(4.0) 
  
# Using GradientTape 
with tf.GradientTape() as gfg: 
  gfg.watch(x) 
  y = x * x * x 
  
# Computing gradient 
res  = gfg.gradient(y, x)  
  
# Printing result 
print("res: ",res) 

Output:


res:  tf.Tensor(48.0, shape=(), dtype=float32)

Example 2:

Python3

# Importing the library 
import tensorflow as tf 
  
x = tf.constant(4.0) 
  
# Using GradientTape 
with tf.GradientTape() as gfg: 
  gfg.watch(x) 
  
  # Using nested GradientTape for  
  # calculating higher order derivative 
  with tf.GradientTape() as gg: 
    gg.watch(x) 
    y = x * x * x 
  
  # Computing first order gradient 
  first_order = gg.gradient(y, x) 
  
# Computing Second order gradient 
second_order  = gfg.gradient(first_order, x)  
  
# Printing result 
print("first_order: ",first_order) 
print("second_order: ",second_order) 

Output:


first_order:  tf.Tensor(48.0, shape=(), dtype=float32)
second_order:  tf.Tensor(24.0, shape=(), dtype=float32)

Python - tensorflow.GradientTape.reset()

aman neekhara

Improve

Article Tags :

Practice Tags :

python

Similar Reads

Python - tensorflow.GradientTape()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. GradientTape() is used to record operations for automatic differentiation. Syntax: tensorflow.GradientTape( persistent, watch_accessed_variables) Parameters: persistent(o

Python - tensorflow.GradientTape.watch()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. watch() is used to start tracing Tensor by the Tape. Syntax: watch( tensor ) Parameter: tensor: It is a Tensor or list of tensors to be watched. Returns: None Raise: Valu

Python - tensorflow.GradientTape.reset()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. reset() is used to clear all information that is stored by the Tape. Syntax: reset() Parameters: It doesn't accept any parameters. Returns: It returns none. Example 1: C/

Python - tensorflow.gradients()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. gradients() is used to get symbolic derivatives of sum of ys w.r.t. x in xs. It doesn't work when eager execution is enabled. Syntax: tensorflow.gradients( ys, xs, grad_y

Python - tensorflow.GradientTape.batch_jacobian()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. batch_jacobian() is used to compute and stack the per example jacobian. Syntax: batch_jacobian( target, source, unconnected_gradients, parallel_iterations, experimental_u

Python - tensorflow.GradientTape.jacobian()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. jacobian() is used to compute the jacobian using operations recorded in context of this tape. Syntax: jacobian( target, source, unconnected_gradients, parallel_iterations

Python - tensorflow.identity()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. identity() returns a Tensor with the same shape and contents as input. Syntax: tensorflow.identity(input, name) Parameters: input: It is a Tensor.name(optional): It defin

Python - tensorflow.identity_n()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. identity_n() is used get a list of Tensor with same shape and content as input Tensor. Syntax: tensorflow.identity_n( input, name) Parameters: input: It is a Tensor.name(

Gradient Descent Optimization in Tensorflow

Gradient descent is an optimization algorithm used to find the values of parameters (coefficients) of a function (f) that minimizes a cost function. In other words, gradient descent is an iterative algorithm that helps to find the optimal solution to a given problem. In this blog, we will discuss gr

Python - tensorflow.GradientTape.stop_recording()

TensorFlow is open-source Python library designed by Google to develop Machine Learning models and deep learning neural networks. stop_recording() is used to temporarily stop recording operation. If the Tape is not recording it will raise an error. Syntax: tensorflow.GradientTape.stop_recording() Pa