Torch Core¶

This module contains all the basic functions we need in other modules of the fastai library (split with core that contains the ones not requiring pytorch). Its documentation can easily be skipped at a first read, unless you want to know what a given fuction does.

In [1]:

from fastai.gen_doc.nbdoc import *
from fastai.torch_core import * 

Global constants¶

AdamW = partial(optim.Adam, betas=(0.9,0.99))

[source]

bn_types = (nn.BatchNorm1d, nn.BatchNorm2d, nn.BatchNorm3d)

[source]

default_device = torch.device('cuda') if torch.cuda.is_available() else torch.device('cpu')

[source]

Functions that operate conversions¶

In [2]:

show_doc(flatten_model, full_name='flatten')

`flatten`[source]

flatten(m)

Flattens all the layers of m.

In [3]:

show_doc(model2half)

`model2half`[source]

model2half(model:Module) → Module

Convert model to half precision except the batchnorm layers.

In [4]:

show_doc(requires_grad, doc_string=False)

`requires_grad`[source]

requires_grad(m:Module, b:Optional[bool]=None) → Optional[bool]

If b is None, returns the requires_grad state of the first layer of m. Otherwise, sets requires_grad=b in all children of m.

In [5]:

show_doc(tensor)

`tensor`[source]

tensor(x:Any, rest) → Tensor

Like torch.as_tensor, but handle lists too, and can pass multiple vector elements directly

Ensures x is a torch Tensor.

In [6]:

show_doc(to_data)

`to_data`[source]

to_data(b:ItemsList)

Recursively map lists of items in b to their wrapped data

In [7]:

show_doc(to_detach)

`to_detach`[source]

to_detach(b:Tensors)

Recursively detach lists of tensors in b

In [8]:

show_doc(to_device)

`to_device`[source]

to_device(b:Tensors, device:device)

Ensure b is on device.

In [9]:

show_doc(to_half, doc_string=False)

`to_half`[source]

to_half(b:Collection[Tensor]) → Collection[Tensor]

Put the input of the batch b in half precision.

In [10]:

show_doc(to_np)

`to_np`[source]

to_np(x)

Convert x to a numpy array.

Functions to deal with model initialization¶

In [11]:

show_doc(apply_init)

`apply_init`[source]

apply_init(m, init_func:LayerFunc)

Initialize all non-batchnorm layers of m with init_func.

In [12]:

show_doc(apply_leaf)

`apply_leaf`[source]

apply_leaf(m:Module, f:LayerFunc)

Apply f to children of m.

In [13]:

show_doc(cond_init)

`cond_init`[source]

cond_init(m:Module, init_func:LayerFunc)

Initialize the non-batchnorm layers of m with init_func

In [14]:

show_doc(in_channels)

`in_channels`[source]

in_channels(m:Module) → List[int]

Return the shape of the first weight layer in m.

Functions to get information of a model¶

In [15]:

show_doc(children)

`children`[source]

children(m:Module) → ModuleList

Get children of module m.

In [16]:

show_doc(first_layer)

`first_layer`[source]

first_layer(m:Module) → Module

Retrieve first layer in a module m.

In [17]:

show_doc(num_children)

`num_children`[source]

num_children(m:Module) → int

Get number of children modules in module m.

In [18]:

show_doc(range_children)

`range_children`[source]

range_children(m:Module) → Iterator[int]

Return iterator of len of children of m.

In [19]:

show_doc(trainable_params)

`trainable_params`[source]

trainable_params(m:Module) → ParamList

Return list of trainable params in m.

Functions to deal with BatchNorm layers¶

In [20]:

show_doc(bn2float)

`bn2float`[source]

bn2float(module:Module) → Module

If module is batchnorm don't use half precision.

In [21]:

show_doc(set_bn_eval)

`set_bn_eval`[source]

set_bn_eval(m:Module)

Set bn layers in eval mode for all recursive children of m.

In [22]:

show_doc(split_bn_bias)

`split_bn_bias`[source]

split_bn_bias(layer_groups:ModuleList) → ModuleList

Sort each layer in layer_groups into batchnorm (bn_types) and non-batchnorm groups.

Other functions¶

In [23]:

show_doc(calc_loss)

`calc_loss`[source]

calc_loss(y_pred:Tensor, y_true:Tensor, loss_func:LossFunction)

Calculate loss between y_pred and y_true using loss_class and bs.

In [24]:

show_doc(data_collate)

`data_collate`[source]

data_collate(batch:ItemsList) → Tensor

Convert batch items to tensor data.

In [25]:

show_doc(split_model, doc_string=False)

`split_model`[source]

split_model(model:Module, splits:Collection[Union[Module, ModuleList]], want_idxs:bool=False)

Splits the model according to the layer in splits. If splits are layers, the model is split at those (not included) sequentially. If want_idxs is True, the corresponding indexes are returned. If splits are lists of layers, the model is split according to those.

In [26]:

show_doc(split_model_idx)

`split_model_idx`[source]

split_model_idx(model:Module, idxs:Collection[int]) → ModuleList

Split model according to the indices in idxs.

Undocumented Methods - Methods moved below this line will intentionally be hidden¶

New Methods - Please document or move to the undocumented section¶

In [27]:

show_doc(np2model_tensor)

`np2model_tensor`[source]

np2model_tensor(a)

In [28]:

show_doc(np_address)

`np_address`[source]

np_address(x:ndarray) → int

Address of x in memory

In [29]:

show_doc(trange_of)

`trange_of`[source]

trange_of(x)

In [30]:

show_doc(model_type)

`model_type`[source]

model_type(dtype)

Torch Core¶

Global constants¶

Functions that operate conversions¶

flatten[source]

model2half[source]

requires_grad[source]

tensor[source]

to_data[source]

to_detach[source]

to_device[source]

to_half[source]

to_np[source]

Functions to deal with model initialization¶

apply_init[source]

apply_leaf[source]

cond_init[source]

in_channels[source]

Functions to get information of a model¶

children[source]

first_layer[source]

num_children[source]

range_children[source]

trainable_params[source]

Functions to deal with BatchNorm layers¶

bn2float[source]

set_bn_eval[source]

split_bn_bias[source]

Other functions¶

calc_loss[source]

data_collate[source]

split_model[source]

split_model_idx[source]

Undocumented Methods - Methods moved below this line will intentionally be hidden¶

New Methods - Please document or move to the undocumented section¶

np2model_tensor[source]

np_address[source]

trange_of[source]

model_type[source]

`flatten`[source]

`model2half`[source]

`requires_grad`[source]

`tensor`[source]

`to_data`[source]

`to_detach`[source]

`to_device`[source]

`to_half`[source]

`to_np`[source]

`apply_init`[source]

`apply_leaf`[source]

`cond_init`[source]

`in_channels`[source]

`children`[source]

`first_layer`[source]

`num_children`[source]

`range_children`[source]

`trainable_params`[source]

`bn2float`[source]

`set_bn_eval`[source]

`split_bn_bias`[source]

`calc_loss`[source]

`data_collate`[source]

`split_model`[source]

`split_model_idx`[source]

`np2model_tensor`[source]

`np_address`[source]

`trange_of`[source]

`model_type`[source]