Skip to main content
Modern PyTorch Guide home page
Search...
⌘K
Official Docs
GitHub
GitHub
Search...
Navigation
Foundations
Building Models
Performance
Domains
Production
Advanced
API Reference
Community
Forums
Core Tensors
Tensor Creation
Tensor Attributes
Tensor Manipulation
Tensor Views
Indexing & Slicing
Tensor size
Mathematical Operations
Pointwise Operations
Reduction Operations
Comparison Operations
Logical Operations
Bitwise Operations
Spectral Operations
Other ops
Neural Networks (torch.nn)
Containers
Linear Layers
Convolution Layers
Pooling Layers
Padding Layers
Upsampling Layers
Activation Functions
Normalization Layers
Recurrent Layers
Transformer Layers
Attention layers
Dropout Layers
Embedding Layers
Distance Functions
Vision Layers
Init
Loss Functions
Regression Losses
Classification Losses
Embedding Losses
Other Losses
Functional (torch.nn.functional)
NN Functional Overview
Functional Convolutions
Functional Pooling
Functional Activations
Functional Normalization
Functional Loss Functions
Optimization (torch.optim)
Optimizer API
Optimizers
Learning Rate Schedulers
Automatic Differentiation
Gradient Computation
Gradient Contexts
Custom Autograd Functions
Autograd Functional API
Autograd Profiler
Data Loading & Processing
Datasets
Data Loading
Samplers
Transforms
Device Management
CPU
CUDA
MPS
XPU
Mtia
Accelerator
Memory Management
Streams & Events
Backends
Distributed Training
Basic Distributed
DistributedDataParallel
FullyShardedDataParallel
Tensor Parallelism
Pipeline Parallelism
RPC Framework
Distributed Checkpoint
Elastic
Tensor
Algorithms
Model Compilation & Export
torch.compile
TorchDynamo
TorchInductor
AOT Autograd
Compiler Backends
TorchScript
Scripting
Tracing
JIT Optimization
torch.export
ONNX Export
Export Quantization
Quantization
Quantization API
QConfig
Observers
Fake Quantize
Quantized Modules
Sparse & Nested Tensors
Sparse Formats
Sparse Creation
Sparse Operations
Nested Tensors
Nested Operations
Masked tensors
Masked ops
Random & Distributions
Random Sampling
Random Seed
Distributions
Signal Processing
FFT
Spectral Analysis
Window Functions
Signal ops
Special Functions
Gamma Functions
Error Functions
Bessel Functions
Other Special Functions
Serialization & Checkpointing
Save & Load
State Dict
Checkpointing
Storage
Profiling & Debugging
Profiler
Bottleneck
Debugging
Anomaly Detection
Monitor
Flop counter
Testing Utilities
Test Assertions
Gradient Checking
Testing Utils
Functional Transformations (torch.func)
vmap
grad
jacobian
functionalize
Advanced Features
Hooks
Custom Operators
C++ Extensions
Memory Format
Autograd Profiler
Library
Overrides
Amp
Utilities
Benchmark Utils
Checkpointing Utils
TensorBoard
C++ Extensions
Mobile Optimizer
Data utils
Dlpack
Hipify
Jit utils
Module tracker
Deterministic
Collect env
Model zoo
Package & Deployment
Overview
Package api
Mobile optimizer
Nativert
Configuration & Environment
Torch config
Future flags
Logging
Environment vars
Type System
Type info
Complex numbers
Named tensors
Tensor size
C++ API
Overview
Frontend
Autograd
Libtorch
Futures & Async
Futures api
Distributed Training
Elastic
Distributed Checkpoint
Tensor
⌘I
