segformer pytorch

Segformer-Pytorch

Implementação de Segformer, rede neural Attention + MLP para segmentação, em Pytorch.

Instalar

$ pip install segformer-pytorch

Uso

Por exemplo, MiT-B0

 import torch
from segformer_pytorch import Segformer

model = Segformer (
    dims = ( 32 , 64 , 160 , 256 ),      # dimensions of each stage
    heads = ( 1 , 2 , 5 , 8 ),           # heads of each stage
    ff_expansion = ( 8 , 8 , 4 , 4 ),    # feedforward expansion factor of each stage
    reduction_ratio = ( 8 , 4 , 2 , 1 ), # reduction ratio of each stage for efficient attention
    num_layers = 2 ,                 # num layers of each stage
    decoder_dim = 256 ,              # decoder dimension
    num_classes = 4                 # number of segmentation classes
)

x = torch . randn ( 1 , 3 , 256 , 256 )
pred = model ( x ) # (1, 4, 64, 64)  # output is (H/4, W/4) map of the number of segmentation classes

Certifique-se de que as palavras-chave sejam no máximo uma tupla de 4, pois este repositório é codificado para fornecer os estágios do MiT 4 conforme feito no artigo.

Citações

 @misc { xie2021segformer ,
    title   = { SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers } , 
    author  = { Enze Xie and Wenhai Wang and Zhiding Yu and Anima Anandkumar and Jose M. Alvarez and Ping Luo } ,
    year    = { 2021 } ,
    eprint  = { 2105.15203 } ,
    archivePrefix = { arXiv } ,
    primaryClass = { cs.CV }
}