PyText
master

Getting Started

  • Installation
  • Train your first model
  • Execute your first model
  • Visualize Model Training with TensorBoard
  • Use PyText models in your app
  • Serve Models in Production
  • Config Files Explained
  • Config Commands

Training More Advanced Models

  • Train Intent-Slot model on ATIS Dataset
  • Hierarchical intent and slot filling
  • Multitask training with disjoint datasets
  • Data Parallel Distributed Training
  • XLM-RoBERTa
  • Semantic parsing with sequence-to-sequence models

Extending PyText

  • Architecture Overview
  • Custom Data Format
  • Custom Tensorizer
  • Using External Dense Features
  • Creating A New Model
  • Hacking PyText

References

  • pytext
    • config
    • data
      • batch_sampler
      • bert_tensorizer
      • data
      • data_handler
      • dense_retrieval_tensorizer
      • disjoint_multitask_data
      • disjoint_multitask_data_handler
      • dynamic_pooling_batcher
      • featurizer
      • packed_lm_data
      • roberta_tensorizer
      • sources
      • squad_for_bert_tensorizer
      • squad_tensorizer
      • tensorizers
        • AnnotationNumberizer.Config
        • ByteTensorizer.Config
        • ByteTokenTensorizer.Config
        • CharacterTokenTensorizer.Config
        • CharacterVocabTokenTensorizer.Config
        • Float1DListTensorizer.Config
        • FloatListSeqTensorizer.Config
        • FloatListTensorizer.Config
        • FloatTensorizer.Config
        • GazetteerTensorizer.Config
        • Integer1DListTensorizer.Config
        • LabelListRankTensorizer.Config
        • LabelListTensorizer.Config
        • LabelTensorizer.Config
        • MetricTensorizer.Config
        • NtokensTensorizer.Config
        • NumericLabelTensorizer.Config
        • SeqTokenTensorizer.Config
        • SlotLabelTensorizer.Config
        • SlotLabelTensorizerExpansible.Config
        • SoftLabelTensorizer.Config
        • String2DListTensorizer.Config
        • Tensorizer.Config
        • TokenTensorizer.Config
        • UidTensorizer.Config
        • VocabConfig
        • VocabFileConfig
      • tokenizers
    • exporters
    • loss
    • metric_reporters
    • models
    • optimizer
    • task
    • torchscript
    • trainers
  • pytext package
PyText
  • Docs »
  • pytext »
  • data »
  • tensorizers
  • Edit on GitHub

tensorizersΒΆ

  • AnnotationNumberizer.Config
  • ByteTensorizer.Config
  • ByteTokenTensorizer.Config
  • CharacterTokenTensorizer.Config
  • CharacterVocabTokenTensorizer.Config
  • Float1DListTensorizer.Config
  • FloatListSeqTensorizer.Config
  • FloatListTensorizer.Config
  • FloatTensorizer.Config
  • GazetteerTensorizer.Config
  • Integer1DListTensorizer.Config
  • LabelListRankTensorizer.Config
  • LabelListTensorizer.Config
  • LabelTensorizer.Config
  • MetricTensorizer.Config
  • NtokensTensorizer.Config
  • NumericLabelTensorizer.Config
  • SeqTokenTensorizer.Config
  • SlotLabelTensorizer.Config
  • SlotLabelTensorizerExpansible.Config
  • SoftLabelTensorizer.Config
  • String2DListTensorizer.Config
  • Tensorizer.Config
  • TokenTensorizer.Config
  • UidTensorizer.Config
  • VocabConfig
  • VocabFileConfig
Next Previous

© Copyright 2018, PyText Contributors Revision e407685a.

Built with Sphinx using a theme provided by Read the Docs.