pytext.data.test package¶
Submodules¶
pytext.data.test.batch_sampler_test module¶
pytext.data.test.data_test module¶
-
class
pytext.data.test.data_test.
BatcherTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
pytext.data.test.dynamic_pooling_batcher_test module¶
pytext.data.test.mask_tensorizers_test module¶
pytext.data.test.pandas_data_source_test module¶
pytext.data.test.round_robin_batchiterator_test module¶
pytext.data.test.simple_featurizer_test module¶
pytext.data.test.tensorizers_test module¶
-
class
pytext.data.test.tensorizers_test.
BERTTensorizerTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tensorizers_test.
CharacterVocabTokenTensorizerTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tensorizers_test.
ListTensorizersTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tensorizers_test.
LookupTokensTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tensorizers_test.
RobertaTensorizerTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tensorizers_test.
SquadForBERTTensorizerTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tensorizers_test.
SquadForRobertaTensorizerTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tensorizers_test.
SquadTensorizerTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tensorizers_test.
String2DListTensorizerTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
expected_numberized
= [([[2, 3], [4, 5, 6, 3]], [2, 4], 2), ([[2, 3], [4, 5, 6, 0, 0]], [2, 5], 2)]¶
-
expected_tensorized
= (tensor([[[2, 3, 1, 1, 1], [4, 5, 6, 3, 1]], [[2, 3, 1, 1, 1], [4, 5, 6, 0, 0]]]),)¶
-
init_rows
= [{'text': [['Move', 'fast'], ['And', 'break', 'things', 'fast']]}]¶
-
test_rows
= [{'text': [['Move', 'fast'], ['And', 'break', 'things', 'fast']]}, {'text': [['Move', 'fast'], ['And', 'break', 'things', 'even', 'faster']]}]¶
-
pytext.data.test.tokenizers_test module¶
-
class
pytext.data.test.tokenizers_test.
GPT2BPETest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tokenizers_test.
SentencePieceTokenizerTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
pytext.data.test.tsv_data_source_test module¶
-
class
pytext.data.test.tsv_data_source_test.
BlockShardedTSVDataSourceTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tsv_data_source_test.
SessionTSVDataSourceTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
class
pytext.data.test.tsv_data_source_test.
TSVDataSourceTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase
-
test_bad_quoting
()[source]¶ The text column of the first row of this file opens a quote but does not close it.
-
pytext.data.test.utils_test module¶
-
class
pytext.data.test.utils_test.
PaddingTest
(methodName='runTest')[source]¶ Bases:
unittest.case.TestCase