LanguageModelMetricReporter.Config

Component: LanguageModelMetricReporter

class LanguageModelMetricReporter.Config

Bases: MetricReporter.Config

All Attributes (including base classes)

output_path: str = '/tmp/test_out.txt'

pep_format: bool = False

student_column_names: list[str] = []

log_gradient: bool = False

aggregate_metrics: bool = True

perplexity_type: PerplexityType = <PerplexityType.MEDIAN: 'median'>

Subclasses

• MaskedLMMetricReporter.Config

Default JSON

{
    "output_path": "/tmp/test_out.txt",
    "pep_format": false,
    "student_column_names": [],
    "log_gradient": false,
    "aggregate_metrics": true,
    "perplexity_type": "median"
}