我正在使用BERT run_classifier
和tensorflow TPUEstimator
,每次我训练我的模型或者我预测使用估算器预测器时,我会在屏幕上打印太多的日志信息。我怎样才能摆脱这些信息。以下行打印数百万次:
INFO:tensorflow:Dequeue next (1) batch(es) of data from outfeed.
I0423 15:45:17.093261 140624241985408 tpu_estimator.py:540] Dequeue next (1) batch(es) of data from outfeed.
以下行也在我的屏幕上写了数百万次(虽然没有问题,模型是使用TPU正确训练的)
E0423 15:44:54.258747 140624241985408 tpu.py:330] Operation of type Placeholder (module_apply_tokens/bert/encoder/layer_6/attention/output/dense/kernel) is not supported on the TPU. Execution will fail if this op is used in the graph.
ERROR:tensorflow:Operation of type Placeholder (module_apply_tokens/bert/encoder/layer_6/attention/output/dense/bias) is not supported on the TPU. Execution will fail if this op is used in the graph.
这是产生这种详细程度的代码:
from bert import run_classifier
estimator = tf.contrib.tpu.TPUEstimator(
use_tpu=True,
model_fn=model_fn,
config=get_run_config(OUTPUT_DIR),
train_batch_size=TRAIN_BATCH_SIZE,
eval_batch_size=EVAL_BATCH_SIZE,
predict_batch_size=PREDICT_BATCH_SIZE,
)
input_features = run_classifier.convert_examples_to_features(prediction_examples, label_list, MAX_SEQ_LENGTH, tokenizer)
predict_input_fn = run_classifier.input_fn_builder(features=input_features, seq_length=MAX_SEQ_LENGTH, is_training=False, drop_remainder=True)
predictions = estimator.predict(predict_input_fn)
我怎么能要求模型不要打印它们?
你应该能够与set the logging verbosity level
tf.logging.set_verbosity(v)
在你的main()
方法的第一行,其中详细级别v
可能是:
_level_names = {
FATAL: 'FATAL',
ERROR: 'ERROR',
WARN: 'WARN',
INFO: 'INFO',
DEBUG: 'DEBUG',
}
其中v=tf.logging.FATAL
将打印最少量的日志。