美文网首页
[Python]填充mask

[Python]填充mask

作者: VanJordan | 来源:发表于2019-04-01 14:48 被阅读0次
  • +[1]<eos>,最精妙的是一行的填充函数 text_input + [ 0 for x in range(biggest_seq - len(text_input))].
  • 获取biggest_seq也很有意思是len(max(encoded_inputs,key=len).
  • 如果是要限定句子长度那么text_input[:max_len] + [ 0 for x in range(max_len -len(text_input))]
encoded_inputs = [encoders["inputs"].encode(x) + [1] for x in input_txt]
# pad each input so is they are the same length
biggest_seq = len(max(encoded_inputs, key=len))
for i, text_input in enumerate(encoded_inputs):
    encoded_inputs[i] = text_input + [0 for x in range(biggest_seq - len(text_input))]

相关文章

网友评论

      本文标题:[Python]填充mask

      本文链接:https://www.haomeiwen.com/subject/wkjvbqtx.html