python 使用yield进行数据的流式处理，,demo：从文件中取

python 使用yield进行数据的流式处理，,demo：从文件中取

demo：从文件中取包含字符“a”的5行数据做一次批处理！！！

# coding: utf-8import timedef cat(f):    for line in f:        yield linedef grep(lines,searchtext):  for line in lines:    if searchtext in line:      yield linedef process(segment_lines):  print (segment_lines)flog = cat(open(‘/tmp/tflearn_logs/vae/events.out.tfevents.1540467860.lanzihuazaideMacBook-Pro.local‘))pylines = grep(flog, ‘a‘)segment_lines = []for line in pylines:  if len(segment_lines) < 5:      segment_lines.append(line)  else:      print ("*"*88)      process(segment_lines)      segment_lines = []if segment_lines:    print ("*"*88)    process(segment_lines)

python 使用yield进行数据的流式处理