Getting started with Starling (ST)

%pip install biostarling
%pip install lightning_lite

import anndata as ad
import pandas as pd
import torch
from starling import starling, utility
from lightning_lite import seed_everything
import pytorch_lightning as pl
Hide code cell output
Requirement already satisfied: biostarling in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (0.1.4)
Requirement already satisfied: flowsom<0.2.0,>=0.1.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from biostarling) (0.1.1)
Requirement already satisfied: numpy<2.0,>=1.26 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from biostarling) (1.26.4)
Requirement already satisfied: pandas>=0.23.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from biostarling) (2.2.2)
Requirement already satisfied: phenograph<2.0.0,>=1.5.7 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from biostarling) (1.5.7)
Requirement already satisfied: pytorch-lightning<3.0.0,>=2.3.3 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from biostarling) (2.4.0)
Requirement already satisfied: scanpy<2.0.0,>=1.10.2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from biostarling) (1.10.2)
Requirement already satisfied: torch<3.0.0,>=2.4.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from biostarling) (2.4.0)
Requirement already satisfied: FlowCytometryTools in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from flowsom<0.2.0,>=0.1.1->biostarling) (0.5.1)
Requirement already satisfied: matplotlib in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from flowsom<0.2.0,>=0.1.1->biostarling) (3.9.1.post1)
Requirement already satisfied: networkx in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from flowsom<0.2.0,>=0.1.1->biostarling) (3.2.1)
Requirement already satisfied: minisom in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from flowsom<0.2.0,>=0.1.1->biostarling) (2.3.2)
Requirement already satisfied: scikit-learn in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from flowsom<0.2.0,>=0.1.1->biostarling) (1.5.1)
Requirement already satisfied: python-dateutil>=2.8.2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pandas>=0.23.0->biostarling) (2.9.0.post0)
Requirement already satisfied: pytz>=2020.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pandas>=0.23.0->biostarling) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pandas>=0.23.0->biostarling) (2024.1)
Requirement already satisfied: leidenalg>=0.8.2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from phenograph<2.0.0,>=1.5.7->biostarling) (0.10.2)
Requirement already satisfied: setuptools>=18.0.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from phenograph<2.0.0,>=1.5.7->biostarling) (72.1.0)
Requirement already satisfied: scipy>=1.5.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from phenograph<2.0.0,>=1.5.7->biostarling) (1.13.1)
Requirement already satisfied: psutil>4 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from phenograph<2.0.0,>=1.5.7->biostarling) (6.0.0)
Requirement already satisfied: tqdm>=4.57.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pytorch-lightning<3.0.0,>=2.3.3->biostarling) (4.66.5)
Requirement already satisfied: PyYAML>=5.4 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pytorch-lightning<3.0.0,>=2.3.3->biostarling) (6.0.2)
Requirement already satisfied: fsspec>=2022.5.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (2024.6.1)
Requirement already satisfied: torchmetrics>=0.7.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pytorch-lightning<3.0.0,>=2.3.3->biostarling) (1.4.1)
Requirement already satisfied: packaging>=20.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pytorch-lightning<3.0.0,>=2.3.3->biostarling) (24.1)
Requirement already satisfied: typing-extensions>=4.4.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pytorch-lightning<3.0.0,>=2.3.3->biostarling) (4.12.2)
Requirement already satisfied: lightning-utilities>=0.10.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from pytorch-lightning<3.0.0,>=2.3.3->biostarling) (0.11.6)
Requirement already satisfied: anndata>=0.8 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (0.10.8)
Requirement already satisfied: h5py>=3.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (3.11.0)
Requirement already satisfied: joblib in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (1.4.2)
Requirement already satisfied: legacy-api-wrap>=1.4 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (1.4)
Requirement already satisfied: natsort in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (8.4.0)
Requirement already satisfied: numba>=0.56 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (0.60.0)
Requirement already satisfied: patsy in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (0.5.6)
Requirement already satisfied: pynndescent>=0.5 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (0.5.13)
Requirement already satisfied: seaborn>=0.13 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (0.13.2)
Requirement already satisfied: session-info in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (1.0.0)
Requirement already satisfied: statsmodels>=0.13 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (0.14.2)
Requirement already satisfied: umap-learn!=0.5.0,>=0.5 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scanpy<2.0.0,>=1.10.2->biostarling) (0.5.6)
Requirement already satisfied: filelock in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (3.15.4)
Requirement already satisfied: sympy in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (1.13.2)
Requirement already satisfied: jinja2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (3.1.4)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (12.1.105)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (12.1.105)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (12.1.105)
Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (9.1.0.70)
Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (12.1.3.1)
Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (11.0.2.54)
Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (10.3.2.106)
Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (11.4.5.107)
Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (12.1.0.106)
Requirement already satisfied: nvidia-nccl-cu12==2.20.5 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (2.20.5)
Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (12.1.105)
Requirement already satisfied: triton==3.0.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch<3.0.0,>=2.4.0->biostarling) (3.0.0)
Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch<3.0.0,>=2.4.0->biostarling) (12.6.20)
Requirement already satisfied: array-api-compat!=1.5,>1.4 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from anndata>=0.8->scanpy<2.0.0,>=1.10.2->biostarling) (1.8)
Requirement already satisfied: aiohttp!=4.0.0a0,!=4.0.0a1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (3.10.3)
Requirement already satisfied: igraph<0.12,>=0.10.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from leidenalg>=0.8.2->phenograph<2.0.0,>=1.5.7->biostarling) (0.11.6)
Requirement already satisfied: contourpy>=1.0.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from matplotlib->flowsom<0.2.0,>=0.1.1->biostarling) (1.2.1)
Requirement already satisfied: cycler>=0.10 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from matplotlib->flowsom<0.2.0,>=0.1.1->biostarling) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from matplotlib->flowsom<0.2.0,>=0.1.1->biostarling) (4.53.1)
Requirement already satisfied: kiwisolver>=1.3.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from matplotlib->flowsom<0.2.0,>=0.1.1->biostarling) (1.4.5)
Requirement already satisfied: pillow>=8 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from matplotlib->flowsom<0.2.0,>=0.1.1->biostarling) (10.4.0)
Requirement already satisfied: pyparsing>=2.3.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from matplotlib->flowsom<0.2.0,>=0.1.1->biostarling) (3.1.2)
Requirement already satisfied: llvmlite<0.44,>=0.43.0dev0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from numba>=0.56->scanpy<2.0.0,>=1.10.2->biostarling) (0.43.0)
Requirement already satisfied: six>=1.5 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from python-dateutil>=2.8.2->pandas>=0.23.0->biostarling) (1.16.0)
Requirement already satisfied: threadpoolctl>=3.1.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from scikit-learn->flowsom<0.2.0,>=0.1.1->biostarling) (3.5.0)
Requirement already satisfied: decorator in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from FlowCytometryTools->flowsom<0.2.0,>=0.1.1->biostarling) (5.1.1)
Requirement already satisfied: fcsparser>=0.1.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from FlowCytometryTools->flowsom<0.2.0,>=0.1.1->biostarling) (0.2.8)
Requirement already satisfied: MarkupSafe>=2.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from jinja2->torch<3.0.0,>=2.4.0->biostarling) (2.1.5)
Requirement already satisfied: stdlib-list in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from session-info->scanpy<2.0.0,>=1.10.2->biostarling) (0.10.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from sympy->torch<3.0.0,>=2.4.0->biostarling) (1.3.0)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (2.3.5)
Requirement already satisfied: aiosignal>=1.1.2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (1.9.4)
Requirement already satisfied: texttable>=1.6.2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from igraph<0.12,>=0.10.0->leidenalg>=0.8.2->phenograph<2.0.0,>=1.5.7->biostarling) (1.7.0)
Requirement already satisfied: idna>=2.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from yarl<2.0,>=1.0->aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>=2022.5.0->pytorch-lightning<3.0.0,>=2.3.3->biostarling) (3.7)
Note: you may need to restart the kernel to use updated packages.
Requirement already satisfied: lightning_lite in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (1.8.6)
Requirement already satisfied: numpy>=1.17.2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from lightning_lite) (1.26.4)
Requirement already satisfied: torch>=1.9.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from lightning_lite) (2.4.0)
Requirement already satisfied: fsspec>2021.06.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from fsspec[http]>2021.06.0->lightning_lite) (2024.6.1)
Requirement already satisfied: packaging>=17.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from lightning_lite) (24.1)
Requirement already satisfied: typing-extensions>=4.0.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from lightning_lite) (4.12.2)
Requirement already satisfied: lightning-utilities!=0.4.0,>=0.3.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from lightning_lite) (0.11.6)
Requirement already satisfied: aiohttp!=4.0.0a0,!=4.0.0a1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from fsspec[http]>2021.06.0->lightning_lite) (3.10.3)
Requirement already satisfied: setuptools in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from lightning-utilities!=0.4.0,>=0.3.0->lightning_lite) (72.1.0)
Requirement already satisfied: filelock in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (3.15.4)
Requirement already satisfied: sympy in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (1.13.2)
Requirement already satisfied: networkx in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (3.2.1)
Requirement already satisfied: jinja2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (3.1.4)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (12.1.105)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (12.1.105)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (12.1.105)
Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (9.1.0.70)
Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (12.1.3.1)
Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (11.0.2.54)
Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (10.3.2.106)
Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (11.4.5.107)
Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (12.1.0.106)
Requirement already satisfied: nvidia-nccl-cu12==2.20.5 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (2.20.5)
Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (12.1.105)
Requirement already satisfied: triton==3.0.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from torch>=1.9.0->lightning_lite) (3.0.0)
Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch>=1.9.0->lightning_lite) (12.6.20)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>2021.06.0->lightning_lite) (2.3.5)
Requirement already satisfied: aiosignal>=1.1.2 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>2021.06.0->lightning_lite) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>2021.06.0->lightning_lite) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>2021.06.0->lightning_lite) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>2021.06.0->lightning_lite) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>2021.06.0->lightning_lite) (1.9.4)
Requirement already satisfied: MarkupSafe>=2.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from jinja2->torch>=1.9.0->lightning_lite) (2.1.5)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from sympy->torch>=1.9.0->lightning_lite) (1.3.0)
Requirement already satisfied: idna>=2.0 in /home/runner/work/starling/starling/.venv/lib/python3.12/site-packages (from yarl<2.0,>=1.0->aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]>2021.06.0->lightning_lite) (3.7)
Note: you may need to restart the kernel to use updated packages.

Setting seed for everything

seed_everything(10, workers=True)
Hide code cell output
Global seed set to 10
10

Loading annData objects

The example below runs Kmeans with 10 clusters read from “sample_input.h5ad” object.

!wget https://github.com/camlab-bioml/starling/raw/main/docs/source/tutorial/sample_input.h5ad

adata = utility.init_clustering("KM", ad.read_h5ad("sample_input.h5ad"), k=10)
Hide code cell output
--2024-09-13 20:55:44--  https://github.com/camlab-bioml/starling/raw/main/docs/source/tutorial/sample_input.h5ad
Resolving github.com (github.com)... 140.82.114.3
Connecting to github.com (github.com)|140.82.114.3|:443... 
connected.
HTTP request sent, awaiting response... 
302 Found
Location: https://raw.githubusercontent.com/camlab-bioml/starling/main/docs/source/tutorial/sample_input.h5ad [following]
--2024-09-13 20:55:45--  https://raw.githubusercontent.com/camlab-bioml/starling/main/docs/source/tutorial/sample_input.h5ad
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.110.133, 185.199.111.133, 185.199.108.133, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.110.133|:443... connected.
HTTP request sent, awaiting response... 
200 OK
Length: 2639432 (2.5M) [application/octet-stream]
Saving to: ‘sample_input.h5ad.1’


sample_input.h5ad.1   0%[                    ]       0  --.-KB/s               
sample_input.h5ad.1 100%[===================>]   2.52M  --.-KB/s    in 0.05s   

2024-09-13 20:55:45 (46.6 MB/s) - ‘sample_input.h5ad.1’ saved [2639432/2639432]
  • The input anndata object should contain a cell-by-protein matrix of segmented single-cell expression profiles in the .X position. Optionally, cell size information can also be provided as a column of the .obs DataFrame. In this case model_cell_size should be set to True and the column specified in the cell_size_col_nameargument.

  • Users might want to arcsinh protein expressions in *.h5ad (for example, sample_input.h5ad).

  • The utility.py provides an easy setup of GMM, KM (Kmeans) or PG (PhenoGraph).

  • Default settings are applied to each method.

  • k can be omitted when PG is used.

Setting initializations

The example below uses defualt parameter settings based on benchmarking results (more details in manuscript).

st = starling.ST(adata)
/home/runner/work/starling/starling/starling/starling.py:78: FutureWarning: Series.__getitem__ treating keys as positions is deprecated. In a future version, integer keys will always be treated as labels (consistent with DataFrame behavior). To access a value by position, use `ser.iloc[pos]`
  torch.tensor(self.adata.obs[self.cell_size_col_name])

A list of parameters are shown:

  • adata: annDATA object of the sample

  • dist_option (default: ‘T’): T for Student-T (df=2) and N for Normal (Gaussian)

  • singlet_prop (default: 0.6): the proportion of anticipated segmentation error free cells

  • model_cell_size (default: ‘Y’): Y for incoporating cell size in the model and N otherwise

  • cell_size_col_name (default: ‘area’): area is the column name in anndata.obs dataframe

  • model_zplane_overlap (default: ‘Y’): Y for modeling z-plane overlap when cell size is modelled and N otherwise Note: if the user sets model_cell_size = ‘N’, then model_zplane_overlap is ignored

  • model_regularizer (default: 1): Regularizier term impose on synthetic doublet loss (BCE)

  • learning_rate (default: 1e-3): The learning rate of ADAM optimizer for STARLING

Equivalent to the above example:

st = starling.ST(adata, 'T', 'Y', 'area', 'Y', 1, 1e-3)

Setting training log

Once training starts, a new directory ‘log’ will be created.

## log training results via tensorboard
log_tb = pl.loggers.TensorBoardLogger(save_dir="log")

One could view the training information via tensorboard. Please refer to torch lightning (https://lightning.ai/docs/pytorch/stable/api_references.html#profiler) for other possible loggers.

Setting early stopping criterion

## set early stopping criterion
cb_early_stopping = pl.callbacks.EarlyStopping(monitor="train_loss", mode="min", verbose=False)

Training loss is monitored.

Training Starling

## train ST
st.train_and_fit(
    callbacks=[cb_early_stopping],
    logger=[log_tb],
)
Hide code cell output
GPU available: False, used: False
TPU available: False, using: 0 TPU cores
HPU available: False, using: 0 HPUs
  | Name | Type | Params | Mode
-------------------------------------
-------------------------------------
0         Trainable params
0         Non-trainable params
0         Total params
0.000     Total estimated model params size (MB)
0         Modules in train mode
0         Modules in eval mode
/home/runner/work/starling/starling/.venv/lib/python3.12/site-packages/torch/utils/data/dataloader.py:557: UserWarning: This DataLoader will create 8 worker processes in total. Our suggested max number of worker in current system is 4, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary.
  warnings.warn(_create_warning_msg(
/home/runner/work/starling/starling/.venv/lib/python3.12/site-packages/pytorch_lightning/loops/fit_loop.py:298: The number of training batches (27) is smaller than the logging interval Trainer(log_every_n_steps=50). Set a lower value for log_every_n_steps if you want to see logs for the training epoch.
Training: |          | 0/? [00:00<?, ?it/s]
Training:   0%|          | 0/27 [00:00<?, ?it/s]
Epoch 0:   0%|          | 0/27 [00:00<?, ?it/s] 
Epoch 0:   4%|▎         | 1/27 [00:00<00:02, 10.37it/s]
Epoch 0:   4%|▎         | 1/27 [00:00<00:02, 10.24it/s, v_num=0, train_loss_step=88.70]
Epoch 0:   7%|▋         | 2/27 [00:00<00:01, 13.78it/s, v_num=0, train_loss_step=88.70]
Epoch 0:   7%|▋         | 2/27 [00:00<00:01, 13.69it/s, v_num=0, train_loss_step=88.50]
/home/runner/work/starling/starling/starling/utility.py:509: UserWarning: The use of `x.T` on tensors of dimension other than 2 to reverse their shape is deprecated and it will throw an error in a future release. Consider `x.mT` to transpose batches of matrices or `x.permute(*torch.arange(x.ndim - 1, -1, -1))` to reverse the dimensions of a tensor. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3697.)
  prob_data_given_gamma_d1.T + log_delta[1] - prob_data
Epoch 0:  11%|█         | 3/27 [00:00<00:01, 15.29it/s, v_num=0, train_loss_step=88.50]
Epoch 0:  11%|█         | 3/27 [00:00<00:01, 15.23it/s, v_num=0, train_loss_step=88.40]
Epoch 0:  15%|█▍        | 4/27 [00:00<00:01, 16.40it/s, v_num=0, train_loss_step=88.40]
Epoch 0:  15%|█▍        | 4/27 [00:00<00:01, 16.34it/s, v_num=0, train_loss_step=88.50]
Epoch 0:  19%|█▊        | 5/27 [00:00<00:01, 17.00it/s, v_num=0, train_loss_step=88.50]
Epoch 0:  19%|█▊        | 5/27 [00:00<00:01, 16.95it/s, v_num=0, train_loss_step=88.30]
Epoch 0:  22%|██▏       | 6/27 [00:00<00:01, 16.69it/s, v_num=0, train_loss_step=88.30]
Epoch 0:  22%|██▏       | 6/27 [00:00<00:01, 16.63it/s, v_num=0, train_loss_step=88.30]
Epoch 0:  26%|██▌       | 7/27 [00:00<00:01, 17.12it/s, v_num=0, train_loss_step=88.30]
Epoch 0:  26%|██▌       | 7/27 [00:00<00:01, 17.09it/s, v_num=0, train_loss_step=88.60]
Epoch 0:  30%|██▉       | 8/27 [00:00<00:01, 16.46it/s, v_num=0, train_loss_step=88.60]
Epoch 0:  30%|██▉       | 8/27 [00:00<00:01, 16.43it/s, v_num=0, train_loss_step=88.70]
Epoch 0:  33%|███▎      | 9/27 [00:00<00:01, 16.69it/s, v_num=0, train_loss_step=88.70]
Epoch 0:  33%|███▎      | 9/27 [00:00<00:01, 16.66it/s, v_num=0, train_loss_step=88.30]
Epoch 0:  37%|███▋      | 10/27 [00:00<00:01, 16.93it/s, v_num=0, train_loss_step=88.30]
Epoch 0:  37%|███▋      | 10/27 [00:00<00:01, 16.90it/s, v_num=0, train_loss_step=88.90]
Epoch 0:  41%|████      | 11/27 [00:00<00:00, 17.14it/s, v_num=0, train_loss_step=88.90]
Epoch 0:  41%|████      | 11/27 [00:00<00:00, 17.12it/s, v_num=0, train_loss_step=88.50]
Epoch 0:  44%|████▍     | 12/27 [00:00<00:00, 17.36it/s, v_num=0, train_loss_step=88.50]
Epoch 0:  44%|████▍     | 12/27 [00:00<00:00, 17.34it/s, v_num=0, train_loss_step=88.30]
Epoch 0:  48%|████▊     | 13/27 [00:00<00:00, 17.57it/s, v_num=0, train_loss_step=88.30]
Epoch 0:  48%|████▊     | 13/27 [00:00<00:00, 17.54it/s, v_num=0, train_loss_step=88.10]
Epoch 0:  52%|█████▏    | 14/27 [00:00<00:00, 17.73it/s, v_num=0, train_loss_step=88.10]
Epoch 0:  52%|█████▏    | 14/27 [00:00<00:00, 17.71it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  56%|█████▌    | 15/27 [00:00<00:00, 17.90it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  56%|█████▌    | 15/27 [00:00<00:00, 17.88it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  59%|█████▉    | 16/27 [00:00<00:00, 17.95it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  59%|█████▉    | 16/27 [00:00<00:00, 17.94it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  63%|██████▎   | 17/27 [00:00<00:00, 18.01it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  63%|██████▎   | 17/27 [00:00<00:00, 17.99it/s, v_num=0, train_loss_step=88.60]
Epoch 0:  67%|██████▋   | 18/27 [00:00<00:00, 18.08it/s, v_num=0, train_loss_step=88.60]
Epoch 0:  67%|██████▋   | 18/27 [00:00<00:00, 18.06it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  70%|███████   | 19/27 [00:01<00:00, 18.14it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  70%|███████   | 19/27 [00:01<00:00, 18.12it/s, v_num=0, train_loss_step=88.20]
Epoch 0:  74%|███████▍  | 20/27 [00:01<00:00, 18.22it/s, v_num=0, train_loss_step=88.20]
Epoch 0:  74%|███████▍  | 20/27 [00:01<00:00, 18.20it/s, v_num=0, train_loss_step=88.10]
Epoch 0:  78%|███████▊  | 21/27 [00:01<00:00, 18.27it/s, v_num=0, train_loss_step=88.10]
Epoch 0:  78%|███████▊  | 21/27 [00:01<00:00, 18.25it/s, v_num=0, train_loss_step=87.90]
Epoch 0:  81%|████████▏ | 22/27 [00:01<00:00, 18.35it/s, v_num=0, train_loss_step=87.90]
Epoch 0:  81%|████████▏ | 22/27 [00:01<00:00, 18.33it/s, v_num=0, train_loss_step=88.20]
Epoch 0:  85%|████████▌ | 23/27 [00:01<00:00, 18.42it/s, v_num=0, train_loss_step=88.20]
Epoch 0:  85%|████████▌ | 23/27 [00:01<00:00, 18.40it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  89%|████████▉ | 24/27 [00:01<00:00, 18.46it/s, v_num=0, train_loss_step=88.00]
Epoch 0:  89%|████████▉ | 24/27 [00:01<00:00, 18.44it/s, v_num=0, train_loss_step=88.10]
Epoch 0:  93%|█████████▎| 25/27 [00:01<00:00, 18.34it/s, v_num=0, train_loss_step=88.10]
Epoch 0:  93%|█████████▎| 25/27 [00:01<00:00, 18.32it/s, v_num=0, train_loss_step=88.10]
Epoch 0:  96%|█████████▋| 26/27 [00:01<00:00, 18.24it/s, v_num=0, train_loss_step=88.10]
Epoch 0:  96%|█████████▋| 26/27 [00:01<00:00, 18.22it/s, v_num=0, train_loss_step=87.80]
Epoch 0: 100%|██████████| 27/27 [00:01<00:00, 18.43it/s, v_num=0, train_loss_step=87.80]
Epoch 0: 100%|██████████| 27/27 [00:01<00:00, 18.42it/s, v_num=0, train_loss_step=88.30]
Epoch 0: 100%|██████████| 27/27 [00:01<00:00, 18.36it/s, v_num=0, train_loss_step=88.30, train_loss_epoch=88.30]
Epoch 0:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=88.30, train_loss_epoch=88.30]         
Epoch 1:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=88.30, train_loss_epoch=88.30]
Epoch 1:   4%|▎         | 1/27 [00:01<00:26,  0.96it/s, v_num=0, train_loss_step=88.30, train_loss_epoch=88.30]
Epoch 1:   4%|▎         | 1/27 [00:01<00:27,  0.96it/s, v_num=0, train_loss_step=87.70, train_loss_epoch=88.30]
Epoch 1:   7%|▋         | 2/27 [00:01<00:13,  1.79it/s, v_num=0, train_loss_step=87.70, train_loss_epoch=88.30]
Epoch 1:   7%|▋         | 2/27 [00:01<00:13,  1.79it/s, v_num=0, train_loss_step=87.50, train_loss_epoch=88.30]
Epoch 1:  11%|█         | 3/27 [00:01<00:09,  2.54it/s, v_num=0, train_loss_step=87.50, train_loss_epoch=88.30]
Epoch 1:  11%|█         | 3/27 [00:01<00:09,  2.53it/s, v_num=0, train_loss_step=87.60, train_loss_epoch=88.30]
Epoch 1:  15%|█▍        | 4/27 [00:01<00:07,  3.21it/s, v_num=0, train_loss_step=87.60, train_loss_epoch=88.30]
Epoch 1:  15%|█▍        | 4/27 [00:01<00:07,  3.21it/s, v_num=0, train_loss_step=87.80, train_loss_epoch=88.30]
Epoch 1:  19%|█▊        | 5/27 [00:01<00:05,  3.81it/s, v_num=0, train_loss_step=87.80, train_loss_epoch=88.30]
Epoch 1:  19%|█▊        | 5/27 [00:01<00:05,  3.81it/s, v_num=0, train_loss_step=88.10, train_loss_epoch=88.30]
Epoch 1:  22%|██▏       | 6/27 [00:01<00:04,  4.29it/s, v_num=0, train_loss_step=88.10, train_loss_epoch=88.30]
Epoch 1:  22%|██▏       | 6/27 [00:01<00:04,  4.29it/s, v_num=0, train_loss_step=88.20, train_loss_epoch=88.30]
Epoch 1:  26%|██▌       | 7/27 [00:01<00:04,  4.82it/s, v_num=0, train_loss_step=88.20, train_loss_epoch=88.30]
Epoch 1:  26%|██▌       | 7/27 [00:01<00:04,  4.82it/s, v_num=0, train_loss_step=88.00, train_loss_epoch=88.30]
Epoch 1:  30%|██▉       | 8/27 [00:01<00:03,  5.30it/s, v_num=0, train_loss_step=88.00, train_loss_epoch=88.30]
Epoch 1:  30%|██▉       | 8/27 [00:01<00:03,  5.30it/s, v_num=0, train_loss_step=87.70, train_loss_epoch=88.30]
Epoch 1:  33%|███▎      | 9/27 [00:01<00:03,  5.76it/s, v_num=0, train_loss_step=87.70, train_loss_epoch=88.30]
Epoch 1:  33%|███▎      | 9/27 [00:01<00:03,  5.75it/s, v_num=0, train_loss_step=88.20, train_loss_epoch=88.30]
Epoch 1:  37%|███▋      | 10/27 [00:01<00:02,  6.12it/s, v_num=0, train_loss_step=88.20, train_loss_epoch=88.30]
Epoch 1:  37%|███▋      | 10/27 [00:01<00:02,  6.12it/s, v_num=0, train_loss_step=87.80, train_loss_epoch=88.30]
Epoch 1:  41%|████      | 11/27 [00:01<00:02,  6.48it/s, v_num=0, train_loss_step=87.80, train_loss_epoch=88.30]
Epoch 1:  41%|████      | 11/27 [00:01<00:02,  6.48it/s, v_num=0, train_loss_step=87.40, train_loss_epoch=88.30]
Epoch 1:  44%|████▍     | 12/27 [00:01<00:02,  6.83it/s, v_num=0, train_loss_step=87.40, train_loss_epoch=88.30]
Epoch 1:  44%|████▍     | 12/27 [00:01<00:02,  6.82it/s, v_num=0, train_loss_step=87.50, train_loss_epoch=88.30]
Epoch 1:  48%|████▊     | 13/27 [00:01<00:01,  7.15it/s, v_num=0, train_loss_step=87.50, train_loss_epoch=88.30]
Epoch 1:  48%|████▊     | 13/27 [00:01<00:01,  7.15it/s, v_num=0, train_loss_step=87.70, train_loss_epoch=88.30]
Epoch 1:  52%|█████▏    | 14/27 [00:01<00:01,  7.47it/s, v_num=0, train_loss_step=87.70, train_loss_epoch=88.30]
Epoch 1:  52%|█████▏    | 14/27 [00:01<00:01,  7.46it/s, v_num=0, train_loss_step=87.40, train_loss_epoch=88.30]
Epoch 1:  56%|█████▌    | 15/27 [00:01<00:01,  7.73it/s, v_num=0, train_loss_step=87.40, train_loss_epoch=88.30]
Epoch 1:  56%|█████▌    | 15/27 [00:01<00:01,  7.73it/s, v_num=0, train_loss_step=87.60, train_loss_epoch=88.30]
Epoch 1:  59%|█████▉    | 16/27 [00:02<00:01,  7.96it/s, v_num=0, train_loss_step=87.60, train_loss_epoch=88.30]
Epoch 1:  59%|█████▉    | 16/27 [00:02<00:01,  7.96it/s, v_num=0, train_loss_step=87.70, train_loss_epoch=88.30]
Epoch 1:  63%|██████▎   | 17/27 [00:02<00:01,  8.19it/s, v_num=0, train_loss_step=87.70, train_loss_epoch=88.30]
Epoch 1:  63%|██████▎   | 17/27 [00:02<00:01,  8.18it/s, v_num=0, train_loss_step=87.30, train_loss_epoch=88.30]
Epoch 1:  67%|██████▋   | 18/27 [00:02<00:01,  8.41it/s, v_num=0, train_loss_step=87.30, train_loss_epoch=88.30]
Epoch 1:  67%|██████▋   | 18/27 [00:02<00:01,  8.41it/s, v_num=0, train_loss_step=87.40, train_loss_epoch=88.30]
Epoch 1:  70%|███████   | 19/27 [00:02<00:00,  8.64it/s, v_num=0, train_loss_step=87.40, train_loss_epoch=88.30]
Epoch 1:  70%|███████   | 19/27 [00:02<00:00,  8.63it/s, v_num=0, train_loss_step=87.50, train_loss_epoch=88.30]
Epoch 1:  74%|███████▍  | 20/27 [00:02<00:00,  8.85it/s, v_num=0, train_loss_step=87.50, train_loss_epoch=88.30]
Epoch 1:  74%|███████▍  | 20/27 [00:02<00:00,  8.85it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=88.30]
Epoch 1:  78%|███████▊  | 21/27 [00:02<00:00,  9.04it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=88.30]
Epoch 1:  78%|███████▊  | 21/27 [00:02<00:00,  9.04it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=88.30]
Epoch 1:  81%|████████▏ | 22/27 [00:02<00:00,  9.23it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=88.30]
Epoch 1:  81%|████████▏ | 22/27 [00:02<00:00,  9.23it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=88.30]
Epoch 1:  85%|████████▌ | 23/27 [00:02<00:00,  9.41it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=88.30]
Epoch 1:  85%|████████▌ | 23/27 [00:02<00:00,  9.40it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=88.30]
Epoch 1:  89%|████████▉ | 24/27 [00:02<00:00,  9.59it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=88.30]
Epoch 1:  89%|████████▉ | 24/27 [00:02<00:00,  9.58it/s, v_num=0, train_loss_step=86.70, train_loss_epoch=88.30]
Epoch 1:  93%|█████████▎| 25/27 [00:02<00:00,  9.78it/s, v_num=0, train_loss_step=86.70, train_loss_epoch=88.30]
Epoch 1:  93%|█████████▎| 25/27 [00:02<00:00,  9.78it/s, v_num=0, train_loss_step=87.80, train_loss_epoch=88.30]
Epoch 1:  96%|█████████▋| 26/27 [00:02<00:00,  9.96it/s, v_num=0, train_loss_step=87.80, train_loss_epoch=88.30]
Epoch 1:  96%|█████████▋| 26/27 [00:02<00:00,  9.96it/s, v_num=0, train_loss_step=87.40, train_loss_epoch=88.30]
Epoch 1: 100%|██████████| 27/27 [00:02<00:00, 10.19it/s, v_num=0, train_loss_step=87.40, train_loss_epoch=88.30]
Epoch 1: 100%|██████████| 27/27 [00:02<00:00, 10.19it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=88.30]
Epoch 1: 100%|██████████| 27/27 [00:02<00:00, 10.18it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=87.50]
Epoch 1:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=87.50]         
Epoch 2:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=87.50]
Epoch 2:   4%|▎         | 1/27 [00:00<00:17,  1.46it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=87.50]
Epoch 2:   4%|▎         | 1/27 [00:00<00:17,  1.45it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:   7%|▋         | 2/27 [00:00<00:10,  2.37it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:   7%|▋         | 2/27 [00:00<00:10,  2.37it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=87.50]
Epoch 2:  11%|█         | 3/27 [00:00<00:07,  3.26it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=87.50]
Epoch 2:  11%|█         | 3/27 [00:00<00:07,  3.26it/s, v_num=0, train_loss_step=87.30, train_loss_epoch=87.50]
Epoch 2:  15%|█▍        | 4/27 [00:01<00:06,  3.37it/s, v_num=0, train_loss_step=87.30, train_loss_epoch=87.50]
Epoch 2:  15%|█▍        | 4/27 [00:01<00:06,  3.37it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  19%|█▊        | 5/27 [00:01<00:06,  3.40it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  19%|█▊        | 5/27 [00:01<00:06,  3.39it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  22%|██▏       | 6/27 [00:01<00:05,  3.92it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  22%|██▏       | 6/27 [00:01<00:05,  3.92it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=87.50]
Epoch 2:  26%|██▌       | 7/27 [00:01<00:04,  4.41it/s, v_num=0, train_loss_step=87.20, train_loss_epoch=87.50]
Epoch 2:  26%|██▌       | 7/27 [00:01<00:04,  4.41it/s, v_num=0, train_loss_step=87.10, train_loss_epoch=87.50]
Epoch 2:  30%|██▉       | 8/27 [00:01<00:03,  4.89it/s, v_num=0, train_loss_step=87.10, train_loss_epoch=87.50]
Epoch 2:  30%|██▉       | 8/27 [00:01<00:03,  4.89it/s, v_num=0, train_loss_step=86.80, train_loss_epoch=87.50]
Epoch 2:  33%|███▎      | 9/27 [00:01<00:03,  5.31it/s, v_num=0, train_loss_step=86.80, train_loss_epoch=87.50]
Epoch 2:  33%|███▎      | 9/27 [00:01<00:03,  5.30it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  37%|███▋      | 10/27 [00:01<00:02,  5.72it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  37%|███▋      | 10/27 [00:01<00:02,  5.72it/s, v_num=0, train_loss_step=86.70, train_loss_epoch=87.50]
Epoch 2:  41%|████      | 11/27 [00:01<00:02,  6.12it/s, v_num=0, train_loss_step=86.70, train_loss_epoch=87.50]
Epoch 2:  41%|████      | 11/27 [00:01<00:02,  6.11it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  44%|████▍     | 12/27 [00:01<00:02,  6.50it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  44%|████▍     | 12/27 [00:01<00:02,  6.50it/s, v_num=0, train_loss_step=87.30, train_loss_epoch=87.50]
Epoch 2:  48%|████▊     | 13/27 [00:01<00:02,  6.86it/s, v_num=0, train_loss_step=87.30, train_loss_epoch=87.50]
Epoch 2:  48%|████▊     | 13/27 [00:01<00:02,  6.86it/s, v_num=0, train_loss_step=86.80, train_loss_epoch=87.50]
Epoch 2:  52%|█████▏    | 14/27 [00:01<00:01,  7.21it/s, v_num=0, train_loss_step=86.80, train_loss_epoch=87.50]
Epoch 2:  52%|█████▏    | 14/27 [00:01<00:01,  7.20it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  56%|█████▌    | 15/27 [00:02<00:01,  6.89it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  56%|█████▌    | 15/27 [00:02<00:01,  6.89it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=87.50]
Epoch 2:  59%|█████▉    | 16/27 [00:02<00:01,  7.20it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=87.50]
Epoch 2:  59%|█████▉    | 16/27 [00:02<00:01,  7.19it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  63%|██████▎   | 17/27 [00:02<00:01,  7.48it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  63%|██████▎   | 17/27 [00:02<00:01,  7.48it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=87.50]
Epoch 2:  67%|██████▋   | 18/27 [00:02<00:01,  7.75it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=87.50]
Epoch 2:  67%|██████▋   | 18/27 [00:02<00:01,  7.74it/s, v_num=0, train_loss_step=87.10, train_loss_epoch=87.50]
Epoch 2:  70%|███████   | 19/27 [00:02<00:00,  8.00it/s, v_num=0, train_loss_step=87.10, train_loss_epoch=87.50]
Epoch 2:  70%|███████   | 19/27 [00:02<00:01,  8.00it/s, v_num=0, train_loss_step=86.60, train_loss_epoch=87.50]
Epoch 2:  74%|███████▍  | 20/27 [00:02<00:00,  8.21it/s, v_num=0, train_loss_step=86.60, train_loss_epoch=87.50]
Epoch 2:  74%|███████▍  | 20/27 [00:02<00:00,  8.21it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=87.50]
Epoch 2:  78%|███████▊  | 21/27 [00:02<00:00,  8.45it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=87.50]
Epoch 2:  78%|███████▊  | 21/27 [00:02<00:00,  8.45it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  81%|████████▏ | 22/27 [00:02<00:00,  8.68it/s, v_num=0, train_loss_step=87.00, train_loss_epoch=87.50]
Epoch 2:  81%|████████▏ | 22/27 [00:02<00:00,  8.68it/s, v_num=0, train_loss_step=86.70, train_loss_epoch=87.50]
Epoch 2:  85%|████████▌ | 23/27 [00:02<00:00,  8.85it/s, v_num=0, train_loss_step=86.70, train_loss_epoch=87.50]
Epoch 2:  85%|████████▌ | 23/27 [00:02<00:00,  8.85it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=87.50]
Epoch 2:  89%|████████▉ | 24/27 [00:02<00:00,  9.06it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=87.50]
Epoch 2:  89%|████████▉ | 24/27 [00:02<00:00,  9.06it/s, v_num=0, train_loss_step=86.60, train_loss_epoch=87.50]
Epoch 2:  93%|█████████▎| 25/27 [00:02<00:00,  9.26it/s, v_num=0, train_loss_step=86.60, train_loss_epoch=87.50]
Epoch 2:  93%|█████████▎| 25/27 [00:02<00:00,  9.26it/s, v_num=0, train_loss_step=86.50, train_loss_epoch=87.50]
Epoch 2:  96%|█████████▋| 26/27 [00:02<00:00,  9.46it/s, v_num=0, train_loss_step=86.50, train_loss_epoch=87.50]
Epoch 2:  96%|█████████▋| 26/27 [00:02<00:00,  9.46it/s, v_num=0, train_loss_step=86.70, train_loss_epoch=87.50]
Epoch 2: 100%|██████████| 27/27 [00:02<00:00,  9.69it/s, v_num=0, train_loss_step=86.70, train_loss_epoch=87.50]
Epoch 2: 100%|██████████| 27/27 [00:02<00:00,  9.69it/s, v_num=0, train_loss_step=86.50, train_loss_epoch=87.50]
Epoch 2: 100%|██████████| 27/27 [00:02<00:00,  9.68it/s, v_num=0, train_loss_step=86.50, train_loss_epoch=86.90]
Epoch 2:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=86.50, train_loss_epoch=86.90]         
Epoch 3:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=86.50, train_loss_epoch=86.90]
Epoch 3:   4%|▎         | 1/27 [00:00<00:09,  2.61it/s, v_num=0, train_loss_step=86.50, train_loss_epoch=86.90]
Epoch 3:   4%|▎         | 1/27 [00:00<00:10,  2.60it/s, v_num=0, train_loss_step=86.30, train_loss_epoch=86.90]
Epoch 3:   7%|▋         | 2/27 [00:00<00:05,  4.58it/s, v_num=0, train_loss_step=86.30, train_loss_epoch=86.90]
Epoch 3:   7%|▋         | 2/27 [00:00<00:05,  4.57it/s, v_num=0, train_loss_step=86.10, train_loss_epoch=86.90]
Epoch 3:  11%|█         | 3/27 [00:00<00:04,  5.78it/s, v_num=0, train_loss_step=86.10, train_loss_epoch=86.90]
Epoch 3:  11%|█         | 3/27 [00:00<00:04,  5.77it/s, v_num=0, train_loss_step=86.80, train_loss_epoch=86.90]
Epoch 3:  15%|█▍        | 4/27 [00:00<00:03,  7.00it/s, v_num=0, train_loss_step=86.80, train_loss_epoch=86.90]
Epoch 3:  15%|█▍        | 4/27 [00:00<00:03,  6.99it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=86.90]
Epoch 3:  19%|█▊        | 5/27 [00:00<00:02,  8.05it/s, v_num=0, train_loss_step=86.90, train_loss_epoch=86.90]
Epoch 3:  19%|█▊        | 5/27 [00:00<00:02,  8.04it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=86.90]
Epoch 3:  22%|██▏       | 6/27 [00:00<00:02,  8.73it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=86.90]
Epoch 3:  22%|██▏       | 6/27 [00:00<00:02,  8.72it/s, v_num=0, train_loss_step=86.60, train_loss_epoch=86.90]
Epoch 3:  26%|██▌       | 7/27 [00:00<00:02,  9.47it/s, v_num=0, train_loss_step=86.60, train_loss_epoch=86.90]
Epoch 3:  26%|██▌       | 7/27 [00:00<00:02,  9.46it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.90]
Epoch 3:  30%|██▉       | 8/27 [00:00<00:01, 10.15it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.90]
Epoch 3:  30%|██▉       | 8/27 [00:00<00:01, 10.14it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=86.90]
Epoch 3:  33%|███▎      | 9/27 [00:00<00:01, 10.70it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=86.90]
Epoch 3:  33%|███▎      | 9/27 [00:00<00:01, 10.69it/s, v_num=0, train_loss_step=86.60, train_loss_epoch=86.90]
Epoch 3:  37%|███▋      | 10/27 [00:00<00:01, 11.20it/s, v_num=0, train_loss_step=86.60, train_loss_epoch=86.90]
Epoch 3:  37%|███▋      | 10/27 [00:00<00:01, 11.19it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=86.90]
Epoch 3:  41%|████      | 11/27 [00:00<00:01, 11.64it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=86.90]
Epoch 3:  41%|████      | 11/27 [00:00<00:01, 11.63it/s, v_num=0, train_loss_step=86.80, train_loss_epoch=86.90]
Epoch 3:  44%|████▍     | 12/27 [00:00<00:01, 12.06it/s, v_num=0, train_loss_step=86.80, train_loss_epoch=86.90]
Epoch 3:  44%|████▍     | 12/27 [00:00<00:01, 12.05it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3:  48%|████▊     | 13/27 [00:01<00:01, 12.48it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3:  48%|████▊     | 13/27 [00:01<00:01, 12.47it/s, v_num=0, train_loss_step=86.30, train_loss_epoch=86.90]
Epoch 3:  52%|█████▏    | 14/27 [00:01<00:01, 12.78it/s, v_num=0, train_loss_step=86.30, train_loss_epoch=86.90]
Epoch 3:  52%|█████▏    | 14/27 [00:01<00:01, 12.77it/s, v_num=0, train_loss_step=86.10, train_loss_epoch=86.90]
Epoch 3:  56%|█████▌    | 15/27 [00:01<00:00, 13.01it/s, v_num=0, train_loss_step=86.10, train_loss_epoch=86.90]
Epoch 3:  56%|█████▌    | 15/27 [00:01<00:00, 13.00it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=86.90]
Epoch 3:  59%|█████▉    | 16/27 [00:01<00:00, 13.34it/s, v_num=0, train_loss_step=86.40, train_loss_epoch=86.90]
Epoch 3:  59%|█████▉    | 16/27 [00:01<00:00, 13.33it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3:  63%|██████▎   | 17/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3:  63%|██████▎   | 17/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.90]
Epoch 3:  67%|██████▋   | 18/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.90]
Epoch 3:  67%|██████▋   | 18/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.90]
Epoch 3:  70%|███████   | 19/27 [00:01<00:00, 14.02it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.90]
Epoch 3:  70%|███████   | 19/27 [00:01<00:00, 14.01it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.90]
Epoch 3:  74%|███████▍  | 20/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.90]
Epoch 3:  74%|███████▍  | 20/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.90]
Epoch 3:  78%|███████▊  | 21/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.90]
Epoch 3:  78%|███████▊  | 21/27 [00:01<00:00, 14.34it/s, v_num=0, train_loss_step=85.80, train_loss_epoch=86.90]
Epoch 3:  81%|████████▏ | 22/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=85.80, train_loss_epoch=86.90]
Epoch 3:  81%|████████▏ | 22/27 [00:01<00:00, 14.49it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3:  85%|████████▌ | 23/27 [00:01<00:00, 14.70it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3:  85%|████████▌ | 23/27 [00:01<00:00, 14.69it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3:  89%|████████▉ | 24/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3:  89%|████████▉ | 24/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=86.10, train_loss_epoch=86.90]
Epoch 3:  93%|█████████▎| 25/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=86.10, train_loss_epoch=86.90]
Epoch 3:  93%|█████████▎| 25/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=86.10, train_loss_epoch=86.90]
Epoch 3:  96%|█████████▋| 26/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=86.10, train_loss_epoch=86.90]
Epoch 3:  96%|█████████▋| 26/27 [00:01<00:00, 15.08it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3: 100%|██████████| 27/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.90]
Epoch 3: 100%|██████████| 27/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.90]
Epoch 3: 100%|██████████| 27/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.20]
Epoch 3:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.20]         
Epoch 4:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.20]
Epoch 4:   4%|▎         | 1/27 [00:00<00:08,  2.93it/s, v_num=0, train_loss_step=86.20, train_loss_epoch=86.20]
Epoch 4:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4:   7%|▋         | 2/27 [00:00<00:04,  5.00it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4:   7%|▋         | 2/27 [00:00<00:05,  4.99it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.20]
Epoch 4:  11%|█         | 3/27 [00:00<00:03,  6.61it/s, v_num=0, train_loss_step=85.90, train_loss_epoch=86.20]
Epoch 4:  11%|█         | 3/27 [00:00<00:03,  6.60it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.20]
Epoch 4:  15%|█▍        | 4/27 [00:00<00:02,  7.94it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.20]
Epoch 4:  15%|█▍        | 4/27 [00:00<00:02,  7.93it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.20]
Epoch 4:  19%|█▊        | 5/27 [00:00<00:02,  8.83it/s, v_num=0, train_loss_step=86.00, train_loss_epoch=86.20]
Epoch 4:  19%|█▊        | 5/27 [00:00<00:02,  8.82it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  22%|██▏       | 6/27 [00:00<00:02,  9.63it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  22%|██▏       | 6/27 [00:00<00:02,  9.62it/s, v_num=0, train_loss_step=85.40, train_loss_epoch=86.20]
Epoch 4:  26%|██▌       | 7/27 [00:00<00:01, 10.33it/s, v_num=0, train_loss_step=85.40, train_loss_epoch=86.20]
Epoch 4:  26%|██▌       | 7/27 [00:00<00:01, 10.32it/s, v_num=0, train_loss_step=86.30, train_loss_epoch=86.20]
Epoch 4:  30%|██▉       | 8/27 [00:00<00:01, 10.98it/s, v_num=0, train_loss_step=86.30, train_loss_epoch=86.20]
Epoch 4:  30%|██▉       | 8/27 [00:00<00:01, 10.96it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  33%|███▎      | 9/27 [00:00<00:01, 11.61it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  33%|███▎      | 9/27 [00:00<00:01, 11.60it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  37%|███▋      | 10/27 [00:00<00:01, 12.15it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  37%|███▋      | 10/27 [00:00<00:01, 12.14it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  41%|████      | 11/27 [00:00<00:01, 12.53it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  41%|████      | 11/27 [00:00<00:01, 12.52it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  44%|████▍     | 12/27 [00:00<00:01, 12.81it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  44%|████▍     | 12/27 [00:00<00:01, 12.80it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  48%|████▊     | 13/27 [00:00<00:01, 13.14it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  48%|████▊     | 13/27 [00:00<00:01, 13.13it/s, v_num=0, train_loss_step=85.40, train_loss_epoch=86.20]
Epoch 4:  52%|█████▏    | 14/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=85.40, train_loss_epoch=86.20]
Epoch 4:  52%|█████▏    | 14/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  56%|█████▌    | 15/27 [00:01<00:00, 13.87it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  56%|█████▌    | 15/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  59%|█████▉    | 16/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  59%|█████▉    | 16/27 [00:01<00:00, 14.14it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  63%|██████▎   | 17/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  63%|██████▎   | 17/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4:  67%|██████▋   | 18/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4:  67%|██████▋   | 18/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  70%|███████   | 19/27 [00:01<00:00, 14.82it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  70%|███████   | 19/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  74%|███████▍  | 20/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4:  74%|███████▍  | 20/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=86.20]
Epoch 4:  78%|███████▊  | 21/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=86.20]
Epoch 4:  78%|███████▊  | 21/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=85.20, train_loss_epoch=86.20]
Epoch 4:  81%|████████▏ | 22/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=85.20, train_loss_epoch=86.20]
Epoch 4:  81%|████████▏ | 22/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  85%|████████▌ | 23/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  85%|████████▌ | 23/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4:  89%|████████▉ | 24/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4:  89%|████████▉ | 24/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4:  93%|█████████▎| 25/27 [00:01<00:00, 15.62it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4:  93%|█████████▎| 25/27 [00:01<00:00, 15.61it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  96%|█████████▋| 26/27 [00:01<00:00, 15.79it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=86.20]
Epoch 4:  96%|█████████▋| 26/27 [00:01<00:00, 15.78it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4: 100%|██████████| 27/27 [00:01<00:00, 16.03it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=86.20]
Epoch 4: 100%|██████████| 27/27 [00:01<00:00, 16.02it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=86.20]
Epoch 4: 100%|██████████| 27/27 [00:01<00:00, 16.01it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=85.60]
Epoch 4:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=85.60]         
Epoch 5:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=85.60]
Epoch 5:   4%|▎         | 1/27 [00:00<00:09,  2.86it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=85.60]
Epoch 5:   4%|▎         | 1/27 [00:00<00:09,  2.84it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=85.60]
Epoch 5:   7%|▋         | 2/27 [00:00<00:05,  4.90it/s, v_num=0, train_loss_step=85.70, train_loss_epoch=85.60]
Epoch 5:   7%|▋         | 2/27 [00:00<00:05,  4.89it/s, v_num=0, train_loss_step=85.40, train_loss_epoch=85.60]
Epoch 5:  11%|█         | 3/27 [00:00<00:03,  6.42it/s, v_num=0, train_loss_step=85.40, train_loss_epoch=85.60]
Epoch 5:  11%|█         | 3/27 [00:00<00:03,  6.41it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=85.60]
Epoch 5:  15%|█▍        | 4/27 [00:00<00:03,  7.38it/s, v_num=0, train_loss_step=85.50, train_loss_epoch=85.60]
Epoch 5:  15%|█▍        | 4/27 [00:00<00:03,  7.36it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  19%|█▊        | 5/27 [00:00<00:02,  8.44it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  19%|█▊        | 5/27 [00:00<00:02,  8.43it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  22%|██▏       | 6/27 [00:00<00:02,  9.22it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  22%|██▏       | 6/27 [00:00<00:02,  9.20it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=85.60]
Epoch 5:  26%|██▌       | 7/27 [00:00<00:02,  9.85it/s, v_num=0, train_loss_step=85.60, train_loss_epoch=85.60]
Epoch 5:  26%|██▌       | 7/27 [00:00<00:02,  9.83it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  30%|██▉       | 8/27 [00:00<00:01, 10.45it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  30%|██▉       | 8/27 [00:00<00:01, 10.44it/s, v_num=0, train_loss_step=85.00, train_loss_epoch=85.60]
Epoch 5:  33%|███▎      | 9/27 [00:00<00:01, 10.98it/s, v_num=0, train_loss_step=85.00, train_loss_epoch=85.60]
Epoch 5:  33%|███▎      | 9/27 [00:00<00:01, 10.97it/s, v_num=0, train_loss_step=85.20, train_loss_epoch=85.60]
Epoch 5:  37%|███▋      | 10/27 [00:00<00:01, 11.44it/s, v_num=0, train_loss_step=85.20, train_loss_epoch=85.60]
Epoch 5:  37%|███▋      | 10/27 [00:00<00:01, 11.42it/s, v_num=0, train_loss_step=85.20, train_loss_epoch=85.60]
Epoch 5:  41%|████      | 11/27 [00:00<00:01, 11.87it/s, v_num=0, train_loss_step=85.20, train_loss_epoch=85.60]
Epoch 5:  41%|████      | 11/27 [00:00<00:01, 11.86it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  44%|████▍     | 12/27 [00:00<00:01, 12.24it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  44%|████▍     | 12/27 [00:00<00:01, 12.22it/s, v_num=0, train_loss_step=84.80, train_loss_epoch=85.60]
Epoch 5:  48%|████▊     | 13/27 [00:01<00:01, 12.63it/s, v_num=0, train_loss_step=84.80, train_loss_epoch=85.60]
Epoch 5:  48%|████▊     | 13/27 [00:01<00:01, 12.62it/s, v_num=0, train_loss_step=85.30, train_loss_epoch=85.60]
Epoch 5:  52%|█████▏    | 14/27 [00:01<00:01, 12.95it/s, v_num=0, train_loss_step=85.30, train_loss_epoch=85.60]
Epoch 5:  52%|█████▏    | 14/27 [00:01<00:01, 12.94it/s, v_num=0, train_loss_step=84.70, train_loss_epoch=85.60]
Epoch 5:  56%|█████▌    | 15/27 [00:01<00:00, 13.27it/s, v_num=0, train_loss_step=84.70, train_loss_epoch=85.60]
Epoch 5:  56%|█████▌    | 15/27 [00:01<00:00, 13.24it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.60]
Epoch 5:  59%|█████▉    | 16/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.60]
Epoch 5:  59%|█████▉    | 16/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  63%|██████▎   | 17/27 [00:01<00:00, 13.76it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  63%|██████▎   | 17/27 [00:01<00:00, 13.75it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  67%|██████▋   | 18/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  67%|██████▋   | 18/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  70%|███████   | 19/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  70%|███████   | 19/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  74%|███████▍  | 20/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  74%|███████▍  | 20/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  78%|███████▊  | 21/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  78%|███████▊  | 21/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  81%|████████▏ | 22/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.60]
Epoch 5:  81%|████████▏ | 22/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=85.00, train_loss_epoch=85.60]
Epoch 5:  85%|████████▌ | 23/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=85.00, train_loss_epoch=85.60]
Epoch 5:  85%|████████▌ | 23/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.60]
Epoch 5:  89%|████████▉ | 24/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.60]
Epoch 5:  89%|████████▉ | 24/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  93%|█████████▎| 25/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5:  93%|█████████▎| 25/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=84.80, train_loss_epoch=85.60]
Epoch 5:  96%|█████████▋| 26/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=84.80, train_loss_epoch=85.60]
Epoch 5:  96%|█████████▋| 26/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=84.70, train_loss_epoch=85.60]
Epoch 5: 100%|██████████| 27/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=84.70, train_loss_epoch=85.60]
Epoch 5: 100%|██████████| 27/27 [00:01<00:00, 15.41it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.60]
Epoch 5: 100%|██████████| 27/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.00]
Epoch 5:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.00]         
Epoch 6:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.00]
Epoch 6:   4%|▎         | 1/27 [00:00<00:08,  2.97it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.00]
Epoch 6:   4%|▎         | 1/27 [00:00<00:08,  2.95it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.00]
Epoch 6:   7%|▋         | 2/27 [00:00<00:05,  4.96it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.00]
Epoch 6:   7%|▋         | 2/27 [00:00<00:05,  4.95it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6:  11%|█         | 3/27 [00:00<00:03,  6.47it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6:  11%|█         | 3/27 [00:00<00:03,  6.46it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.00]
Epoch 6:  15%|█▍        | 4/27 [00:00<00:02,  7.67it/s, v_num=0, train_loss_step=84.90, train_loss_epoch=85.00]
Epoch 6:  15%|█▍        | 4/27 [00:00<00:03,  7.66it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  19%|█▊        | 5/27 [00:00<00:02,  8.55it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  19%|█▊        | 5/27 [00:00<00:02,  8.53it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  22%|██▏       | 6/27 [00:00<00:02,  9.23it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  22%|██▏       | 6/27 [00:00<00:02,  9.22it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.00]
Epoch 6:  26%|██▌       | 7/27 [00:00<00:02,  9.97it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.00]
Epoch 6:  26%|██▌       | 7/27 [00:00<00:02,  9.96it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.00]
Epoch 6:  30%|██▉       | 8/27 [00:00<00:01, 10.56it/s, v_num=0, train_loss_step=85.10, train_loss_epoch=85.00]
Epoch 6:  30%|██▉       | 8/27 [00:00<00:01, 10.54it/s, v_num=0, train_loss_step=84.70, train_loss_epoch=85.00]
Epoch 6:  33%|███▎      | 9/27 [00:00<00:01, 11.15it/s, v_num=0, train_loss_step=84.70, train_loss_epoch=85.00]
Epoch 6:  33%|███▎      | 9/27 [00:00<00:01, 11.14it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6:  37%|███▋      | 10/27 [00:00<00:01, 11.67it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6:  37%|███▋      | 10/27 [00:00<00:01, 11.66it/s, v_num=0, train_loss_step=84.50, train_loss_epoch=85.00]
Epoch 6:  41%|████      | 11/27 [00:00<00:01, 12.15it/s, v_num=0, train_loss_step=84.50, train_loss_epoch=85.00]
Epoch 6:  41%|████      | 11/27 [00:00<00:01, 12.14it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=85.00]
Epoch 6:  44%|████▍     | 12/27 [00:00<00:01, 12.56it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=85.00]
Epoch 6:  44%|████▍     | 12/27 [00:00<00:01, 12.54it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6:  48%|████▊     | 13/27 [00:01<00:01, 12.97it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6:  48%|████▊     | 13/27 [00:01<00:01, 12.96it/s, v_num=0, train_loss_step=84.80, train_loss_epoch=85.00]
Epoch 6:  52%|█████▏    | 14/27 [00:01<00:00, 13.31it/s, v_num=0, train_loss_step=84.80, train_loss_epoch=85.00]
Epoch 6:  52%|█████▏    | 14/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=84.80, train_loss_epoch=85.00]
Epoch 6:  56%|█████▌    | 15/27 [00:01<00:00, 13.62it/s, v_num=0, train_loss_step=84.80, train_loss_epoch=85.00]
Epoch 6:  56%|█████▌    | 15/27 [00:01<00:00, 13.61it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  59%|█████▉    | 16/27 [00:01<00:00, 13.89it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  59%|█████▉    | 16/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6:  63%|██████▎   | 17/27 [00:01<00:00, 14.13it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6:  63%|██████▎   | 17/27 [00:01<00:00, 14.12it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=85.00]
Epoch 6:  67%|██████▋   | 18/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=85.00]
Epoch 6:  67%|██████▋   | 18/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=85.00]
Epoch 6:  70%|███████   | 19/27 [00:01<00:00, 14.57it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=85.00]
Epoch 6:  70%|███████   | 19/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  74%|███████▍  | 20/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  74%|███████▍  | 20/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  78%|███████▊  | 21/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6:  78%|███████▊  | 21/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=84.30, train_loss_epoch=85.00]
Epoch 6:  81%|████████▏ | 22/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=84.30, train_loss_epoch=85.00]
Epoch 6:  81%|████████▏ | 22/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=84.30, train_loss_epoch=85.00]
Epoch 6:  85%|████████▌ | 23/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=84.30, train_loss_epoch=85.00]
Epoch 6:  85%|████████▌ | 23/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=85.00]
Epoch 6:  89%|████████▉ | 24/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=85.00]
Epoch 6:  89%|████████▉ | 24/27 [00:01<00:00, 15.41it/s, v_num=0, train_loss_step=84.50, train_loss_epoch=85.00]
Epoch 6:  93%|█████████▎| 25/27 [00:01<00:00, 15.53it/s, v_num=0, train_loss_step=84.50, train_loss_epoch=85.00]
Epoch 6:  93%|█████████▎| 25/27 [00:01<00:00, 15.52it/s, v_num=0, train_loss_step=84.30, train_loss_epoch=85.00]
Epoch 6:  96%|█████████▋| 26/27 [00:01<00:00, 15.59it/s, v_num=0, train_loss_step=84.30, train_loss_epoch=85.00]
Epoch 6:  96%|█████████▋| 26/27 [00:01<00:00, 15.58it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6: 100%|██████████| 27/27 [00:01<00:00, 15.79it/s, v_num=0, train_loss_step=84.60, train_loss_epoch=85.00]
Epoch 6: 100%|██████████| 27/27 [00:01<00:00, 15.78it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=85.00]
Epoch 6: 100%|██████████| 27/27 [00:01<00:00, 15.76it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=84.50]
Epoch 6:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=84.50]         
Epoch 7:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=84.50]
Epoch 7:   4%|▎         | 1/27 [00:00<00:08,  3.16it/s, v_num=0, train_loss_step=84.40, train_loss_epoch=84.50]
Epoch 7:   4%|▎         | 1/27 [00:00<00:08,  3.14it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:   7%|▋         | 2/27 [00:00<00:04,  5.30it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:   7%|▋         | 2/27 [00:00<00:04,  5.29it/s, v_num=0, train_loss_step=84.30, train_loss_epoch=84.50]
Epoch 7:  11%|█         | 3/27 [00:00<00:03,  7.01it/s, v_num=0, train_loss_step=84.30, train_loss_epoch=84.50]
Epoch 7:  11%|█         | 3/27 [00:00<00:03,  6.99it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=84.50]
Epoch 7:  15%|█▍        | 4/27 [00:00<00:02,  8.16it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=84.50]
Epoch 7:  15%|█▍        | 4/27 [00:00<00:02,  8.13it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  19%|█▊        | 5/27 [00:00<00:02,  9.12it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  19%|█▊        | 5/27 [00:00<00:02,  9.10it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:  22%|██▏       | 6/27 [00:00<00:02,  9.86it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:  22%|██▏       | 6/27 [00:00<00:02,  9.85it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=84.50]
Epoch 7:  26%|██▌       | 7/27 [00:00<00:01, 10.56it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=84.50]
Epoch 7:  26%|██▌       | 7/27 [00:00<00:01, 10.55it/s, v_num=0, train_loss_step=84.20, train_loss_epoch=84.50]
Epoch 7:  30%|██▉       | 8/27 [00:00<00:01, 11.12it/s, v_num=0, train_loss_step=84.20, train_loss_epoch=84.50]
Epoch 7:  30%|██▉       | 8/27 [00:00<00:01, 11.11it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=84.50]
Epoch 7:  33%|███▎      | 9/27 [00:00<00:01, 11.72it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=84.50]
Epoch 7:  33%|███▎      | 9/27 [00:00<00:01, 11.70it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:  37%|███▋      | 10/27 [00:00<00:01, 12.18it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:  37%|███▋      | 10/27 [00:00<00:01, 12.17it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  41%|████      | 11/27 [00:00<00:01, 12.62it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  41%|████      | 11/27 [00:00<00:01, 12.61it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  44%|████▍     | 12/27 [00:00<00:01, 12.88it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  44%|████▍     | 12/27 [00:00<00:01, 12.87it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  48%|████▊     | 13/27 [00:00<00:01, 13.24it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  48%|████▊     | 13/27 [00:00<00:01, 13.23it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  52%|█████▏    | 14/27 [00:01<00:00, 13.66it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  52%|█████▏    | 14/27 [00:01<00:00, 13.64it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.50]
Epoch 7:  56%|█████▌    | 15/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.50]
Epoch 7:  56%|█████▌    | 15/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  59%|█████▉    | 16/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  59%|█████▉    | 16/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:  63%|██████▎   | 17/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:  63%|██████▎   | 17/27 [00:01<00:00, 14.53it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:  67%|██████▋   | 18/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.50]
Epoch 7:  67%|██████▋   | 18/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=83.70, train_loss_epoch=84.50]
Epoch 7:  70%|███████   | 19/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=83.70, train_loss_epoch=84.50]
Epoch 7:  70%|███████   | 19/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  74%|███████▍  | 20/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  74%|███████▍  | 20/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.50]
Epoch 7:  78%|███████▊  | 21/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.50]
Epoch 7:  78%|███████▊  | 21/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=84.50, train_loss_epoch=84.50]
Epoch 7:  81%|████████▏ | 22/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=84.50, train_loss_epoch=84.50]
Epoch 7:  81%|████████▏ | 22/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  85%|████████▌ | 23/27 [00:01<00:00, 15.34it/s, v_num=0, train_loss_step=84.00, train_loss_epoch=84.50]
Epoch 7:  85%|████████▌ | 23/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  89%|████████▉ | 24/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  89%|████████▉ | 24/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=84.50]
Epoch 7:  93%|█████████▎| 25/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=83.80, train_loss_epoch=84.50]
Epoch 7:  93%|█████████▎| 25/27 [00:01<00:00, 15.48it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  96%|█████████▋| 26/27 [00:01<00:00, 15.57it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.50]
Epoch 7:  96%|█████████▋| 26/27 [00:01<00:00, 15.56it/s, v_num=0, train_loss_step=84.20, train_loss_epoch=84.50]
Epoch 7: 100%|██████████| 27/27 [00:01<00:00, 15.81it/s, v_num=0, train_loss_step=84.20, train_loss_epoch=84.50]
Epoch 7: 100%|██████████| 27/27 [00:01<00:00, 15.80it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.50]
Epoch 7: 100%|██████████| 27/27 [00:01<00:00, 15.79it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 7:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]         
Epoch 8:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:   4%|▎         | 1/27 [00:00<00:08,  2.97it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:   4%|▎         | 1/27 [00:00<00:08,  2.95it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.00]
Epoch 8:   7%|▋         | 2/27 [00:00<00:04,  5.04it/s, v_num=0, train_loss_step=84.10, train_loss_epoch=84.00]
Epoch 8:   7%|▋         | 2/27 [00:00<00:04,  5.02it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  11%|█         | 3/27 [00:00<00:03,  6.66it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  11%|█         | 3/27 [00:00<00:03,  6.64it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8:  15%|█▍        | 4/27 [00:00<00:02,  7.84it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8:  15%|█▍        | 4/27 [00:00<00:02,  7.83it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8:  19%|█▊        | 5/27 [00:00<00:02,  8.86it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8:  19%|█▊        | 5/27 [00:00<00:02,  8.85it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=84.00]
Epoch 8:  22%|██▏       | 6/27 [00:00<00:02,  9.64it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=84.00]
Epoch 8:  22%|██▏       | 6/27 [00:00<00:02,  9.62it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  26%|██▌       | 7/27 [00:00<00:01, 10.35it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  26%|██▌       | 7/27 [00:00<00:01, 10.33it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8:  30%|██▉       | 8/27 [00:00<00:01, 10.83it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8:  30%|██▉       | 8/27 [00:00<00:01, 10.81it/s, v_num=0, train_loss_step=83.70, train_loss_epoch=84.00]
Epoch 8:  33%|███▎      | 9/27 [00:00<00:01, 11.35it/s, v_num=0, train_loss_step=83.70, train_loss_epoch=84.00]
Epoch 8:  33%|███▎      | 9/27 [00:00<00:01, 11.34it/s, v_num=0, train_loss_step=83.40, train_loss_epoch=84.00]
Epoch 8:  37%|███▋      | 10/27 [00:00<00:01, 11.80it/s, v_num=0, train_loss_step=83.40, train_loss_epoch=84.00]
Epoch 8:  37%|███▋      | 10/27 [00:00<00:01, 11.78it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  41%|████      | 11/27 [00:00<00:01, 12.28it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  41%|████      | 11/27 [00:00<00:01, 12.27it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.00]
Epoch 8:  44%|████▍     | 12/27 [00:00<00:01, 12.65it/s, v_num=0, train_loss_step=83.90, train_loss_epoch=84.00]
Epoch 8:  44%|████▍     | 12/27 [00:00<00:01, 12.64it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  48%|████▊     | 13/27 [00:00<00:01, 13.03it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  48%|████▊     | 13/27 [00:00<00:01, 13.02it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  52%|█████▏    | 14/27 [00:01<00:00, 13.37it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  52%|█████▏    | 14/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=83.30, train_loss_epoch=84.00]
Epoch 8:  56%|█████▌    | 15/27 [00:01<00:00, 13.72it/s, v_num=0, train_loss_step=83.30, train_loss_epoch=84.00]
Epoch 8:  56%|█████▌    | 15/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8:  59%|█████▉    | 16/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8:  59%|█████▉    | 16/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  63%|██████▎   | 17/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  63%|██████▎   | 17/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  67%|██████▋   | 18/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=84.00]
Epoch 8:  67%|██████▋   | 18/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=83.70, train_loss_epoch=84.00]
Epoch 8:  70%|███████   | 19/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=83.70, train_loss_epoch=84.00]
Epoch 8:  70%|███████   | 19/27 [00:01<00:00, 14.53it/s, v_num=0, train_loss_step=83.30, train_loss_epoch=84.00]
Epoch 8:  74%|███████▍  | 20/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=83.30, train_loss_epoch=84.00]
Epoch 8:  74%|███████▍  | 20/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=84.00]
Epoch 8:  78%|███████▊  | 21/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=84.00]
Epoch 8:  78%|███████▊  | 21/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=84.00]
Epoch 8:  81%|████████▏ | 22/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=84.00]
Epoch 8:  81%|████████▏ | 22/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=84.00]
Epoch 8:  85%|████████▌ | 23/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=84.00]
Epoch 8:  85%|████████▌ | 23/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=83.30, train_loss_epoch=84.00]
Epoch 8:  89%|████████▉ | 24/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=83.30, train_loss_epoch=84.00]
Epoch 8:  89%|████████▉ | 24/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=82.70, train_loss_epoch=84.00]
Epoch 8:  93%|█████████▎| 25/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=82.70, train_loss_epoch=84.00]
Epoch 8:  93%|█████████▎| 25/27 [00:01<00:00, 15.48it/s, v_num=0, train_loss_step=83.40, train_loss_epoch=84.00]
Epoch 8:  96%|█████████▋| 26/27 [00:01<00:00, 15.60it/s, v_num=0, train_loss_step=83.40, train_loss_epoch=84.00]
Epoch 8:  96%|█████████▋| 26/27 [00:01<00:00, 15.59it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=84.00]
Epoch 8: 100%|██████████| 27/27 [00:01<00:00, 15.74it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=84.00]
Epoch 8: 100%|██████████| 27/27 [00:01<00:00, 15.73it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=84.00]
Epoch 8: 100%|██████████| 27/27 [00:01<00:00, 15.71it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=83.40]
Epoch 8:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=83.40]         
Epoch 9:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=83.40]
Epoch 9:   4%|▎         | 1/27 [00:00<00:08,  3.10it/s, v_num=0, train_loss_step=83.60, train_loss_epoch=83.40]
Epoch 9:   4%|▎         | 1/27 [00:00<00:08,  3.07it/s, v_num=0, train_loss_step=83.70, train_loss_epoch=83.40]
Epoch 9:   7%|▋         | 2/27 [00:00<00:04,  5.21it/s, v_num=0, train_loss_step=83.70, train_loss_epoch=83.40]
Epoch 9:   7%|▋         | 2/27 [00:00<00:04,  5.19it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=83.40]
Epoch 9:  11%|█         | 3/27 [00:00<00:03,  6.69it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=83.40]
Epoch 9:  11%|█         | 3/27 [00:00<00:03,  6.68it/s, v_num=0, train_loss_step=83.40, train_loss_epoch=83.40]
Epoch 9:  15%|█▍        | 4/27 [00:00<00:02,  7.99it/s, v_num=0, train_loss_step=83.40, train_loss_epoch=83.40]
Epoch 9:  15%|█▍        | 4/27 [00:00<00:02,  7.97it/s, v_num=0, train_loss_step=83.10, train_loss_epoch=83.40]
Epoch 9:  19%|█▊        | 5/27 [00:00<00:02,  8.97it/s, v_num=0, train_loss_step=83.10, train_loss_epoch=83.40]
Epoch 9:  19%|█▊        | 5/27 [00:00<00:02,  8.95it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=83.40]
Epoch 9:  22%|██▏       | 6/27 [00:00<00:02,  9.62it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=83.40]
Epoch 9:  22%|██▏       | 6/27 [00:00<00:02,  9.61it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=83.40]
Epoch 9:  26%|██▌       | 7/27 [00:00<00:01, 10.28it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=83.40]
Epoch 9:  26%|██▌       | 7/27 [00:00<00:01, 10.26it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=83.40]
Epoch 9:  30%|██▉       | 8/27 [00:00<00:01, 10.81it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=83.40]
Epoch 9:  30%|██▉       | 8/27 [00:00<00:01, 10.80it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=83.40]
Epoch 9:  33%|███▎      | 9/27 [00:00<00:01, 11.37it/s, v_num=0, train_loss_step=83.50, train_loss_epoch=83.40]
Epoch 9:  33%|███▎      | 9/27 [00:00<00:01, 11.35it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=83.40]
Epoch 9:  37%|███▋      | 10/27 [00:00<00:01, 11.89it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=83.40]
Epoch 9:  37%|███▋      | 10/27 [00:00<00:01, 11.88it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9:  41%|████      | 11/27 [00:00<00:01, 12.27it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9:  41%|████      | 11/27 [00:00<00:01, 12.26it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=83.40]
Epoch 9:  44%|████▍     | 12/27 [00:00<00:01, 12.71it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=83.40]
Epoch 9:  44%|████▍     | 12/27 [00:00<00:01, 12.70it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=83.40]
Epoch 9:  48%|████▊     | 13/27 [00:01<00:01, 12.93it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=83.40]
Epoch 9:  48%|████▊     | 13/27 [00:01<00:01, 12.92it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=83.40]
Epoch 9:  52%|█████▏    | 14/27 [00:01<00:00, 13.09it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=83.40]
Epoch 9:  52%|█████▏    | 14/27 [00:01<00:00, 13.08it/s, v_num=0, train_loss_step=83.10, train_loss_epoch=83.40]
Epoch 9:  56%|█████▌    | 15/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=83.10, train_loss_epoch=83.40]
Epoch 9:  56%|█████▌    | 15/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9:  59%|█████▉    | 16/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9:  59%|█████▉    | 16/27 [00:01<00:00, 13.50it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=83.40]
Epoch 9:  63%|██████▎   | 17/27 [00:01<00:00, 13.78it/s, v_num=0, train_loss_step=83.20, train_loss_epoch=83.40]
Epoch 9:  63%|██████▎   | 17/27 [00:01<00:00, 13.77it/s, v_num=0, train_loss_step=82.70, train_loss_epoch=83.40]
Epoch 9:  67%|██████▋   | 18/27 [00:01<00:00, 14.02it/s, v_num=0, train_loss_step=82.70, train_loss_epoch=83.40]
Epoch 9:  67%|██████▋   | 18/27 [00:01<00:00, 14.01it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9:  70%|███████   | 19/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9:  70%|███████   | 19/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9:  74%|███████▍  | 20/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9:  74%|███████▍  | 20/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=83.40]
Epoch 9:  78%|███████▊  | 21/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=83.40]
Epoch 9:  78%|███████▊  | 21/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=82.30, train_loss_epoch=83.40]
Epoch 9:  81%|████████▏ | 22/27 [00:01<00:00, 14.70it/s, v_num=0, train_loss_step=82.30, train_loss_epoch=83.40]
Epoch 9:  81%|████████▏ | 22/27 [00:01<00:00, 14.69it/s, v_num=0, train_loss_step=82.70, train_loss_epoch=83.40]
Epoch 9:  85%|████████▌ | 23/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=82.70, train_loss_epoch=83.40]
Epoch 9:  85%|████████▌ | 23/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=83.40]
Epoch 9:  89%|████████▉ | 24/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=83.00, train_loss_epoch=83.40]
Epoch 9:  89%|████████▉ | 24/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=83.40]
Epoch 9:  93%|█████████▎| 25/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=83.40]
Epoch 9:  93%|█████████▎| 25/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=83.40]
Epoch 9:  96%|█████████▋| 26/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=83.40]
Epoch 9:  96%|█████████▋| 26/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9: 100%|██████████| 27/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=83.40]
Epoch 9: 100%|██████████| 27/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=83.40]
Epoch 9: 100%|██████████| 27/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 9:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]         
Epoch 10:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 10:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 10:   4%|▎         | 1/27 [00:00<00:09,  2.88it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:   7%|▋         | 2/27 [00:00<00:04,  5.05it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:   7%|▋         | 2/27 [00:00<00:04,  5.03it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 10:  11%|█         | 3/27 [00:00<00:03,  6.64it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 10:  11%|█         | 3/27 [00:00<00:03,  6.62it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=82.90]
Epoch 10:  15%|█▍        | 4/27 [00:00<00:02,  7.91it/s, v_num=0, train_loss_step=82.90, train_loss_epoch=82.90]
Epoch 10:  15%|█▍        | 4/27 [00:00<00:02,  7.90it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  19%|█▊        | 5/27 [00:00<00:02,  8.91it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  19%|█▊        | 5/27 [00:00<00:02,  8.89it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 10:  22%|██▏       | 6/27 [00:00<00:02,  9.59it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 10:  22%|██▏       | 6/27 [00:00<00:02,  9.58it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  26%|██▌       | 7/27 [00:00<00:01, 10.07it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  26%|██▌       | 7/27 [00:00<00:01, 10.06it/s, v_num=0, train_loss_step=82.70, train_loss_epoch=82.90]
Epoch 10:  30%|██▉       | 8/27 [00:00<00:01, 10.52it/s, v_num=0, train_loss_step=82.70, train_loss_epoch=82.90]
Epoch 10:  30%|██▉       | 8/27 [00:00<00:01, 10.50it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  33%|███▎      | 9/27 [00:00<00:01, 11.06it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  33%|███▎      | 9/27 [00:00<00:01, 11.05it/s, v_num=0, train_loss_step=82.30, train_loss_epoch=82.90]
Epoch 10:  37%|███▋      | 10/27 [00:00<00:01, 11.39it/s, v_num=0, train_loss_step=82.30, train_loss_epoch=82.90]
Epoch 10:  37%|███▋      | 10/27 [00:00<00:01, 11.37it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=82.90]
Epoch 10:  41%|████      | 11/27 [00:00<00:01, 11.73it/s, v_num=0, train_loss_step=82.80, train_loss_epoch=82.90]
Epoch 10:  41%|████      | 11/27 [00:00<00:01, 11.72it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.90]
Epoch 10:  44%|████▍     | 12/27 [00:00<00:01, 12.16it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.90]
Epoch 10:  44%|████▍     | 12/27 [00:00<00:01, 12.15it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  48%|████▊     | 13/27 [00:01<00:01, 12.55it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  48%|████▊     | 13/27 [00:01<00:01, 12.54it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.90]
Epoch 10:  52%|█████▏    | 14/27 [00:01<00:01, 12.88it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.90]
Epoch 10:  52%|█████▏    | 14/27 [00:01<00:01, 12.87it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 10:  56%|█████▌    | 15/27 [00:01<00:00, 13.21it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.90]
Epoch 10:  56%|█████▌    | 15/27 [00:01<00:00, 13.20it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  59%|█████▉    | 16/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  59%|█████▉    | 16/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  63%|██████▎   | 17/27 [00:01<00:00, 13.74it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  63%|██████▎   | 17/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  67%|██████▋   | 18/27 [00:01<00:00, 13.93it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  67%|██████▋   | 18/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=82.40, train_loss_epoch=82.90]
Epoch 10:  70%|███████   | 19/27 [00:01<00:00, 14.12it/s, v_num=0, train_loss_step=82.40, train_loss_epoch=82.90]
Epoch 10:  70%|███████   | 19/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  74%|███████▍  | 20/27 [00:01<00:00, 14.34it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  74%|███████▍  | 20/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.90]
Epoch 10:  78%|███████▊  | 21/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.90]
Epoch 10:  78%|███████▊  | 21/27 [00:01<00:00, 14.49it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.90]
Epoch 10:  81%|████████▏ | 22/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.90]
Epoch 10:  81%|████████▏ | 22/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  85%|████████▌ | 23/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=82.60, train_loss_epoch=82.90]
Epoch 10:  85%|████████▌ | 23/27 [00:01<00:00, 14.82it/s, v_num=0, train_loss_step=82.30, train_loss_epoch=82.90]
Epoch 10:  89%|████████▉ | 24/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=82.30, train_loss_epoch=82.90]
Epoch 10:  89%|████████▉ | 24/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=82.30, train_loss_epoch=82.90]
Epoch 10:  93%|█████████▎| 25/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=82.30, train_loss_epoch=82.90]
Epoch 10:  93%|█████████▎| 25/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.90]
Epoch 10:  96%|█████████▋| 26/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.90]
Epoch 10:  96%|█████████▋| 26/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.90]
Epoch 10: 100%|██████████| 27/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.90]
Epoch 10: 100%|██████████| 27/27 [00:01<00:00, 15.43it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.90]
Epoch 10: 100%|██████████| 27/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 10:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]         
Epoch 11:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:   4%|▎         | 1/27 [00:00<00:08,  2.91it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:   4%|▎         | 1/27 [00:00<00:08,  2.89it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.40]
Epoch 11:   7%|▋         | 2/27 [00:00<00:05,  4.82it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.40]
Epoch 11:   7%|▋         | 2/27 [00:00<00:05,  4.81it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.40]
Epoch 11:  11%|█         | 3/27 [00:00<00:03,  6.38it/s, v_num=0, train_loss_step=82.50, train_loss_epoch=82.40]
Epoch 11:  11%|█         | 3/27 [00:00<00:03,  6.37it/s, v_num=0, train_loss_step=82.20, train_loss_epoch=82.40]
Epoch 11:  15%|█▍        | 4/27 [00:00<00:03,  7.63it/s, v_num=0, train_loss_step=82.20, train_loss_epoch=82.40]
Epoch 11:  15%|█▍        | 4/27 [00:00<00:03,  7.62it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  19%|█▊        | 5/27 [00:00<00:02,  8.45it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  19%|█▊        | 5/27 [00:00<00:02,  8.44it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  22%|██▏       | 6/27 [00:00<00:02,  9.06it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  22%|██▏       | 6/27 [00:00<00:02,  9.05it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  26%|██▌       | 7/27 [00:00<00:02,  9.74it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  26%|██▌       | 7/27 [00:00<00:02,  9.73it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:  30%|██▉       | 8/27 [00:00<00:01, 10.36it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:  30%|██▉       | 8/27 [00:00<00:01, 10.35it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  33%|███▎      | 9/27 [00:00<00:01, 10.94it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  33%|███▎      | 9/27 [00:00<00:01, 10.93it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  37%|███▋      | 10/27 [00:00<00:01, 11.45it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  37%|███▋      | 10/27 [00:00<00:01, 11.44it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:  41%|████      | 11/27 [00:00<00:01, 11.92it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:  41%|████      | 11/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  44%|████▍     | 12/27 [00:00<00:01, 12.35it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  44%|████▍     | 12/27 [00:00<00:01, 12.34it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.40]
Epoch 11:  48%|████▊     | 13/27 [00:01<00:01, 12.74it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.40]
Epoch 11:  48%|████▊     | 13/27 [00:01<00:01, 12.73it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:  52%|█████▏    | 14/27 [00:01<00:00, 13.07it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:  52%|█████▏    | 14/27 [00:01<00:00, 13.06it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.40]
Epoch 11:  56%|█████▌    | 15/27 [00:01<00:00, 13.35it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.40]
Epoch 11:  56%|█████▌    | 15/27 [00:01<00:00, 13.34it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.40]
Epoch 11:  59%|█████▉    | 16/27 [00:01<00:00, 13.60it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.40]
Epoch 11:  59%|█████▉    | 16/27 [00:01<00:00, 13.59it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:  63%|██████▎   | 17/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=82.00, train_loss_epoch=82.40]
Epoch 11:  63%|██████▎   | 17/27 [00:01<00:00, 13.85it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  67%|██████▋   | 18/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  67%|██████▋   | 18/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  70%|███████   | 19/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  70%|███████   | 19/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=81.70, train_loss_epoch=82.40]
Epoch 11:  74%|███████▍  | 20/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=81.70, train_loss_epoch=82.40]
Epoch 11:  74%|███████▍  | 20/27 [00:01<00:00, 14.37it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.40]
Epoch 11:  78%|███████▊  | 21/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=82.10, train_loss_epoch=82.40]
Epoch 11:  78%|███████▊  | 21/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  81%|████████▏ | 22/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  81%|████████▏ | 22/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=81.70, train_loss_epoch=82.40]
Epoch 11:  85%|████████▌ | 23/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=81.70, train_loss_epoch=82.40]
Epoch 11:  85%|████████▌ | 23/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  89%|████████▉ | 24/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=81.90, train_loss_epoch=82.40]
Epoch 11:  89%|████████▉ | 24/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  93%|█████████▎| 25/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=82.40]
Epoch 11:  93%|█████████▎| 25/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=82.40]
Epoch 11:  96%|█████████▋| 26/27 [00:01<00:00, 15.17it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=82.40]
Epoch 11:  96%|█████████▋| 26/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=82.40]
Epoch 11: 100%|██████████| 27/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=82.40]
Epoch 11: 100%|██████████| 27/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=82.40]
Epoch 11: 100%|██████████| 27/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 11:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]         
Epoch 12:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:   4%|▎         | 1/27 [00:00<00:08,  3.03it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:   4%|▎         | 1/27 [00:00<00:08,  3.01it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:   7%|▋         | 2/27 [00:00<00:04,  5.04it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:   7%|▋         | 2/27 [00:00<00:04,  5.03it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  11%|█         | 3/27 [00:00<00:03,  6.73it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  11%|█         | 3/27 [00:00<00:03,  6.72it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=81.90]
Epoch 12:  15%|█▍        | 4/27 [00:00<00:02,  8.07it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=81.90]
Epoch 12:  15%|█▍        | 4/27 [00:00<00:02,  8.05it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  19%|█▊        | 5/27 [00:00<00:02,  8.85it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  19%|█▊        | 5/27 [00:00<00:02,  8.84it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  22%|██▏       | 6/27 [00:00<00:02,  9.50it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  22%|██▏       | 6/27 [00:00<00:02,  9.48it/s, v_num=0, train_loss_step=81.70, train_loss_epoch=81.90]
Epoch 12:  26%|██▌       | 7/27 [00:00<00:01, 10.12it/s, v_num=0, train_loss_step=81.70, train_loss_epoch=81.90]
Epoch 12:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=81.90]
Epoch 12:  30%|██▉       | 8/27 [00:00<00:01, 10.78it/s, v_num=0, train_loss_step=81.80, train_loss_epoch=81.90]
Epoch 12:  30%|██▉       | 8/27 [00:00<00:01, 10.76it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  33%|███▎      | 9/27 [00:00<00:01, 11.21it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  33%|███▎      | 9/27 [00:00<00:01, 11.19it/s, v_num=0, train_loss_step=81.40, train_loss_epoch=81.90]
Epoch 12:  37%|███▋      | 10/27 [00:00<00:01, 11.58it/s, v_num=0, train_loss_step=81.40, train_loss_epoch=81.90]
Epoch 12:  37%|███▋      | 10/27 [00:00<00:01, 11.56it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=81.90]
Epoch 12:  41%|████      | 11/27 [00:00<00:01, 12.04it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=81.90]
Epoch 12:  41%|████      | 11/27 [00:00<00:01, 12.03it/s, v_num=0, train_loss_step=81.40, train_loss_epoch=81.90]
Epoch 12:  44%|████▍     | 12/27 [00:00<00:01, 12.43it/s, v_num=0, train_loss_step=81.40, train_loss_epoch=81.90]
Epoch 12:  44%|████▍     | 12/27 [00:00<00:01, 12.42it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=81.90]
Epoch 12:  48%|████▊     | 13/27 [00:01<00:01, 12.82it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=81.90]
Epoch 12:  48%|████▊     | 13/27 [00:01<00:01, 12.81it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  52%|█████▏    | 14/27 [00:01<00:00, 13.16it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  52%|█████▏    | 14/27 [00:01<00:00, 13.15it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  56%|█████▌    | 15/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  56%|█████▌    | 15/27 [00:01<00:00, 13.42it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  59%|█████▉    | 16/27 [00:01<00:00, 13.68it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  59%|█████▉    | 16/27 [00:01<00:00, 13.67it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  63%|██████▎   | 17/27 [00:01<00:00, 13.93it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  63%|██████▎   | 17/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  67%|██████▋   | 18/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  67%|██████▋   | 18/27 [00:01<00:00, 14.14it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  70%|███████   | 19/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=81.60, train_loss_epoch=81.90]
Epoch 12:  70%|███████   | 19/27 [00:01<00:00, 14.32it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.90]
Epoch 12:  74%|███████▍  | 20/27 [00:01<00:00, 14.53it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.90]
Epoch 12:  74%|███████▍  | 20/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.90]
Epoch 12:  78%|███████▊  | 21/27 [00:01<00:00, 14.70it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.90]
Epoch 12:  78%|███████▊  | 21/27 [00:01<00:00, 14.69it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.90]
Epoch 12:  81%|████████▏ | 22/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.90]
Epoch 12:  81%|████████▏ | 22/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.90]
Epoch 12:  85%|████████▌ | 23/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.90]
Epoch 12:  85%|████████▌ | 23/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.90]
Epoch 12:  89%|████████▉ | 24/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.90]
Epoch 12:  89%|████████▉ | 24/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.90]
Epoch 12:  93%|█████████▎| 25/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.90]
Epoch 12:  93%|█████████▎| 25/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  96%|█████████▋| 26/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12:  96%|█████████▋| 26/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.90]
Epoch 12: 100%|██████████| 27/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.90]
Epoch 12: 100%|██████████| 27/27 [00:01<00:00, 15.43it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.90]
Epoch 12: 100%|██████████| 27/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.40]
Epoch 12:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.40]         
Epoch 13:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.40]
Epoch 13:   4%|▎         | 1/27 [00:00<00:08,  3.05it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.40]
Epoch 13:   4%|▎         | 1/27 [00:00<00:08,  3.03it/s, v_num=0, train_loss_step=81.40, train_loss_epoch=81.40]
Epoch 13:   7%|▋         | 2/27 [00:00<00:04,  5.21it/s, v_num=0, train_loss_step=81.40, train_loss_epoch=81.40]
Epoch 13:   7%|▋         | 2/27 [00:00<00:04,  5.20it/s, v_num=0, train_loss_step=80.90, train_loss_epoch=81.40]
Epoch 13:  11%|█         | 3/27 [00:00<00:03,  6.65it/s, v_num=0, train_loss_step=80.90, train_loss_epoch=81.40]
Epoch 13:  11%|█         | 3/27 [00:00<00:03,  6.63it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  15%|█▍        | 4/27 [00:00<00:02,  7.92it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  15%|█▍        | 4/27 [00:00<00:02,  7.91it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.40]
Epoch 13:  19%|█▊        | 5/27 [00:00<00:02,  8.94it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.40]
Epoch 13:  19%|█▊        | 5/27 [00:00<00:02,  8.92it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.40]
Epoch 13:  22%|██▏       | 6/27 [00:00<00:02,  9.67it/s, v_num=0, train_loss_step=81.50, train_loss_epoch=81.40]
Epoch 13:  22%|██▏       | 6/27 [00:00<00:02,  9.66it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  26%|██▌       | 7/27 [00:00<00:01, 10.46it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  26%|██▌       | 7/27 [00:00<00:01, 10.44it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  30%|██▉       | 8/27 [00:00<00:01, 10.99it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  30%|██▉       | 8/27 [00:00<00:01, 10.98it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=81.40]
Epoch 13:  33%|███▎      | 9/27 [00:00<00:01, 11.55it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=81.40]
Epoch 13:  33%|███▎      | 9/27 [00:00<00:01, 11.53it/s, v_num=0, train_loss_step=80.70, train_loss_epoch=81.40]
Epoch 13:  37%|███▋      | 10/27 [00:00<00:01, 11.98it/s, v_num=0, train_loss_step=80.70, train_loss_epoch=81.40]
Epoch 13:  37%|███▋      | 10/27 [00:00<00:01, 11.96it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.40]
Epoch 13:  41%|████      | 11/27 [00:00<00:01, 12.15it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.40]
Epoch 13:  41%|████      | 11/27 [00:00<00:01, 12.13it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  44%|████▍     | 12/27 [00:00<00:01, 12.61it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  44%|████▍     | 12/27 [00:00<00:01, 12.59it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13:  48%|████▊     | 13/27 [00:01<00:01, 12.96it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13:  48%|████▊     | 13/27 [00:01<00:01, 12.95it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.40]
Epoch 13:  52%|█████▏    | 14/27 [00:01<00:00, 13.31it/s, v_num=0, train_loss_step=81.10, train_loss_epoch=81.40]
Epoch 13:  52%|█████▏    | 14/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13:  56%|█████▌    | 15/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13:  56%|█████▌    | 15/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=81.40]
Epoch 13:  59%|█████▉    | 16/27 [00:01<00:00, 13.82it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=81.40]
Epoch 13:  59%|█████▉    | 16/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13:  63%|██████▎   | 17/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13:  63%|██████▎   | 17/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=81.40]
Epoch 13:  67%|██████▋   | 18/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=81.40]
Epoch 13:  67%|██████▋   | 18/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=80.70, train_loss_epoch=81.40]
Epoch 13:  70%|███████   | 19/27 [00:01<00:00, 14.49it/s, v_num=0, train_loss_step=80.70, train_loss_epoch=81.40]
Epoch 13:  70%|███████   | 19/27 [00:01<00:00, 14.48it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.40]
Epoch 13:  74%|███████▍  | 20/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=81.30, train_loss_epoch=81.40]
Epoch 13:  74%|███████▍  | 20/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=81.40]
Epoch 13:  78%|███████▊  | 21/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=81.40]
Epoch 13:  78%|███████▊  | 21/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  81%|████████▏ | 22/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=81.20, train_loss_epoch=81.40]
Epoch 13:  81%|████████▏ | 22/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=81.40]
Epoch 13:  85%|████████▌ | 23/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=81.40]
Epoch 13:  85%|████████▌ | 23/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=81.40]
Epoch 13:  89%|████████▉ | 24/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=81.40]
Epoch 13:  89%|████████▉ | 24/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13:  93%|█████████▎| 25/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13:  93%|█████████▎| 25/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=80.90, train_loss_epoch=81.40]
Epoch 13:  96%|█████████▋| 26/27 [00:01<00:00, 15.48it/s, v_num=0, train_loss_step=80.90, train_loss_epoch=81.40]
Epoch 13:  96%|█████████▋| 26/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=81.40]
Epoch 13: 100%|██████████| 27/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=81.40]
Epoch 13: 100%|██████████| 27/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=81.40]
Epoch 13: 100%|██████████| 27/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 13:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]         
Epoch 14:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:   4%|▎         | 1/27 [00:00<00:08,  3.00it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:   4%|▎         | 1/27 [00:00<00:08,  2.98it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=80.90]
Epoch 14:   7%|▋         | 2/27 [00:00<00:05,  4.96it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=80.90]
Epoch 14:   7%|▋         | 2/27 [00:00<00:05,  4.95it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=80.90]
Epoch 14:  11%|█         | 3/27 [00:00<00:03,  6.42it/s, v_num=0, train_loss_step=81.00, train_loss_epoch=80.90]
Epoch 14:  11%|█         | 3/27 [00:00<00:03,  6.41it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=80.90]
Epoch 14:  15%|█▍        | 4/27 [00:00<00:03,  7.61it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=80.90]
Epoch 14:  15%|█▍        | 4/27 [00:00<00:03,  7.59it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:  19%|█▊        | 5/27 [00:00<00:02,  8.64it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:  19%|█▊        | 5/27 [00:00<00:02,  8.63it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:  22%|██▏       | 6/27 [00:00<00:02,  9.39it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:  22%|██▏       | 6/27 [00:00<00:02,  9.37it/s, v_num=0, train_loss_step=80.70, train_loss_epoch=80.90]
Epoch 14:  26%|██▌       | 7/27 [00:00<00:01, 10.06it/s, v_num=0, train_loss_step=80.70, train_loss_epoch=80.90]
Epoch 14:  26%|██▌       | 7/27 [00:00<00:01, 10.05it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=80.90]
Epoch 14:  30%|██▉       | 8/27 [00:00<00:01, 10.69it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=80.90]
Epoch 14:  30%|██▉       | 8/27 [00:00<00:01, 10.68it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=80.90]
Epoch 14:  33%|███▎      | 9/27 [00:00<00:01, 11.14it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=80.90]
Epoch 14:  33%|███▎      | 9/27 [00:00<00:01, 11.13it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=80.90]
Epoch 14:  37%|███▋      | 10/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=80.90]
Epoch 14:  37%|███▋      | 10/27 [00:00<00:01, 11.49it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:  41%|████      | 11/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:  41%|████      | 11/27 [00:00<00:01, 11.90it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=80.90]
Epoch 14:  44%|████▍     | 12/27 [00:00<00:01, 12.33it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=80.90]
Epoch 14:  44%|████▍     | 12/27 [00:00<00:01, 12.32it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=80.90]
Epoch 14:  48%|████▊     | 13/27 [00:01<00:01, 12.70it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=80.90]
Epoch 14:  48%|████▊     | 13/27 [00:01<00:01, 12.69it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.90]
Epoch 14:  52%|█████▏    | 14/27 [00:01<00:00, 13.14it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.90]
Epoch 14:  52%|█████▏    | 14/27 [00:01<00:00, 13.13it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=80.90]
Epoch 14:  56%|█████▌    | 15/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=80.90]
Epoch 14:  56%|█████▌    | 15/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=80.90]
Epoch 14:  59%|█████▉    | 16/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=80.60, train_loss_epoch=80.90]
Epoch 14:  59%|█████▉    | 16/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=80.90]
Epoch 14:  63%|██████▎   | 17/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=80.50, train_loss_epoch=80.90]
Epoch 14:  63%|██████▎   | 17/27 [00:01<00:00, 13.90it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:  67%|██████▋   | 18/27 [00:01<00:00, 14.12it/s, v_num=0, train_loss_step=80.80, train_loss_epoch=80.90]
Epoch 14:  67%|██████▋   | 18/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.90]
Epoch 14:  70%|███████   | 19/27 [00:01<00:00, 14.32it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.90]
Epoch 14:  70%|███████   | 19/27 [00:01<00:00, 14.31it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.90]
Epoch 14:  74%|███████▍  | 20/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.90]
Epoch 14:  74%|███████▍  | 20/27 [00:01<00:00, 14.53it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.90]
Epoch 14:  78%|███████▊  | 21/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.90]
Epoch 14:  78%|███████▊  | 21/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.90]
Epoch 14:  81%|████████▏ | 22/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.90]
Epoch 14:  81%|████████▏ | 22/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.90]
Epoch 14:  85%|████████▌ | 23/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.90]
Epoch 14:  85%|████████▌ | 23/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.90]
Epoch 14:  89%|████████▉ | 24/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.90]
Epoch 14:  89%|████████▉ | 24/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=79.80, train_loss_epoch=80.90]
Epoch 14:  93%|█████████▎| 25/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=79.80, train_loss_epoch=80.90]
Epoch 14:  93%|█████████▎| 25/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.90]
Epoch 14:  96%|█████████▋| 26/27 [00:01<00:00, 15.56it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.90]
Epoch 14:  96%|█████████▋| 26/27 [00:01<00:00, 15.55it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=80.90]
Epoch 14: 100%|██████████| 27/27 [00:01<00:00, 15.80it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=80.90]
Epoch 14: 100%|██████████| 27/27 [00:01<00:00, 15.78it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.90]
Epoch 14: 100%|██████████| 27/27 [00:01<00:00, 15.76it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.50]
Epoch 14:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.50]         
Epoch 15:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.50]
Epoch 15:   4%|▎         | 1/27 [00:00<00:08,  2.97it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.50]
Epoch 15:   4%|▎         | 1/27 [00:00<00:08,  2.95it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.50]
Epoch 15:   7%|▋         | 2/27 [00:00<00:04,  5.11it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.50]
Epoch 15:   7%|▋         | 2/27 [00:00<00:04,  5.10it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.50]
Epoch 15:  11%|█         | 3/27 [00:00<00:03,  6.75it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.50]
Epoch 15:  11%|█         | 3/27 [00:00<00:03,  6.74it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.50]
Epoch 15:  15%|█▍        | 4/27 [00:00<00:02,  7.75it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.50]
Epoch 15:  15%|█▍        | 4/27 [00:00<00:02,  7.72it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.50]
Epoch 15:  19%|█▊        | 5/27 [00:00<00:02,  8.85it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.50]
Epoch 15:  19%|█▊        | 5/27 [00:00<00:02,  8.83it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.50]
Epoch 15:  22%|██▏       | 6/27 [00:00<00:02,  9.73it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.50]
Epoch 15:  22%|██▏       | 6/27 [00:00<00:02,  9.72it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=80.50]
Epoch 15:  26%|██▌       | 7/27 [00:00<00:01, 10.43it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=80.50]
Epoch 15:  26%|██▌       | 7/27 [00:00<00:01, 10.42it/s, v_num=0, train_loss_step=79.70, train_loss_epoch=80.50]
Epoch 15:  30%|██▉       | 8/27 [00:00<00:01, 10.98it/s, v_num=0, train_loss_step=79.70, train_loss_epoch=80.50]
Epoch 15:  30%|██▉       | 8/27 [00:00<00:01, 10.97it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.50]
Epoch 15:  33%|███▎      | 9/27 [00:00<00:01, 11.51it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.50]
Epoch 15:  33%|███▎      | 9/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=79.80, train_loss_epoch=80.50]
Epoch 15:  37%|███▋      | 10/27 [00:00<00:01, 12.04it/s, v_num=0, train_loss_step=79.80, train_loss_epoch=80.50]
Epoch 15:  37%|███▋      | 10/27 [00:00<00:01, 12.03it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.50]
Epoch 15:  41%|████      | 11/27 [00:00<00:01, 12.49it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.50]
Epoch 15:  41%|████      | 11/27 [00:00<00:01, 12.47it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  44%|████▍     | 12/27 [00:00<00:01, 12.87it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  44%|████▍     | 12/27 [00:00<00:01, 12.86it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.50]
Epoch 15:  48%|████▊     | 13/27 [00:00<00:01, 13.28it/s, v_num=0, train_loss_step=80.30, train_loss_epoch=80.50]
Epoch 15:  48%|████▊     | 13/27 [00:00<00:01, 13.27it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.50]
Epoch 15:  52%|█████▏    | 14/27 [00:01<00:00, 13.64it/s, v_num=0, train_loss_step=80.20, train_loss_epoch=80.50]
Epoch 15:  52%|█████▏    | 14/27 [00:01<00:00, 13.63it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.50]
Epoch 15:  56%|█████▌    | 15/27 [00:01<00:00, 13.97it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.50]
Epoch 15:  56%|█████▌    | 15/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  59%|█████▉    | 16/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  59%|█████▉    | 16/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=80.50]
Epoch 15:  63%|██████▎   | 17/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=80.40, train_loss_epoch=80.50]
Epoch 15:  63%|██████▎   | 17/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  67%|██████▋   | 18/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  67%|██████▋   | 18/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  70%|███████   | 19/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  70%|███████   | 19/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=79.80, train_loss_epoch=80.50]
Epoch 15:  74%|███████▍  | 20/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=79.80, train_loss_epoch=80.50]
Epoch 15:  74%|███████▍  | 20/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  78%|███████▊  | 21/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15:  78%|███████▊  | 21/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=79.70, train_loss_epoch=80.50]
Epoch 15:  81%|████████▏ | 22/27 [00:01<00:00, 15.59it/s, v_num=0, train_loss_step=79.70, train_loss_epoch=80.50]
Epoch 15:  81%|████████▏ | 22/27 [00:01<00:00, 15.58it/s, v_num=0, train_loss_step=79.60, train_loss_epoch=80.50]
Epoch 15:  85%|████████▌ | 23/27 [00:01<00:00, 15.76it/s, v_num=0, train_loss_step=79.60, train_loss_epoch=80.50]
Epoch 15:  85%|████████▌ | 23/27 [00:01<00:00, 15.75it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.50]
Epoch 15:  89%|████████▉ | 24/27 [00:01<00:00, 15.89it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.50]
Epoch 15:  89%|████████▉ | 24/27 [00:01<00:00, 15.88it/s, v_num=0, train_loss_step=79.60, train_loss_epoch=80.50]
Epoch 15:  93%|█████████▎| 25/27 [00:01<00:00, 15.93it/s, v_num=0, train_loss_step=79.60, train_loss_epoch=80.50]
Epoch 15:  93%|█████████▎| 25/27 [00:01<00:00, 15.91it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.50]
Epoch 15:  96%|█████████▋| 26/27 [00:01<00:00, 16.09it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.50]
Epoch 15:  96%|█████████▋| 26/27 [00:01<00:00, 16.07it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15: 100%|██████████| 27/27 [00:01<00:00, 16.28it/s, v_num=0, train_loss_step=80.00, train_loss_epoch=80.50]
Epoch 15: 100%|██████████| 27/27 [00:01<00:00, 16.27it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=80.50]
Epoch 15: 100%|██████████| 27/27 [00:01<00:00, 16.25it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=80.00]
Epoch 15:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=80.00]         
Epoch 16:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=80.00]
Epoch 16:   4%|▎         | 1/27 [00:00<00:09,  2.81it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=80.00]
Epoch 16:   4%|▎         | 1/27 [00:00<00:09,  2.79it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.00]
Epoch 16:   7%|▋         | 2/27 [00:00<00:05,  4.88it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.00]
Epoch 16:   7%|▋         | 2/27 [00:00<00:05,  4.87it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  11%|█         | 3/27 [00:00<00:03,  6.47it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  11%|█         | 3/27 [00:00<00:03,  6.46it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.00]
Epoch 16:  15%|█▍        | 4/27 [00:00<00:02,  7.77it/s, v_num=0, train_loss_step=79.90, train_loss_epoch=80.00]
Epoch 16:  15%|█▍        | 4/27 [00:00<00:02,  7.75it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  19%|█▊        | 5/27 [00:00<00:02,  8.67it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  19%|█▊        | 5/27 [00:00<00:02,  8.66it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.00]
Epoch 16:  22%|██▏       | 6/27 [00:00<00:02,  9.42it/s, v_num=0, train_loss_step=80.10, train_loss_epoch=80.00]
Epoch 16:  22%|██▏       | 6/27 [00:00<00:02,  9.40it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  26%|██▌       | 7/27 [00:00<00:01, 10.13it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  30%|██▉       | 8/27 [00:00<00:01, 10.70it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  30%|██▉       | 8/27 [00:00<00:01, 10.69it/s, v_num=0, train_loss_step=79.60, train_loss_epoch=80.00]
Epoch 16:  33%|███▎      | 9/27 [00:00<00:01, 11.26it/s, v_num=0, train_loss_step=79.60, train_loss_epoch=80.00]
Epoch 16:  33%|███▎      | 9/27 [00:00<00:01, 11.25it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  37%|███▋      | 10/27 [00:00<00:01, 11.79it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  37%|███▋      | 10/27 [00:00<00:01, 11.78it/s, v_num=0, train_loss_step=79.80, train_loss_epoch=80.00]
Epoch 16:  41%|████      | 11/27 [00:00<00:01, 12.17it/s, v_num=0, train_loss_step=79.80, train_loss_epoch=80.00]
Epoch 16:  41%|████      | 11/27 [00:00<00:01, 12.15it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  44%|████▍     | 12/27 [00:00<00:01, 12.66it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  44%|████▍     | 12/27 [00:00<00:01, 12.63it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  48%|████▊     | 13/27 [00:00<00:01, 13.07it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  48%|████▊     | 13/27 [00:00<00:01, 13.06it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  52%|█████▏    | 14/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  52%|█████▏    | 14/27 [00:01<00:00, 13.28it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  56%|█████▌    | 15/27 [00:01<00:00, 13.53it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  56%|█████▌    | 15/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  59%|█████▉    | 16/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  59%|█████▉    | 16/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  63%|██████▎   | 17/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  63%|██████▎   | 17/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  67%|██████▋   | 18/27 [00:01<00:00, 14.24it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  67%|██████▋   | 18/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=79.20, train_loss_epoch=80.00]
Epoch 16:  70%|███████   | 19/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=79.20, train_loss_epoch=80.00]
Epoch 16:  70%|███████   | 19/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  74%|███████▍  | 20/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  74%|███████▍  | 20/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  78%|███████▊  | 21/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  78%|███████▊  | 21/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  81%|████████▏ | 22/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16:  81%|████████▏ | 22/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  85%|████████▌ | 23/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  85%|████████▌ | 23/27 [00:01<00:00, 15.17it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  89%|████████▉ | 24/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=79.40, train_loss_epoch=80.00]
Epoch 16:  89%|████████▉ | 24/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=79.20, train_loss_epoch=80.00]
Epoch 16:  93%|█████████▎| 25/27 [00:01<00:00, 15.52it/s, v_num=0, train_loss_step=79.20, train_loss_epoch=80.00]
Epoch 16:  93%|█████████▎| 25/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  96%|█████████▋| 26/27 [00:01<00:00, 15.62it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16:  96%|█████████▋| 26/27 [00:01<00:00, 15.61it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16: 100%|██████████| 27/27 [00:01<00:00, 15.86it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=80.00]
Epoch 16: 100%|██████████| 27/27 [00:01<00:00, 15.86it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=80.00]
Epoch 16: 100%|██████████| 27/27 [00:01<00:00, 15.84it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=79.50]
Epoch 16:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=79.50]         
Epoch 17:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=79.50]
Epoch 17:   4%|▎         | 1/27 [00:00<00:09,  2.70it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=79.50]
Epoch 17:   4%|▎         | 1/27 [00:00<00:09,  2.68it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=79.50]
Epoch 17:   7%|▋         | 2/27 [00:00<00:05,  4.79it/s, v_num=0, train_loss_step=79.30, train_loss_epoch=79.50]
Epoch 17:   7%|▋         | 2/27 [00:00<00:05,  4.78it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=79.50]
Epoch 17:  11%|█         | 3/27 [00:00<00:03,  6.41it/s, v_num=0, train_loss_step=79.50, train_loss_epoch=79.50]
Epoch 17:  11%|█         | 3/27 [00:00<00:03,  6.40it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  15%|█▍        | 4/27 [00:00<00:02,  7.77it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  15%|█▍        | 4/27 [00:00<00:02,  7.76it/s, v_num=0, train_loss_step=79.60, train_loss_epoch=79.50]
Epoch 17:  19%|█▊        | 5/27 [00:00<00:02,  8.66it/s, v_num=0, train_loss_step=79.60, train_loss_epoch=79.50]
Epoch 17:  19%|█▊        | 5/27 [00:00<00:02,  8.64it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  22%|██▏       | 6/27 [00:00<00:02,  9.66it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  22%|██▏       | 6/27 [00:00<00:02,  9.64it/s, v_num=0, train_loss_step=79.20, train_loss_epoch=79.50]
Epoch 17:  26%|██▌       | 7/27 [00:00<00:01, 10.18it/s, v_num=0, train_loss_step=79.20, train_loss_epoch=79.50]
Epoch 17:  26%|██▌       | 7/27 [00:00<00:01, 10.17it/s, v_num=0, train_loss_step=79.00, train_loss_epoch=79.50]
Epoch 17:  30%|██▉       | 8/27 [00:00<00:01, 11.01it/s, v_num=0, train_loss_step=79.00, train_loss_epoch=79.50]
Epoch 17:  30%|██▉       | 8/27 [00:00<00:01, 10.99it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  33%|███▎      | 9/27 [00:00<00:01, 11.65it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  33%|███▎      | 9/27 [00:00<00:01, 11.63it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  37%|███▋      | 10/27 [00:00<00:01, 12.32it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  37%|███▋      | 10/27 [00:00<00:01, 12.31it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.50]
Epoch 17:  41%|████      | 11/27 [00:00<00:01, 12.71it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.50]
Epoch 17:  41%|████      | 11/27 [00:00<00:01, 12.69it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  44%|████▍     | 12/27 [00:00<00:01, 13.13it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  44%|████▍     | 12/27 [00:00<00:01, 13.12it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  48%|████▊     | 13/27 [00:00<00:01, 13.44it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  48%|████▊     | 13/27 [00:00<00:01, 13.43it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.50]
Epoch 17:  52%|█████▏    | 14/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.50]
Epoch 17:  52%|█████▏    | 14/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  56%|█████▌    | 15/27 [00:01<00:00, 14.08it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  56%|█████▌    | 15/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=79.20, train_loss_epoch=79.50]
Epoch 17:  59%|█████▉    | 16/27 [00:01<00:00, 14.34it/s, v_num=0, train_loss_step=79.20, train_loss_epoch=79.50]
Epoch 17:  59%|█████▉    | 16/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  63%|██████▎   | 17/27 [00:01<00:00, 14.53it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  63%|██████▎   | 17/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.50]
Epoch 17:  67%|██████▋   | 18/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.50]
Epoch 17:  67%|██████▋   | 18/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=78.50, train_loss_epoch=79.50]
Epoch 17:  70%|███████   | 19/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=78.50, train_loss_epoch=79.50]
Epoch 17:  70%|███████   | 19/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  74%|███████▍  | 20/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  74%|███████▍  | 20/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.50]
Epoch 17:  78%|███████▊  | 21/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.50]
Epoch 17:  78%|███████▊  | 21/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  81%|████████▏ | 22/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=79.10, train_loss_epoch=79.50]
Epoch 17:  81%|████████▏ | 22/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=79.00, train_loss_epoch=79.50]
Epoch 17:  85%|████████▌ | 23/27 [00:01<00:00, 15.41it/s, v_num=0, train_loss_step=79.00, train_loss_epoch=79.50]
Epoch 17:  85%|████████▌ | 23/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  89%|████████▉ | 24/27 [00:01<00:00, 15.56it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  89%|████████▉ | 24/27 [00:01<00:00, 15.55it/s, v_num=0, train_loss_step=79.00, train_loss_epoch=79.50]
Epoch 17:  93%|█████████▎| 25/27 [00:01<00:00, 15.67it/s, v_num=0, train_loss_step=79.00, train_loss_epoch=79.50]
Epoch 17:  93%|█████████▎| 25/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  96%|█████████▋| 26/27 [00:01<00:00, 15.82it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.50]
Epoch 17:  96%|█████████▋| 26/27 [00:01<00:00, 15.81it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.50]
Epoch 17: 100%|██████████| 27/27 [00:01<00:00, 16.01it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.50]
Epoch 17: 100%|██████████| 27/27 [00:01<00:00, 16.00it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.50]
Epoch 17: 100%|██████████| 27/27 [00:01<00:00, 15.99it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 17:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]         
Epoch 18:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:   4%|▎         | 1/27 [00:00<00:09,  2.86it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:   4%|▎         | 1/27 [00:00<00:09,  2.84it/s, v_num=0, train_loss_step=78.70, train_loss_epoch=79.00]
Epoch 18:   7%|▋         | 2/27 [00:00<00:05,  4.73it/s, v_num=0, train_loss_step=78.70, train_loss_epoch=79.00]
Epoch 18:   7%|▋         | 2/27 [00:00<00:05,  4.72it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.00]
Epoch 18:  11%|█         | 3/27 [00:00<00:03,  6.31it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.00]
Epoch 18:  11%|█         | 3/27 [00:00<00:03,  6.30it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  15%|█▍        | 4/27 [00:00<00:03,  7.53it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  15%|█▍        | 4/27 [00:00<00:03,  7.52it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  19%|█▊        | 5/27 [00:00<00:02,  8.60it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  19%|█▊        | 5/27 [00:00<00:02,  8.59it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.00]
Epoch 18:  22%|██▏       | 6/27 [00:00<00:02,  9.32it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.00]
Epoch 18:  22%|██▏       | 6/27 [00:00<00:02,  9.30it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  26%|██▌       | 7/27 [00:00<00:02,  9.94it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  26%|██▌       | 7/27 [00:00<00:02,  9.92it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.00]
Epoch 18:  30%|██▉       | 8/27 [00:00<00:01, 10.50it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.00]
Epoch 18:  30%|██▉       | 8/27 [00:00<00:01, 10.49it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.00]
Epoch 18:  33%|███▎      | 9/27 [00:00<00:01, 11.05it/s, v_num=0, train_loss_step=78.90, train_loss_epoch=79.00]
Epoch 18:  33%|███▎      | 9/27 [00:00<00:01, 11.04it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.00]
Epoch 18:  37%|███▋      | 10/27 [00:00<00:01, 11.55it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.00]
Epoch 18:  37%|███▋      | 10/27 [00:00<00:01, 11.54it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.00]
Epoch 18:  41%|████      | 11/27 [00:00<00:01, 11.85it/s, v_num=0, train_loss_step=78.80, train_loss_epoch=79.00]
Epoch 18:  41%|████      | 11/27 [00:00<00:01, 11.83it/s, v_num=0, train_loss_step=78.00, train_loss_epoch=79.00]
Epoch 18:  44%|████▍     | 12/27 [00:00<00:01, 12.30it/s, v_num=0, train_loss_step=78.00, train_loss_epoch=79.00]
Epoch 18:  44%|████▍     | 12/27 [00:00<00:01, 12.28it/s, v_num=0, train_loss_step=77.90, train_loss_epoch=79.00]
Epoch 18:  48%|████▊     | 13/27 [00:01<00:01, 12.52it/s, v_num=0, train_loss_step=77.90, train_loss_epoch=79.00]
Epoch 18:  48%|████▊     | 13/27 [00:01<00:01, 12.50it/s, v_num=0, train_loss_step=78.70, train_loss_epoch=79.00]
Epoch 18:  52%|█████▏    | 14/27 [00:01<00:01, 12.90it/s, v_num=0, train_loss_step=78.70, train_loss_epoch=79.00]
Epoch 18:  52%|█████▏    | 14/27 [00:01<00:01, 12.89it/s, v_num=0, train_loss_step=78.30, train_loss_epoch=79.00]
Epoch 18:  56%|█████▌    | 15/27 [00:01<00:00, 13.22it/s, v_num=0, train_loss_step=78.30, train_loss_epoch=79.00]
Epoch 18:  56%|█████▌    | 15/27 [00:01<00:00, 13.21it/s, v_num=0, train_loss_step=78.30, train_loss_epoch=79.00]
Epoch 18:  59%|█████▉    | 16/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=78.30, train_loss_epoch=79.00]
Epoch 18:  59%|█████▉    | 16/27 [00:01<00:00, 13.49it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  63%|██████▎   | 17/27 [00:01<00:00, 13.78it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  63%|██████▎   | 17/27 [00:01<00:00, 13.77it/s, v_num=0, train_loss_step=78.50, train_loss_epoch=79.00]
Epoch 18:  67%|██████▋   | 18/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=78.50, train_loss_epoch=79.00]
Epoch 18:  67%|██████▋   | 18/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=78.50, train_loss_epoch=79.00]
Epoch 18:  70%|███████   | 19/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=78.50, train_loss_epoch=79.00]
Epoch 18:  70%|███████   | 19/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=79.00]
Epoch 18:  74%|███████▍  | 20/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=79.00]
Epoch 18:  74%|███████▍  | 20/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=78.30, train_loss_epoch=79.00]
Epoch 18:  78%|███████▊  | 21/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=78.30, train_loss_epoch=79.00]
Epoch 18:  78%|███████▊  | 21/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=78.40, train_loss_epoch=79.00]
Epoch 18:  81%|████████▏ | 22/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=78.40, train_loss_epoch=79.00]
Epoch 18:  81%|████████▏ | 22/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=78.70, train_loss_epoch=79.00]
Epoch 18:  85%|████████▌ | 23/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=78.70, train_loss_epoch=79.00]
Epoch 18:  85%|████████▌ | 23/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=78.40, train_loss_epoch=79.00]
Epoch 18:  89%|████████▉ | 24/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=78.40, train_loss_epoch=79.00]
Epoch 18:  89%|████████▉ | 24/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=79.00]
Epoch 18:  93%|█████████▎| 25/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=79.00]
Epoch 18:  93%|█████████▎| 25/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  96%|█████████▋| 26/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=79.00]
Epoch 18:  96%|█████████▋| 26/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=78.30, train_loss_epoch=79.00]
Epoch 18: 100%|██████████| 27/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=78.30, train_loss_epoch=79.00]
Epoch 18: 100%|██████████| 27/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=79.00]
Epoch 18: 100%|██████████| 27/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 18:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]         
Epoch 19:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:   4%|▎         | 1/27 [00:00<00:09,  2.88it/s, v_num=0, train_loss_step=78.70, train_loss_epoch=78.50]
Epoch 19:   7%|▋         | 2/27 [00:00<00:04,  5.05it/s, v_num=0, train_loss_step=78.70, train_loss_epoch=78.50]
Epoch 19:   7%|▋         | 2/27 [00:00<00:04,  5.04it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  11%|█         | 3/27 [00:00<00:03,  6.54it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  11%|█         | 3/27 [00:00<00:03,  6.53it/s, v_num=0, train_loss_step=78.00, train_loss_epoch=78.50]
Epoch 19:  15%|█▍        | 4/27 [00:00<00:02,  7.81it/s, v_num=0, train_loss_step=78.00, train_loss_epoch=78.50]
Epoch 19:  15%|█▍        | 4/27 [00:00<00:02,  7.79it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  19%|█▊        | 5/27 [00:00<00:02,  8.85it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  19%|█▊        | 5/27 [00:00<00:02,  8.84it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  22%|██▏       | 6/27 [00:00<00:02,  9.72it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  22%|██▏       | 6/27 [00:00<00:02,  9.71it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  26%|██▌       | 7/27 [00:00<00:01, 10.23it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  26%|██▌       | 7/27 [00:00<00:01, 10.22it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  30%|██▉       | 8/27 [00:00<00:01, 10.80it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  30%|██▉       | 8/27 [00:00<00:01, 10.79it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  33%|███▎      | 9/27 [00:00<00:01, 11.30it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  33%|███▎      | 9/27 [00:00<00:01, 11.28it/s, v_num=0, train_loss_step=78.40, train_loss_epoch=78.50]
Epoch 19:  37%|███▋      | 10/27 [00:00<00:01, 11.76it/s, v_num=0, train_loss_step=78.40, train_loss_epoch=78.50]
Epoch 19:  37%|███▋      | 10/27 [00:00<00:01, 11.75it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  41%|████      | 11/27 [00:00<00:01, 12.04it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  41%|████      | 11/27 [00:00<00:01, 12.03it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.50]
Epoch 19:  44%|████▍     | 12/27 [00:00<00:01, 12.44it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.50]
Epoch 19:  44%|████▍     | 12/27 [00:00<00:01, 12.43it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  48%|████▊     | 13/27 [00:01<00:01, 12.81it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  48%|████▊     | 13/27 [00:01<00:01, 12.80it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  52%|█████▏    | 14/27 [00:01<00:00, 13.10it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  52%|█████▏    | 14/27 [00:01<00:00, 13.09it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=78.50]
Epoch 19:  56%|█████▌    | 15/27 [00:01<00:00, 13.44it/s, v_num=0, train_loss_step=78.60, train_loss_epoch=78.50]
Epoch 19:  56%|█████▌    | 15/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  59%|█████▉    | 16/27 [00:01<00:00, 13.63it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  59%|█████▉    | 16/27 [00:01<00:00, 13.61it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.50]
Epoch 19:  63%|██████▎   | 17/27 [00:01<00:00, 13.85it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.50]
Epoch 19:  63%|██████▎   | 17/27 [00:01<00:00, 13.83it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  67%|██████▋   | 18/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=78.20, train_loss_epoch=78.50]
Epoch 19:  67%|██████▋   | 18/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.50]
Epoch 19:  70%|███████   | 19/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.50]
Epoch 19:  70%|███████   | 19/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.50]
Epoch 19:  74%|███████▍  | 20/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.50]
Epoch 19:  74%|███████▍  | 20/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=78.00, train_loss_epoch=78.50]
Epoch 19:  78%|███████▊  | 21/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=78.00, train_loss_epoch=78.50]
Epoch 19:  78%|███████▊  | 21/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=77.90, train_loss_epoch=78.50]
Epoch 19:  81%|████████▏ | 22/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=77.90, train_loss_epoch=78.50]
Epoch 19:  81%|████████▏ | 22/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  85%|████████▌ | 23/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=78.10, train_loss_epoch=78.50]
Epoch 19:  85%|████████▌ | 23/27 [00:01<00:00, 14.82it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.50]
Epoch 19:  89%|████████▉ | 24/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.50]
Epoch 19:  89%|████████▉ | 24/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.50]
Epoch 19:  93%|█████████▎| 25/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.50]
Epoch 19:  93%|█████████▎| 25/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.50]
Epoch 19:  96%|█████████▋| 26/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.50]
Epoch 19:  96%|█████████▋| 26/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.50]
Epoch 19: 100%|██████████| 27/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.50]
Epoch 19: 100%|██████████| 27/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.50]
Epoch 19: 100%|██████████| 27/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.00]
Epoch 19:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.00]         
Epoch 20:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.00]
Epoch 20:   4%|▎         | 1/27 [00:00<00:09,  2.82it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.00]
Epoch 20:   4%|▎         | 1/27 [00:00<00:09,  2.80it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.00]
Epoch 20:   7%|▋         | 2/27 [00:00<00:05,  4.84it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.00]
Epoch 20:   7%|▋         | 2/27 [00:00<00:05,  4.83it/s, v_num=0, train_loss_step=77.90, train_loss_epoch=78.00]
Epoch 20:  11%|█         | 3/27 [00:00<00:03,  6.36it/s, v_num=0, train_loss_step=77.90, train_loss_epoch=78.00]
Epoch 20:  11%|█         | 3/27 [00:00<00:03,  6.35it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.00]
Epoch 20:  15%|█▍        | 4/27 [00:00<00:02,  7.69it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.00]
Epoch 20:  15%|█▍        | 4/27 [00:00<00:02,  7.67it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  19%|█▊        | 5/27 [00:00<00:02,  8.77it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  19%|█▊        | 5/27 [00:00<00:02,  8.75it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.00]
Epoch 20:  22%|██▏       | 6/27 [00:00<00:02,  9.50it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.00]
Epoch 20:  22%|██▏       | 6/27 [00:00<00:02,  9.48it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.00]
Epoch 20:  26%|██▌       | 7/27 [00:00<00:01, 10.30it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.00]
Epoch 20:  26%|██▌       | 7/27 [00:00<00:01, 10.28it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.00]
Epoch 20:  30%|██▉       | 8/27 [00:00<00:01, 10.87it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.00]
Epoch 20:  30%|██▉       | 8/27 [00:00<00:01, 10.85it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=78.00]
Epoch 20:  33%|███▎      | 9/27 [00:00<00:01, 11.47it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=78.00]
Epoch 20:  33%|███▎      | 9/27 [00:00<00:01, 11.46it/s, v_num=0, train_loss_step=78.00, train_loss_epoch=78.00]
Epoch 20:  37%|███▋      | 10/27 [00:00<00:01, 11.96it/s, v_num=0, train_loss_step=78.00, train_loss_epoch=78.00]
Epoch 20:  37%|███▋      | 10/27 [00:00<00:01, 11.95it/s, v_num=0, train_loss_step=77.30, train_loss_epoch=78.00]
Epoch 20:  41%|████      | 11/27 [00:00<00:01, 12.37it/s, v_num=0, train_loss_step=77.30, train_loss_epoch=78.00]
Epoch 20:  41%|████      | 11/27 [00:00<00:01, 12.35it/s, v_num=0, train_loss_step=77.90, train_loss_epoch=78.00]
Epoch 20:  44%|████▍     | 12/27 [00:00<00:01, 12.73it/s, v_num=0, train_loss_step=77.90, train_loss_epoch=78.00]
Epoch 20:  44%|████▍     | 12/27 [00:00<00:01, 12.71it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  48%|████▊     | 13/27 [00:00<00:01, 13.09it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  48%|████▊     | 13/27 [00:00<00:01, 13.08it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.00]
Epoch 20:  52%|█████▏    | 14/27 [00:01<00:00, 13.39it/s, v_num=0, train_loss_step=77.70, train_loss_epoch=78.00]
Epoch 20:  52%|█████▏    | 14/27 [00:01<00:00, 13.38it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.00]
Epoch 20:  56%|█████▌    | 15/27 [00:01<00:00, 13.64it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.00]
Epoch 20:  56%|█████▌    | 15/27 [00:01<00:00, 13.63it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.00]
Epoch 20:  59%|█████▉    | 16/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=77.80, train_loss_epoch=78.00]
Epoch 20:  59%|█████▉    | 16/27 [00:01<00:00, 13.93it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.00]
Epoch 20:  63%|██████▎   | 17/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.00]
Epoch 20:  63%|██████▎   | 17/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  67%|██████▋   | 18/27 [00:01<00:00, 14.31it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  67%|██████▋   | 18/27 [00:01<00:00, 14.30it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.00]
Epoch 20:  70%|███████   | 19/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.00]
Epoch 20:  70%|███████   | 19/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.00]
Epoch 20:  74%|███████▍  | 20/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.00]
Epoch 20:  74%|███████▍  | 20/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.00]
Epoch 20:  78%|███████▊  | 21/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=77.50, train_loss_epoch=78.00]
Epoch 20:  78%|███████▊  | 21/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  81%|████████▏ | 22/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  81%|████████▏ | 22/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  85%|████████▌ | 23/27 [00:01<00:00, 15.08it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  85%|████████▌ | 23/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  89%|████████▉ | 24/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=78.00]
Epoch 20:  89%|████████▉ | 24/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.00]
Epoch 20:  93%|█████████▎| 25/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=78.00]
Epoch 20:  93%|█████████▎| 25/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=78.00]
Epoch 20:  96%|█████████▋| 26/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=78.00]
Epoch 20:  96%|█████████▋| 26/27 [00:01<00:00, 15.45it/s, v_num=0, train_loss_step=77.30, train_loss_epoch=78.00]
Epoch 20: 100%|██████████| 27/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=77.30, train_loss_epoch=78.00]
Epoch 20: 100%|██████████| 27/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=78.00]
Epoch 20: 100%|██████████| 27/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 20:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]         
Epoch 21:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:   4%|▎         | 1/27 [00:00<00:09,  2.81it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:   4%|▎         | 1/27 [00:00<00:09,  2.79it/s, v_num=0, train_loss_step=77.30, train_loss_epoch=77.50]
Epoch 21:   7%|▋         | 2/27 [00:00<00:05,  4.79it/s, v_num=0, train_loss_step=77.30, train_loss_epoch=77.50]
Epoch 21:   7%|▋         | 2/27 [00:00<00:05,  4.78it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.50]
Epoch 21:  11%|█         | 3/27 [00:00<00:03,  6.17it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.50]
Epoch 21:  11%|█         | 3/27 [00:00<00:03,  6.16it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21:  15%|█▍        | 4/27 [00:00<00:03,  7.22it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21:  15%|█▍        | 4/27 [00:00<00:03,  7.21it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=77.50]
Epoch 21:  19%|█▊        | 5/27 [00:00<00:02,  8.11it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=77.50]
Epoch 21:  19%|█▊        | 5/27 [00:00<00:02,  8.09it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=77.50]
Epoch 21:  22%|██▏       | 6/27 [00:00<00:02,  8.94it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=77.50]
Epoch 21:  22%|██▏       | 6/27 [00:00<00:02,  8.93it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.50]
Epoch 21:  26%|██▌       | 7/27 [00:00<00:02,  9.65it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.50]
Epoch 21:  26%|██▌       | 7/27 [00:00<00:02,  9.63it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  30%|██▉       | 8/27 [00:00<00:01, 10.19it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  30%|██▉       | 8/27 [00:00<00:01, 10.17it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.50]
Epoch 21:  33%|███▎      | 9/27 [00:00<00:01, 10.75it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.50]
Epoch 21:  33%|███▎      | 9/27 [00:00<00:01, 10.73it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  37%|███▋      | 10/27 [00:00<00:01, 11.24it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  37%|███▋      | 10/27 [00:00<00:01, 11.23it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  41%|████      | 11/27 [00:00<00:01, 11.67it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  41%|████      | 11/27 [00:00<00:01, 11.66it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.50]
Epoch 21:  44%|████▍     | 12/27 [00:00<00:01, 12.06it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.50]
Epoch 21:  44%|████▍     | 12/27 [00:00<00:01, 12.05it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21:  48%|████▊     | 13/27 [00:01<00:01, 12.45it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21:  48%|████▊     | 13/27 [00:01<00:01, 12.44it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  52%|█████▏    | 14/27 [00:01<00:01, 12.79it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  52%|█████▏    | 14/27 [00:01<00:01, 12.78it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21:  56%|█████▌    | 15/27 [00:01<00:00, 13.14it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21:  56%|█████▌    | 15/27 [00:01<00:00, 13.13it/s, v_num=0, train_loss_step=76.90, train_loss_epoch=77.50]
Epoch 21:  59%|█████▉    | 16/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=76.90, train_loss_epoch=77.50]
Epoch 21:  59%|█████▉    | 16/27 [00:01<00:00, 13.34it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.50]
Epoch 21:  63%|██████▎   | 17/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.50]
Epoch 21:  63%|██████▎   | 17/27 [00:01<00:00, 13.55it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=77.50]
Epoch 21:  67%|██████▋   | 18/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=77.60, train_loss_epoch=77.50]
Epoch 21:  67%|██████▋   | 18/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.50]
Epoch 21:  70%|███████   | 19/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.50]
Epoch 21:  70%|███████   | 19/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=77.50]
Epoch 21:  74%|███████▍  | 20/27 [00:01<00:00, 14.20it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=77.50]
Epoch 21:  74%|███████▍  | 20/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=77.50]
Epoch 21:  78%|███████▊  | 21/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=77.40, train_loss_epoch=77.50]
Epoch 21:  78%|███████▊  | 21/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  81%|████████▏ | 22/27 [00:01<00:00, 14.48it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21:  81%|████████▏ | 22/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=76.90, train_loss_epoch=77.50]
Epoch 21:  85%|████████▌ | 23/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=76.90, train_loss_epoch=77.50]
Epoch 21:  85%|████████▌ | 23/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.50]
Epoch 21:  89%|████████▉ | 24/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.50]
Epoch 21:  89%|████████▉ | 24/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.50]
Epoch 21:  93%|█████████▎| 25/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.50]
Epoch 21:  93%|█████████▎| 25/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21:  96%|█████████▋| 26/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21:  96%|█████████▋| 26/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21: 100%|██████████| 27/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=77.20, train_loss_epoch=77.50]
Epoch 21: 100%|██████████| 27/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.50]
Epoch 21: 100%|██████████| 27/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.10]
Epoch 21:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.10]         
Epoch 22:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.10]
Epoch 22:   4%|▎         | 1/27 [00:00<00:09,  2.85it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.10]
Epoch 22:   4%|▎         | 1/27 [00:00<00:09,  2.83it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.10]
Epoch 22:   7%|▋         | 2/27 [00:00<00:05,  4.90it/s, v_num=0, train_loss_step=77.10, train_loss_epoch=77.10]
Epoch 22:   7%|▋         | 2/27 [00:00<00:05,  4.89it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=77.10]
Epoch 22:  11%|█         | 3/27 [00:00<00:03,  6.45it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=77.10]
Epoch 22:  11%|█         | 3/27 [00:00<00:03,  6.44it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=77.10]
Epoch 22:  15%|█▍        | 4/27 [00:00<00:03,  7.65it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=77.10]
Epoch 22:  15%|█▍        | 4/27 [00:00<00:03,  7.64it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=77.10]
Epoch 22:  19%|█▊        | 5/27 [00:00<00:02,  8.48it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=77.10]
Epoch 22:  19%|█▊        | 5/27 [00:00<00:02,  8.46it/s, v_num=0, train_loss_step=76.90, train_loss_epoch=77.10]
Epoch 22:  22%|██▏       | 6/27 [00:00<00:02,  9.24it/s, v_num=0, train_loss_step=76.90, train_loss_epoch=77.10]
Epoch 22:  22%|██▏       | 6/27 [00:00<00:02,  9.23it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.10]
Epoch 22:  26%|██▌       | 7/27 [00:00<00:02,  9.87it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.10]
Epoch 22:  26%|██▌       | 7/27 [00:00<00:02,  9.86it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.10]
Epoch 22:  30%|██▉       | 8/27 [00:00<00:01, 10.26it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.10]
Epoch 22:  30%|██▉       | 8/27 [00:00<00:01, 10.25it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22:  33%|███▎      | 9/27 [00:00<00:01, 10.65it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22:  33%|███▎      | 9/27 [00:00<00:01, 10.63it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=77.10]
Epoch 22:  37%|███▋      | 10/27 [00:00<00:01, 11.10it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=77.10]
Epoch 22:  37%|███▋      | 10/27 [00:00<00:01, 11.09it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.10]
Epoch 22:  41%|████      | 11/27 [00:00<00:01, 11.52it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.10]
Epoch 22:  41%|████      | 11/27 [00:00<00:01, 11.51it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=77.10]
Epoch 22:  44%|████▍     | 12/27 [00:01<00:01, 11.81it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=77.10]
Epoch 22:  44%|████▍     | 12/27 [00:01<00:01, 11.80it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=77.10]
Epoch 22:  48%|████▊     | 13/27 [00:01<00:01, 12.23it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=77.10]
Epoch 22:  48%|████▊     | 13/27 [00:01<00:01, 12.22it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22:  52%|█████▏    | 14/27 [00:01<00:01, 12.56it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22:  52%|█████▏    | 14/27 [00:01<00:01, 12.54it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22:  56%|█████▌    | 15/27 [00:01<00:00, 12.73it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22:  56%|█████▌    | 15/27 [00:01<00:00, 12.71it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.10]
Epoch 22:  59%|█████▉    | 16/27 [00:01<00:00, 12.91it/s, v_num=0, train_loss_step=76.80, train_loss_epoch=77.10]
Epoch 22:  59%|█████▉    | 16/27 [00:01<00:00, 12.90it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22:  63%|██████▎   | 17/27 [00:01<00:00, 13.18it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22:  63%|██████▎   | 17/27 [00:01<00:00, 13.17it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=77.10]
Epoch 22:  67%|██████▋   | 18/27 [00:01<00:00, 13.37it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=77.10]
Epoch 22:  67%|██████▋   | 18/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22:  70%|███████   | 19/27 [00:01<00:00, 13.59it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22:  70%|███████   | 19/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.10]
Epoch 22:  74%|███████▍  | 20/27 [00:01<00:00, 13.73it/s, v_num=0, train_loss_step=77.00, train_loss_epoch=77.10]
Epoch 22:  74%|███████▍  | 20/27 [00:01<00:00, 13.72it/s, v_num=0, train_loss_step=76.90, train_loss_epoch=77.10]
Epoch 22:  78%|███████▊  | 21/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=76.90, train_loss_epoch=77.10]
Epoch 22:  78%|███████▊  | 21/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22:  81%|████████▏ | 22/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22:  81%|████████▏ | 22/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=77.10]
Epoch 22:  85%|████████▌ | 23/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=77.10]
Epoch 22:  85%|████████▌ | 23/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22:  89%|████████▉ | 24/27 [00:01<00:00, 14.32it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22:  89%|████████▉ | 24/27 [00:01<00:00, 14.31it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=77.10]
Epoch 22:  93%|█████████▎| 25/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=77.10]
Epoch 22:  93%|█████████▎| 25/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22:  96%|█████████▋| 26/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22:  96%|█████████▋| 26/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22: 100%|██████████| 27/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=77.10]
Epoch 22: 100%|██████████| 27/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=77.10]
Epoch 22: 100%|██████████| 27/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 22:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]         
Epoch 23:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:   4%|▎         | 1/27 [00:00<00:09,  2.88it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:   4%|▎         | 1/27 [00:00<00:09,  2.86it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:   7%|▋         | 2/27 [00:00<00:05,  4.72it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:   7%|▋         | 2/27 [00:00<00:05,  4.71it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  11%|█         | 3/27 [00:00<00:03,  6.12it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  11%|█         | 3/27 [00:00<00:03,  6.11it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  15%|█▍        | 4/27 [00:00<00:03,  7.40it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  15%|█▍        | 4/27 [00:00<00:03,  7.39it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  19%|█▊        | 5/27 [00:00<00:02,  8.37it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  19%|█▊        | 5/27 [00:00<00:02,  8.35it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=76.60]
Epoch 23:  22%|██▏       | 6/27 [00:00<00:02,  9.24it/s, v_num=0, train_loss_step=76.50, train_loss_epoch=76.60]
Epoch 23:  22%|██▏       | 6/27 [00:00<00:02,  9.23it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  26%|██▌       | 7/27 [00:00<00:02,  9.93it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  26%|██▌       | 7/27 [00:00<00:02,  9.92it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  30%|██▉       | 8/27 [00:00<00:01, 10.50it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  30%|██▉       | 8/27 [00:00<00:01, 10.49it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  33%|███▎      | 9/27 [00:00<00:01, 11.11it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  33%|███▎      | 9/27 [00:00<00:01, 11.10it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=76.60]
Epoch 23:  37%|███▋      | 10/27 [00:00<00:01, 11.63it/s, v_num=0, train_loss_step=76.70, train_loss_epoch=76.60]
Epoch 23:  37%|███▋      | 10/27 [00:00<00:01, 11.62it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=76.60]
Epoch 23:  41%|████      | 11/27 [00:00<00:01, 12.13it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=76.60]
Epoch 23:  41%|████      | 11/27 [00:00<00:01, 12.12it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=76.60]
Epoch 23:  44%|████▍     | 12/27 [00:00<00:01, 12.55it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=76.60]
Epoch 23:  44%|████▍     | 12/27 [00:00<00:01, 12.54it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=76.60]
Epoch 23:  48%|████▊     | 13/27 [00:00<00:01, 13.01it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=76.60]
Epoch 23:  48%|████▊     | 13/27 [00:01<00:01, 13.00it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  52%|█████▏    | 14/27 [00:01<00:00, 13.21it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  52%|█████▏    | 14/27 [00:01<00:00, 13.19it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=76.60]
Epoch 23:  56%|█████▌    | 15/27 [00:01<00:00, 13.55it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=76.60]
Epoch 23:  56%|█████▌    | 15/27 [00:01<00:00, 13.54it/s, v_num=0, train_loss_step=76.10, train_loss_epoch=76.60]
Epoch 23:  59%|█████▉    | 16/27 [00:01<00:00, 13.83it/s, v_num=0, train_loss_step=76.10, train_loss_epoch=76.60]
Epoch 23:  59%|█████▉    | 16/27 [00:01<00:00, 13.82it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=76.60]
Epoch 23:  63%|██████▎   | 17/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=76.60, train_loss_epoch=76.60]
Epoch 23:  63%|██████▎   | 17/27 [00:01<00:00, 14.10it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.60]
Epoch 23:  67%|██████▋   | 18/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.60]
Epoch 23:  67%|██████▋   | 18/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=76.30, train_loss_epoch=76.60]
Epoch 23:  70%|███████   | 19/27 [00:01<00:00, 14.48it/s, v_num=0, train_loss_step=76.30, train_loss_epoch=76.60]
Epoch 23:  70%|███████   | 19/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  74%|███████▍  | 20/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=76.40, train_loss_epoch=76.60]
Epoch 23:  74%|███████▍  | 20/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  78%|███████▊  | 21/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  78%|███████▊  | 21/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  81%|████████▏ | 22/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23:  81%|████████▏ | 22/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.60]
Epoch 23:  85%|████████▌ | 23/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.60]
Epoch 23:  85%|████████▌ | 23/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.60]
Epoch 23:  89%|████████▉ | 24/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.60]
Epoch 23:  89%|████████▉ | 24/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.60]
Epoch 23:  93%|█████████▎| 25/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.60]
Epoch 23:  93%|█████████▎| 25/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.60]
Epoch 23:  96%|█████████▋| 26/27 [00:01<00:00, 15.43it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.60]
Epoch 23:  96%|█████████▋| 26/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.60]
Epoch 23: 100%|██████████| 27/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.60]
Epoch 23: 100%|██████████| 27/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.60]
Epoch 23: 100%|██████████| 27/27 [00:01<00:00, 15.62it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.10]
Epoch 23:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.10]         
Epoch 24:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.10]
Epoch 24:   4%|▎         | 1/27 [00:00<00:09,  2.83it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.10]
Epoch 24:   4%|▎         | 1/27 [00:00<00:09,  2.81it/s, v_num=0, train_loss_step=76.30, train_loss_epoch=76.10]
Epoch 24:   7%|▋         | 2/27 [00:00<00:05,  4.86it/s, v_num=0, train_loss_step=76.30, train_loss_epoch=76.10]
Epoch 24:   7%|▋         | 2/27 [00:00<00:05,  4.85it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.10]
Epoch 24:  11%|█         | 3/27 [00:00<00:03,  6.37it/s, v_num=0, train_loss_step=76.00, train_loss_epoch=76.10]
Epoch 24:  11%|█         | 3/27 [00:00<00:03,  6.36it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=76.10]
Epoch 24:  15%|█▍        | 4/27 [00:00<00:03,  7.49it/s, v_num=0, train_loss_step=76.20, train_loss_epoch=76.10]
Epoch 24:  15%|█▍        | 4/27 [00:00<00:03,  7.48it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.10]
Epoch 24:  19%|█▊        | 5/27 [00:00<00:02,  8.35it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.10]
Epoch 24:  19%|█▊        | 5/27 [00:00<00:02,  8.34it/s, v_num=0, train_loss_step=76.10, train_loss_epoch=76.10]
Epoch 24:  22%|██▏       | 6/27 [00:00<00:02,  9.06it/s, v_num=0, train_loss_step=76.10, train_loss_epoch=76.10]
Epoch 24:  22%|██▏       | 6/27 [00:00<00:02,  9.05it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  26%|██▌       | 7/27 [00:00<00:02,  9.66it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  26%|██▌       | 7/27 [00:00<00:02,  9.65it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24:  30%|██▉       | 8/27 [00:00<00:01, 10.30it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24:  30%|██▉       | 8/27 [00:00<00:01, 10.28it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24:  33%|███▎      | 9/27 [00:00<00:01, 10.82it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24:  33%|███▎      | 9/27 [00:00<00:01, 10.81it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.10]
Epoch 24:  37%|███▋      | 10/27 [00:00<00:01, 11.28it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.10]
Epoch 24:  37%|███▋      | 10/27 [00:00<00:01, 11.27it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=76.10]
Epoch 24:  41%|████      | 11/27 [00:00<00:01, 11.70it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=76.10]
Epoch 24:  41%|████      | 11/27 [00:00<00:01, 11.69it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24:  44%|████▍     | 12/27 [00:00<00:01, 12.10it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24:  44%|████▍     | 12/27 [00:00<00:01, 12.09it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  48%|████▊     | 13/27 [00:01<00:01, 12.48it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  48%|████▊     | 13/27 [00:01<00:01, 12.47it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24:  52%|█████▏    | 14/27 [00:01<00:01, 12.81it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24:  52%|█████▏    | 14/27 [00:01<00:01, 12.80it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=76.10]
Epoch 24:  56%|█████▌    | 15/27 [00:01<00:00, 13.06it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=76.10]
Epoch 24:  56%|█████▌    | 15/27 [00:01<00:00, 13.05it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  59%|█████▉    | 16/27 [00:01<00:00, 13.34it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  59%|█████▉    | 16/27 [00:01<00:00, 13.33it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.10]
Epoch 24:  63%|██████▎   | 17/27 [00:01<00:00, 13.61it/s, v_num=0, train_loss_step=75.90, train_loss_epoch=76.10]
Epoch 24:  63%|██████▎   | 17/27 [00:01<00:00, 13.59it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=76.10]
Epoch 24:  67%|██████▋   | 18/27 [00:01<00:00, 13.84it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=76.10]
Epoch 24:  67%|██████▋   | 18/27 [00:01<00:00, 13.83it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=76.10]
Epoch 24:  70%|███████   | 19/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=76.10]
Epoch 24:  70%|███████   | 19/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  74%|███████▍  | 20/27 [00:01<00:00, 14.13it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  74%|███████▍  | 20/27 [00:01<00:00, 14.12it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=76.10]
Epoch 24:  78%|███████▊  | 21/27 [00:01<00:00, 14.30it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=76.10]
Epoch 24:  78%|███████▊  | 21/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  81%|████████▏ | 22/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=76.10]
Epoch 24:  81%|████████▏ | 22/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=76.10]
Epoch 24:  85%|████████▌ | 23/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=76.10]
Epoch 24:  85%|████████▌ | 23/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=76.10]
Epoch 24:  89%|████████▉ | 24/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=76.10]
Epoch 24:  89%|████████▉ | 24/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=76.10]
Epoch 24:  93%|█████████▎| 25/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=76.10]
Epoch 24:  93%|█████████▎| 25/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=76.10]
Epoch 24:  96%|█████████▋| 26/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=76.10]
Epoch 24:  96%|█████████▋| 26/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=76.10]
Epoch 24: 100%|██████████| 27/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=76.10]
Epoch 24: 100%|██████████| 27/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=76.10]
Epoch 24: 100%|██████████| 27/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=75.70]
Epoch 24:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=75.70]         
Epoch 25:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=75.70]
Epoch 25:   4%|▎         | 1/27 [00:00<00:08,  3.04it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=75.70]
Epoch 25:   4%|▎         | 1/27 [00:00<00:08,  3.02it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=75.70]
Epoch 25:   7%|▋         | 2/27 [00:00<00:04,  5.20it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=75.70]
Epoch 25:   7%|▋         | 2/27 [00:00<00:04,  5.19it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.70]
Epoch 25:  11%|█         | 3/27 [00:00<00:03,  6.90it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.70]
Epoch 25:  11%|█         | 3/27 [00:00<00:03,  6.89it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=75.70]
Epoch 25:  15%|█▍        | 4/27 [00:00<00:02,  8.13it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=75.70]
Epoch 25:  15%|█▍        | 4/27 [00:00<00:02,  8.11it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=75.70]
Epoch 25:  19%|█▊        | 5/27 [00:00<00:02,  9.05it/s, v_num=0, train_loss_step=75.70, train_loss_epoch=75.70]
Epoch 25:  19%|█▊        | 5/27 [00:00<00:02,  9.03it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.70]
Epoch 25:  22%|██▏       | 6/27 [00:00<00:02,  9.76it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.70]
Epoch 25:  22%|██▏       | 6/27 [00:00<00:02,  9.75it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=75.70]
Epoch 25:  26%|██▌       | 7/27 [00:00<00:01, 10.47it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=75.70]
Epoch 25:  26%|██▌       | 7/27 [00:00<00:01, 10.45it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=75.70]
Epoch 25:  30%|██▉       | 8/27 [00:00<00:01, 11.06it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=75.70]
Epoch 25:  30%|██▉       | 8/27 [00:00<00:01, 11.04it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=75.70]
Epoch 25:  33%|███▎      | 9/27 [00:00<00:01, 11.66it/s, v_num=0, train_loss_step=75.80, train_loss_epoch=75.70]
Epoch 25:  33%|███▎      | 9/27 [00:00<00:01, 11.64it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=75.70]
Epoch 25:  37%|███▋      | 10/27 [00:00<00:01, 12.10it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=75.70]
Epoch 25:  37%|███▋      | 10/27 [00:00<00:01, 12.09it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  41%|████      | 11/27 [00:00<00:01, 12.53it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  41%|████      | 11/27 [00:00<00:01, 12.51it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  44%|████▍     | 12/27 [00:00<00:01, 12.87it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  44%|████▍     | 12/27 [00:00<00:01, 12.86it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  48%|████▊     | 13/27 [00:00<00:01, 13.26it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  48%|████▊     | 13/27 [00:00<00:01, 13.25it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  52%|█████▏    | 14/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  52%|█████▏    | 14/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=75.70]
Epoch 25:  56%|█████▌    | 15/27 [00:01<00:00, 13.77it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=75.70]
Epoch 25:  56%|█████▌    | 15/27 [00:01<00:00, 13.76it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=75.70]
Epoch 25:  59%|█████▉    | 16/27 [00:01<00:00, 14.10it/s, v_num=0, train_loss_step=75.50, train_loss_epoch=75.70]
Epoch 25:  59%|█████▉    | 16/27 [00:01<00:00, 14.09it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=75.70]
Epoch 25:  63%|██████▎   | 17/27 [00:01<00:00, 14.37it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=75.70]
Epoch 25:  63%|██████▎   | 17/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=75.00, train_loss_epoch=75.70]
Epoch 25:  67%|██████▋   | 18/27 [00:01<00:00, 14.59it/s, v_num=0, train_loss_step=75.00, train_loss_epoch=75.70]
Epoch 25:  67%|██████▋   | 18/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.70]
Epoch 25:  70%|███████   | 19/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.70]
Epoch 25:  70%|███████   | 19/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=75.70]
Epoch 25:  74%|███████▍  | 20/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=75.30, train_loss_epoch=75.70]
Epoch 25:  74%|███████▍  | 20/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.70]
Epoch 25:  78%|███████▊  | 21/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.70]
Epoch 25:  78%|███████▊  | 21/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=75.70]
Epoch 25:  81%|████████▏ | 22/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=75.60, train_loss_epoch=75.70]
Epoch 25:  81%|████████▏ | 22/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=75.00, train_loss_epoch=75.70]
Epoch 25:  85%|████████▌ | 23/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=75.00, train_loss_epoch=75.70]
Epoch 25:  85%|████████▌ | 23/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.70]
Epoch 25:  89%|████████▉ | 24/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.70]
Epoch 25:  89%|████████▉ | 24/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  93%|█████████▎| 25/27 [00:01<00:00, 15.54it/s, v_num=0, train_loss_step=75.20, train_loss_epoch=75.70]
Epoch 25:  93%|█████████▎| 25/27 [00:01<00:00, 15.53it/s, v_num=0, train_loss_step=75.00, train_loss_epoch=75.70]
Epoch 25:  96%|█████████▋| 26/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=75.00, train_loss_epoch=75.70]
Epoch 25:  96%|█████████▋| 26/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=75.70]
Epoch 25: 100%|██████████| 27/27 [00:01<00:00, 15.85it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=75.70]
Epoch 25: 100%|██████████| 27/27 [00:01<00:00, 15.84it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.70]
Epoch 25: 100%|██████████| 27/27 [00:01<00:00, 15.83it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 25:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]         
Epoch 26:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26:   4%|▎         | 1/27 [00:00<00:08,  2.98it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26:   4%|▎         | 1/27 [00:00<00:08,  2.96it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=75.30]
Epoch 26:   7%|▋         | 2/27 [00:00<00:04,  5.03it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=75.30]
Epoch 26:   7%|▋         | 2/27 [00:00<00:04,  5.01it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  11%|█         | 3/27 [00:00<00:03,  6.52it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  11%|█         | 3/27 [00:00<00:03,  6.51it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=75.30]
Epoch 26:  15%|█▍        | 4/27 [00:00<00:02,  7.76it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=75.30]
Epoch 26:  15%|█▍        | 4/27 [00:00<00:02,  7.75it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=75.30]
Epoch 26:  19%|█▊        | 5/27 [00:00<00:02,  8.80it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=75.30]
Epoch 26:  19%|█▊        | 5/27 [00:00<00:02,  8.79it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=75.30]
Epoch 26:  22%|██▏       | 6/27 [00:00<00:02,  9.48it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=75.30]
Epoch 26:  22%|██▏       | 6/27 [00:00<00:02,  9.47it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.30]
Epoch 26:  26%|██▌       | 7/27 [00:00<00:01, 10.18it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.30]
Epoch 26:  26%|██▌       | 7/27 [00:00<00:01, 10.16it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  30%|██▉       | 8/27 [00:00<00:01, 10.77it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  30%|██▉       | 8/27 [00:00<00:01, 10.76it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  33%|███▎      | 9/27 [00:00<00:01, 11.31it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  33%|███▎      | 9/27 [00:00<00:01, 11.30it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.30]
Epoch 26:  37%|███▋      | 10/27 [00:00<00:01, 11.81it/s, v_num=0, train_loss_step=75.10, train_loss_epoch=75.30]
Epoch 26:  37%|███▋      | 10/27 [00:00<00:01, 11.80it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=75.30]
Epoch 26:  41%|████      | 11/27 [00:00<00:01, 12.25it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=75.30]
Epoch 26:  41%|████      | 11/27 [00:00<00:01, 12.22it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=75.30]
Epoch 26:  44%|████▍     | 12/27 [00:00<00:01, 12.44it/s, v_num=0, train_loss_step=75.40, train_loss_epoch=75.30]
Epoch 26:  44%|████▍     | 12/27 [00:00<00:01, 12.43it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  48%|████▊     | 13/27 [00:01<00:01, 12.83it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  48%|████▊     | 13/27 [00:01<00:01, 12.82it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=75.30]
Epoch 26:  52%|█████▏    | 14/27 [00:01<00:00, 13.19it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=75.30]
Epoch 26:  52%|█████▏    | 14/27 [00:01<00:00, 13.18it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  56%|█████▌    | 15/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  56%|█████▌    | 15/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26:  59%|█████▉    | 16/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26:  59%|█████▉    | 16/27 [00:01<00:00, 13.70it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=75.30]
Epoch 26:  63%|██████▎   | 17/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=75.30]
Epoch 26:  63%|██████▎   | 17/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=75.30]
Epoch 26:  67%|██████▋   | 18/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=75.30]
Epoch 26:  67%|██████▋   | 18/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26:  70%|███████   | 19/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26:  70%|███████   | 19/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26:  74%|███████▍  | 20/27 [00:01<00:00, 14.59it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26:  74%|███████▍  | 20/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=75.30]
Epoch 26:  78%|███████▊  | 21/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=75.30]
Epoch 26:  78%|███████▊  | 21/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  81%|████████▏ | 22/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  81%|████████▏ | 22/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=75.00, train_loss_epoch=75.30]
Epoch 26:  85%|████████▌ | 23/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=75.00, train_loss_epoch=75.30]
Epoch 26:  85%|████████▌ | 23/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=75.30]
Epoch 26:  89%|████████▉ | 24/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=75.30]
Epoch 26:  89%|████████▉ | 24/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  93%|█████████▎| 25/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=74.90, train_loss_epoch=75.30]
Epoch 26:  93%|█████████▎| 25/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=75.30]
Epoch 26:  96%|█████████▋| 26/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=75.30]
Epoch 26:  96%|█████████▋| 26/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26: 100%|██████████| 27/27 [00:01<00:00, 15.73it/s, v_num=0, train_loss_step=74.70, train_loss_epoch=75.30]
Epoch 26: 100%|██████████| 27/27 [00:01<00:00, 15.72it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=75.30]
Epoch 26: 100%|██████████| 27/27 [00:01<00:00, 15.71it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 26:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]         
Epoch 27:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=74.80]
Epoch 27:   7%|▋         | 2/27 [00:00<00:05,  5.00it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=74.80]
Epoch 27:   7%|▋         | 2/27 [00:00<00:05,  4.98it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.80]
Epoch 27:  11%|█         | 3/27 [00:00<00:03,  6.59it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.80]
Epoch 27:  11%|█         | 3/27 [00:00<00:03,  6.58it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  15%|█▍        | 4/27 [00:00<00:02,  7.75it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  15%|█▍        | 4/27 [00:00<00:02,  7.74it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27:  19%|█▊        | 5/27 [00:00<00:02,  8.73it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27:  19%|█▊        | 5/27 [00:00<00:02,  8.71it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  22%|██▏       | 6/27 [00:00<00:02,  9.58it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  22%|██▏       | 6/27 [00:00<00:02,  9.57it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=74.80]
Epoch 27:  26%|██▌       | 7/27 [00:00<00:01, 10.25it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=74.80]
Epoch 27:  26%|██▌       | 7/27 [00:00<00:01, 10.24it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  30%|██▉       | 8/27 [00:00<00:01, 10.85it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  30%|██▉       | 8/27 [00:00<00:01, 10.83it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  33%|███▎      | 9/27 [00:00<00:01, 11.42it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  33%|███▎      | 9/27 [00:00<00:01, 11.41it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27:  37%|███▋      | 10/27 [00:00<00:01, 11.89it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27:  37%|███▋      | 10/27 [00:00<00:01, 11.88it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=74.80]
Epoch 27:  41%|████      | 11/27 [00:00<00:01, 12.29it/s, v_num=0, train_loss_step=74.80, train_loss_epoch=74.80]
Epoch 27:  41%|████      | 11/27 [00:00<00:01, 12.27it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.80]
Epoch 27:  44%|████▍     | 12/27 [00:00<00:01, 12.70it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.80]
Epoch 27:  44%|████▍     | 12/27 [00:00<00:01, 12.69it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=74.80]
Epoch 27:  48%|████▊     | 13/27 [00:00<00:01, 13.10it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=74.80]
Epoch 27:  48%|████▊     | 13/27 [00:00<00:01, 13.09it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  52%|█████▏    | 14/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  52%|█████▏    | 14/27 [00:01<00:00, 13.41it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.80]
Epoch 27:  56%|█████▌    | 15/27 [00:01<00:00, 13.69it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.80]
Epoch 27:  56%|█████▌    | 15/27 [00:01<00:00, 13.68it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  59%|█████▉    | 16/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  59%|█████▉    | 16/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  63%|██████▎   | 17/27 [00:01<00:00, 14.37it/s, v_num=0, train_loss_step=74.50, train_loss_epoch=74.80]
Epoch 27:  63%|██████▎   | 17/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27:  67%|██████▋   | 18/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27:  67%|██████▋   | 18/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  70%|███████   | 19/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  70%|███████   | 19/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27:  74%|███████▍  | 20/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27:  74%|███████▍  | 20/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  78%|███████▊  | 21/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  78%|███████▊  | 21/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.80]
Epoch 27:  81%|████████▏ | 22/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.80]
Epoch 27:  81%|████████▏ | 22/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=74.20, train_loss_epoch=74.80]
Epoch 27:  85%|████████▌ | 23/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=74.20, train_loss_epoch=74.80]
Epoch 27:  85%|████████▌ | 23/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  89%|████████▉ | 24/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.80]
Epoch 27:  89%|████████▉ | 24/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=74.80]
Epoch 27:  93%|█████████▎| 25/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=74.60, train_loss_epoch=74.80]
Epoch 27:  93%|█████████▎| 25/27 [00:01<00:00, 15.48it/s, v_num=0, train_loss_step=74.20, train_loss_epoch=74.80]
Epoch 27:  96%|█████████▋| 26/27 [00:01<00:00, 15.60it/s, v_num=0, train_loss_step=74.20, train_loss_epoch=74.80]
Epoch 27:  96%|█████████▋| 26/27 [00:01<00:00, 15.59it/s, v_num=0, train_loss_step=74.20, train_loss_epoch=74.80]
Epoch 27: 100%|██████████| 27/27 [00:01<00:00, 15.84it/s, v_num=0, train_loss_step=74.20, train_loss_epoch=74.80]
Epoch 27: 100%|██████████| 27/27 [00:01<00:00, 15.83it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.80]
Epoch 27: 100%|██████████| 27/27 [00:01<00:00, 15.82it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.40]
Epoch 27:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.40]         
Epoch 28:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.40]
Epoch 28:   4%|▎         | 1/27 [00:00<00:08,  3.13it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.40]
Epoch 28:   4%|▎         | 1/27 [00:00<00:08,  3.11it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:   7%|▋         | 2/27 [00:00<00:04,  5.24it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:   7%|▋         | 2/27 [00:00<00:04,  5.22it/s, v_num=0, train_loss_step=74.20, train_loss_epoch=74.40]
Epoch 28:  11%|█         | 3/27 [00:00<00:03,  6.75it/s, v_num=0, train_loss_step=74.20, train_loss_epoch=74.40]
Epoch 28:  11%|█         | 3/27 [00:00<00:03,  6.74it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.40]
Epoch 28:  15%|█▍        | 4/27 [00:00<00:02,  8.09it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.40]
Epoch 28:  15%|█▍        | 4/27 [00:00<00:02,  8.07it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.40]
Epoch 28:  19%|█▊        | 5/27 [00:00<00:02,  9.10it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.40]
Epoch 28:  19%|█▊        | 5/27 [00:00<00:02,  9.08it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.40]
Epoch 28:  22%|██▏       | 6/27 [00:00<00:02,  9.76it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.40]
Epoch 28:  22%|██▏       | 6/27 [00:00<00:02,  9.74it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.40]
Epoch 28:  26%|██▌       | 7/27 [00:00<00:01, 10.37it/s, v_num=0, train_loss_step=74.40, train_loss_epoch=74.40]
Epoch 28:  26%|██▌       | 7/27 [00:00<00:01, 10.35it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.40]
Epoch 28:  30%|██▉       | 8/27 [00:00<00:01, 10.82it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.40]
Epoch 28:  30%|██▉       | 8/27 [00:00<00:01, 10.81it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:  33%|███▎      | 9/27 [00:00<00:01, 11.22it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:  33%|███▎      | 9/27 [00:00<00:01, 11.20it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:  37%|███▋      | 10/27 [00:00<00:01, 11.74it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:  37%|███▋      | 10/27 [00:00<00:01, 11.72it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=74.40]
Epoch 28:  41%|████      | 11/27 [00:00<00:01, 12.18it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=74.40]
Epoch 28:  41%|████      | 11/27 [00:00<00:01, 12.16it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.40]
Epoch 28:  44%|████▍     | 12/27 [00:00<00:01, 12.58it/s, v_num=0, train_loss_step=74.30, train_loss_epoch=74.40]
Epoch 28:  44%|████▍     | 12/27 [00:00<00:01, 12.56it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  48%|████▊     | 13/27 [00:01<00:01, 12.97it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  48%|████▊     | 13/27 [00:01<00:01, 12.95it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=74.40]
Epoch 28:  52%|█████▏    | 14/27 [00:01<00:00, 13.28it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=74.40]
Epoch 28:  52%|█████▏    | 14/27 [00:01<00:00, 13.26it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  56%|█████▌    | 15/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  56%|█████▌    | 15/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.40]
Epoch 28:  59%|█████▉    | 16/27 [00:01<00:00, 13.84it/s, v_num=0, train_loss_step=74.10, train_loss_epoch=74.40]
Epoch 28:  59%|█████▉    | 16/27 [00:01<00:00, 13.83it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=74.40]
Epoch 28:  63%|██████▎   | 17/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=74.40]
Epoch 28:  63%|██████▎   | 17/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  67%|██████▋   | 18/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  67%|██████▋   | 18/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  70%|███████   | 19/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  70%|███████   | 19/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  74%|███████▍  | 20/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=74.40]
Epoch 28:  74%|███████▍  | 20/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=74.40]
Epoch 28:  78%|███████▊  | 21/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=74.40]
Epoch 28:  78%|███████▊  | 21/27 [00:01<00:00, 14.82it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:  81%|████████▏ | 22/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:  81%|████████▏ | 22/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:  85%|████████▌ | 23/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=74.00, train_loss_epoch=74.40]
Epoch 28:  85%|████████▌ | 23/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=74.40]
Epoch 28:  89%|████████▉ | 24/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=74.40]
Epoch 28:  89%|████████▉ | 24/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=74.40]
Epoch 28:  93%|█████████▎| 25/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=74.40]
Epoch 28:  93%|█████████▎| 25/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=74.40]
Epoch 28:  96%|█████████▋| 26/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=74.40]
Epoch 28:  96%|█████████▋| 26/27 [00:01<00:00, 15.41it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=74.40]
Epoch 28: 100%|██████████| 27/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=74.40]
Epoch 28: 100%|██████████| 27/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=74.40]
Epoch 28: 100%|██████████| 27/27 [00:01<00:00, 15.61it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 28:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]         
Epoch 29:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:   4%|▎         | 1/27 [00:00<00:09,  2.78it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:   4%|▎         | 1/27 [00:00<00:09,  2.76it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:   7%|▋         | 2/27 [00:00<00:05,  4.81it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:   7%|▋         | 2/27 [00:00<00:05,  4.80it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  11%|█         | 3/27 [00:00<00:03,  6.46it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  11%|█         | 3/27 [00:00<00:03,  6.45it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=73.90]
Epoch 29:  15%|█▍        | 4/27 [00:00<00:02,  7.80it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=73.90]
Epoch 29:  15%|█▍        | 4/27 [00:00<00:02,  7.79it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=73.90]
Epoch 29:  19%|█▊        | 5/27 [00:00<00:02,  8.79it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=73.90]
Epoch 29:  19%|█▊        | 5/27 [00:00<00:02,  8.78it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:  22%|██▏       | 6/27 [00:00<00:02,  9.49it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:  22%|██▏       | 6/27 [00:00<00:02,  9.48it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=73.90]
Epoch 29:  26%|██▌       | 7/27 [00:00<00:01, 10.28it/s, v_num=0, train_loss_step=73.90, train_loss_epoch=73.90]
Epoch 29:  26%|██▌       | 7/27 [00:00<00:01, 10.27it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=73.90]
Epoch 29:  30%|██▉       | 8/27 [00:00<00:01, 10.93it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=73.90]
Epoch 29:  30%|██▉       | 8/27 [00:00<00:01, 10.92it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=73.90]
Epoch 29:  33%|███▎      | 9/27 [00:00<00:01, 11.60it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=73.90]
Epoch 29:  33%|███▎      | 9/27 [00:00<00:01, 11.58it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=73.90]
Epoch 29:  37%|███▋      | 10/27 [00:00<00:01, 12.33it/s, v_num=0, train_loss_step=73.80, train_loss_epoch=73.90]
Epoch 29:  37%|███▋      | 10/27 [00:00<00:01, 12.32it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=73.90]
Epoch 29:  41%|████      | 11/27 [00:00<00:01, 12.89it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=73.90]
Epoch 29:  41%|████      | 11/27 [00:00<00:01, 12.87it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  44%|████▍     | 12/27 [00:00<00:01, 13.26it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  44%|████▍     | 12/27 [00:00<00:01, 13.25it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=73.90]
Epoch 29:  48%|████▊     | 13/27 [00:00<00:01, 13.53it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=73.90]
Epoch 29:  48%|████▊     | 13/27 [00:00<00:01, 13.52it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.90]
Epoch 29:  52%|█████▏    | 14/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.90]
Epoch 29:  52%|█████▏    | 14/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=73.90]
Epoch 29:  56%|█████▌    | 15/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=73.70, train_loss_epoch=73.90]
Epoch 29:  56%|█████▌    | 15/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  59%|█████▉    | 16/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  59%|█████▉    | 16/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.90]
Epoch 29:  63%|██████▎   | 17/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.90]
Epoch 29:  63%|██████▎   | 17/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  67%|██████▋   | 18/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  67%|██████▋   | 18/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.90]
Epoch 29:  70%|███████   | 19/27 [00:01<00:00, 15.58it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.90]
Epoch 29:  70%|███████   | 19/27 [00:01<00:00, 15.56it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:  74%|███████▍  | 20/27 [00:01<00:00, 15.75it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:  74%|███████▍  | 20/27 [00:01<00:00, 15.74it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  78%|███████▊  | 21/27 [00:01<00:00, 15.90it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  78%|███████▊  | 21/27 [00:01<00:00, 15.89it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.90]
Epoch 29:  81%|████████▏ | 22/27 [00:01<00:00, 16.12it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.90]
Epoch 29:  81%|████████▏ | 22/27 [00:01<00:00, 16.11it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.90]
Epoch 29:  85%|████████▌ | 23/27 [00:01<00:00, 16.33it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.90]
Epoch 29:  85%|████████▌ | 23/27 [00:01<00:00, 16.31it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  89%|████████▉ | 24/27 [00:01<00:00, 16.47it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.90]
Epoch 29:  89%|████████▉ | 24/27 [00:01<00:00, 16.46it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.90]
Epoch 29:  93%|█████████▎| 25/27 [00:01<00:00, 16.64it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.90]
Epoch 29:  93%|█████████▎| 25/27 [00:01<00:00, 16.63it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:  96%|█████████▋| 26/27 [00:01<00:00, 16.78it/s, v_num=0, train_loss_step=73.60, train_loss_epoch=73.90]
Epoch 29:  96%|█████████▋| 26/27 [00:01<00:00, 16.77it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.90]
Epoch 29: 100%|██████████| 27/27 [00:01<00:00, 16.97it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.90]
Epoch 29: 100%|██████████| 27/27 [00:01<00:00, 16.96it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.90]
Epoch 29: 100%|██████████| 27/27 [00:01<00:00, 16.94it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 29:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]         
Epoch 30:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:   4%|▎         | 1/27 [00:00<00:09,  2.78it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:   4%|▎         | 1/27 [00:00<00:09,  2.77it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30:   7%|▋         | 2/27 [00:00<00:05,  4.78it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30:   7%|▋         | 2/27 [00:00<00:05,  4.77it/s, v_num=0, train_loss_step=73.40, train_loss_epoch=73.50]
Epoch 30:  11%|█         | 3/27 [00:00<00:03,  6.30it/s, v_num=0, train_loss_step=73.40, train_loss_epoch=73.50]
Epoch 30:  11%|█         | 3/27 [00:00<00:03,  6.29it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.50]
Epoch 30:  15%|█▍        | 4/27 [00:00<00:03,  7.55it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.50]
Epoch 30:  15%|█▍        | 4/27 [00:00<00:03,  7.54it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.50]
Epoch 30:  19%|█▊        | 5/27 [00:00<00:02,  8.50it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.50]
Epoch 30:  19%|█▊        | 5/27 [00:00<00:02,  8.49it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  22%|██▏       | 6/27 [00:00<00:02,  9.14it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  22%|██▏       | 6/27 [00:00<00:02,  9.13it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.50]
Epoch 30:  26%|██▌       | 7/27 [00:00<00:02,  9.91it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.50]
Epoch 30:  26%|██▌       | 7/27 [00:00<00:02,  9.89it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  30%|██▉       | 8/27 [00:00<00:01, 10.55it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  30%|██▉       | 8/27 [00:00<00:01, 10.54it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.50]
Epoch 30:  33%|███▎      | 9/27 [00:00<00:01, 11.16it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.50]
Epoch 30:  33%|███▎      | 9/27 [00:00<00:01, 11.15it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  37%|███▋      | 10/27 [00:00<00:01, 11.63it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  37%|███▋      | 10/27 [00:00<00:01, 11.61it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.50]
Epoch 30:  41%|████      | 11/27 [00:00<00:01, 12.07it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.50]
Epoch 30:  41%|████      | 11/27 [00:00<00:01, 12.06it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.50]
Epoch 30:  44%|████▍     | 12/27 [00:00<00:01, 12.54it/s, v_num=0, train_loss_step=73.50, train_loss_epoch=73.50]
Epoch 30:  44%|████▍     | 12/27 [00:00<00:01, 12.52it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.50]
Epoch 30:  48%|████▊     | 13/27 [00:01<00:01, 12.91it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.50]
Epoch 30:  48%|████▊     | 13/27 [00:01<00:01, 12.90it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  52%|█████▏    | 14/27 [00:01<00:00, 13.24it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  52%|█████▏    | 14/27 [00:01<00:00, 13.23it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.50]
Epoch 30:  56%|█████▌    | 15/27 [00:01<00:00, 13.53it/s, v_num=0, train_loss_step=73.20, train_loss_epoch=73.50]
Epoch 30:  56%|█████▌    | 15/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=73.40, train_loss_epoch=73.50]
Epoch 30:  59%|█████▉    | 16/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=73.40, train_loss_epoch=73.50]
Epoch 30:  59%|█████▉    | 16/27 [00:01<00:00, 13.84it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.50]
Epoch 30:  63%|██████▎   | 17/27 [00:01<00:00, 14.10it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.50]
Epoch 30:  63%|██████▎   | 17/27 [00:01<00:00, 14.09it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  67%|██████▋   | 18/27 [00:01<00:00, 14.34it/s, v_num=0, train_loss_step=73.30, train_loss_epoch=73.50]
Epoch 30:  67%|██████▋   | 18/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.50]
Epoch 30:  70%|███████   | 19/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.50]
Epoch 30:  70%|███████   | 19/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.50]
Epoch 30:  74%|███████▍  | 20/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.50]
Epoch 30:  74%|███████▍  | 20/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30:  78%|███████▊  | 21/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30:  78%|███████▊  | 21/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30:  81%|████████▏ | 22/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30:  81%|████████▏ | 22/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.50]
Epoch 30:  85%|████████▌ | 23/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.50]
Epoch 30:  85%|████████▌ | 23/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.50]
Epoch 30:  89%|████████▉ | 24/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.50]
Epoch 30:  89%|████████▉ | 24/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30:  93%|█████████▎| 25/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30:  93%|█████████▎| 25/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.50]
Epoch 30:  96%|█████████▋| 26/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.50]
Epoch 30:  96%|█████████▋| 26/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.50]
Epoch 30: 100%|██████████| 27/27 [00:01<00:00, 15.45it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.50]
Epoch 30: 100%|██████████| 27/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.50]
Epoch 30: 100%|██████████| 27/27 [00:01<00:00, 15.43it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 30:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]         
Epoch 31:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 31:   4%|▎         | 1/27 [00:00<00:08,  2.99it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 31:   4%|▎         | 1/27 [00:00<00:08,  2.96it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 31:   7%|▋         | 2/27 [00:00<00:04,  5.30it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 31:   7%|▋         | 2/27 [00:00<00:04,  5.29it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.10]
Epoch 31:  11%|█         | 3/27 [00:00<00:03,  6.78it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.10]
Epoch 31:  11%|█         | 3/27 [00:00<00:03,  6.77it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31:  15%|█▍        | 4/27 [00:00<00:02,  8.28it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31:  15%|█▍        | 4/27 [00:00<00:02,  8.27it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.10]
Epoch 31:  19%|█▊        | 5/27 [00:00<00:02,  9.48it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.10]
Epoch 31:  19%|█▊        | 5/27 [00:00<00:02,  9.47it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 31:  22%|██▏       | 6/27 [00:00<00:02, 10.48it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 31:  22%|██▏       | 6/27 [00:00<00:02, 10.47it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.10]
Epoch 31:  26%|██▌       | 7/27 [00:00<00:01, 11.05it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.10]
Epoch 31:  26%|██▌       | 7/27 [00:00<00:01, 11.03it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31:  30%|██▉       | 8/27 [00:00<00:01, 11.70it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31:  30%|██▉       | 8/27 [00:00<00:01, 11.69it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.10]
Epoch 31:  33%|███▎      | 9/27 [00:00<00:01, 12.32it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.10]
Epoch 31:  33%|███▎      | 9/27 [00:00<00:01, 12.31it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.10]
Epoch 31:  37%|███▋      | 10/27 [00:00<00:01, 12.93it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.10]
Epoch 31:  37%|███▋      | 10/27 [00:00<00:01, 12.91it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=73.10]
Epoch 31:  41%|████      | 11/27 [00:00<00:01, 13.16it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=73.10]
Epoch 31:  41%|████      | 11/27 [00:00<00:01, 13.15it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.10]
Epoch 31:  44%|████▍     | 12/27 [00:00<00:01, 13.62it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=73.10]
Epoch 31:  44%|████▍     | 12/27 [00:00<00:01, 13.60it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.10]
Epoch 31:  48%|████▊     | 13/27 [00:00<00:01, 13.97it/s, v_num=0, train_loss_step=72.90, train_loss_epoch=73.10]
Epoch 31:  48%|████▊     | 13/27 [00:00<00:01, 13.95it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31:  52%|█████▏    | 14/27 [00:00<00:00, 14.32it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31:  52%|█████▏    | 14/27 [00:00<00:00, 14.30it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.10]
Epoch 31:  56%|█████▌    | 15/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.10]
Epoch 31:  56%|█████▌    | 15/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=73.10]
Epoch 31:  59%|█████▉    | 16/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=73.10]
Epoch 31:  59%|█████▉    | 16/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.10]
Epoch 31:  63%|██████▎   | 17/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=73.00, train_loss_epoch=73.10]
Epoch 31:  63%|██████▎   | 17/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=73.10]
Epoch 31:  67%|██████▋   | 18/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=73.10]
Epoch 31:  67%|██████▋   | 18/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=73.10]
Epoch 31:  70%|███████   | 19/27 [00:01<00:00, 15.60it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=73.10]
Epoch 31:  70%|███████   | 19/27 [00:01<00:00, 15.59it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 31:  74%|███████▍  | 20/27 [00:01<00:00, 15.74it/s, v_num=0, train_loss_step=73.10, train_loss_epoch=73.10]
Epoch 31:  74%|███████▍  | 20/27 [00:01<00:00, 15.73it/s, v_num=0, train_loss_step=72.30, train_loss_epoch=73.10]
Epoch 31:  78%|███████▊  | 21/27 [00:01<00:00, 15.97it/s, v_num=0, train_loss_step=72.30, train_loss_epoch=73.10]
Epoch 31:  78%|███████▊  | 21/27 [00:01<00:00, 15.96it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=73.10]
Epoch 31:  81%|████████▏ | 22/27 [00:01<00:00, 16.08it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=73.10]
Epoch 31:  81%|████████▏ | 22/27 [00:01<00:00, 16.06it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31:  85%|████████▌ | 23/27 [00:01<00:00, 16.06it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31:  85%|████████▌ | 23/27 [00:01<00:00, 16.05it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=73.10]
Epoch 31:  89%|████████▉ | 24/27 [00:01<00:00, 16.18it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=73.10]
Epoch 31:  89%|████████▉ | 24/27 [00:01<00:00, 16.17it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=73.10]
Epoch 31:  93%|█████████▎| 25/27 [00:01<00:00, 16.30it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=73.10]
Epoch 31:  93%|█████████▎| 25/27 [00:01<00:00, 16.30it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=73.10]
Epoch 31:  96%|█████████▋| 26/27 [00:01<00:00, 16.35it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=73.10]
Epoch 31:  96%|█████████▋| 26/27 [00:01<00:00, 16.34it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=73.10]
Epoch 31: 100%|██████████| 27/27 [00:01<00:00, 16.55it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=73.10]
Epoch 31: 100%|██████████| 27/27 [00:01<00:00, 16.55it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=73.10]
Epoch 31: 100%|██████████| 27/27 [00:01<00:00, 16.53it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 31:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]         
Epoch 32:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 32:   4%|▎         | 1/27 [00:00<00:08,  2.99it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 32:   4%|▎         | 1/27 [00:00<00:08,  2.96it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=72.70]
Epoch 32:   7%|▋         | 2/27 [00:00<00:05,  4.93it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=72.70]
Epoch 32:   7%|▋         | 2/27 [00:00<00:05,  4.92it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 32:  11%|█         | 3/27 [00:00<00:03,  6.37it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 32:  11%|█         | 3/27 [00:00<00:03,  6.35it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=72.70]
Epoch 32:  15%|█▍        | 4/27 [00:00<00:03,  7.58it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=72.70]
Epoch 32:  15%|█▍        | 4/27 [00:00<00:03,  7.56it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=72.70]
Epoch 32:  19%|█▊        | 5/27 [00:00<00:02,  8.42it/s, v_num=0, train_loss_step=72.60, train_loss_epoch=72.70]
Epoch 32:  19%|█▊        | 5/27 [00:00<00:02,  8.41it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.70]
Epoch 32:  22%|██▏       | 6/27 [00:00<00:02,  9.17it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.70]
Epoch 32:  22%|██▏       | 6/27 [00:00<00:02,  9.16it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  26%|██▌       | 7/27 [00:00<00:02,  9.94it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  26%|██▌       | 7/27 [00:00<00:02,  9.92it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=72.70]
Epoch 32:  30%|██▉       | 8/27 [00:00<00:01, 10.51it/s, v_num=0, train_loss_step=72.80, train_loss_epoch=72.70]
Epoch 32:  30%|██▉       | 8/27 [00:00<00:01, 10.49it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=72.70]
Epoch 32:  33%|███▎      | 9/27 [00:00<00:01, 11.06it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=72.70]
Epoch 32:  33%|███▎      | 9/27 [00:00<00:01, 11.04it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=72.70]
Epoch 32:  37%|███▋      | 10/27 [00:00<00:01, 11.56it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=72.70]
Epoch 32:  37%|███▋      | 10/27 [00:00<00:01, 11.55it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 32:  41%|████      | 11/27 [00:00<00:01, 12.12it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 32:  41%|████      | 11/27 [00:00<00:01, 12.10it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=72.70]
Epoch 32:  44%|████▍     | 12/27 [00:00<00:01, 12.62it/s, v_num=0, train_loss_step=72.70, train_loss_epoch=72.70]
Epoch 32:  44%|████▍     | 12/27 [00:00<00:01, 12.61it/s, v_num=0, train_loss_step=72.30, train_loss_epoch=72.70]
Epoch 32:  48%|████▊     | 13/27 [00:00<00:01, 13.04it/s, v_num=0, train_loss_step=72.30, train_loss_epoch=72.70]
Epoch 32:  48%|████▊     | 13/27 [00:00<00:01, 13.03it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 32:  52%|█████▏    | 14/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=72.50, train_loss_epoch=72.70]
Epoch 32:  52%|█████▏    | 14/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.70]
Epoch 32:  56%|█████▌    | 15/27 [00:01<00:00, 13.67it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.70]
Epoch 32:  56%|█████▌    | 15/27 [00:01<00:00, 13.66it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=72.70]
Epoch 32:  59%|█████▉    | 16/27 [00:01<00:00, 14.01it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=72.70]
Epoch 32:  59%|█████▉    | 16/27 [00:01<00:00, 14.00it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  63%|██████▎   | 17/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  63%|██████▎   | 17/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.70]
Epoch 32:  67%|██████▋   | 18/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.70]
Epoch 32:  67%|██████▋   | 18/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=72.70]
Epoch 32:  70%|███████   | 19/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=72.70]
Epoch 32:  70%|███████   | 19/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=72.70]
Epoch 32:  74%|███████▍  | 20/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=72.40, train_loss_epoch=72.70]
Epoch 32:  74%|███████▍  | 20/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  78%|███████▊  | 21/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  78%|███████▊  | 21/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  81%|████████▏ | 22/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  81%|████████▏ | 22/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.70]
Epoch 32:  85%|████████▌ | 23/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.70]
Epoch 32:  85%|████████▌ | 23/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=72.70]
Epoch 32:  89%|████████▉ | 24/27 [00:01<00:00, 15.60it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=72.70]
Epoch 32:  89%|████████▉ | 24/27 [00:01<00:00, 15.60it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  93%|█████████▎| 25/27 [00:01<00:00, 15.69it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.70]
Epoch 32:  93%|█████████▎| 25/27 [00:01<00:00, 15.68it/s, v_num=0, train_loss_step=72.30, train_loss_epoch=72.70]
Epoch 32:  96%|█████████▋| 26/27 [00:01<00:00, 15.83it/s, v_num=0, train_loss_step=72.30, train_loss_epoch=72.70]
Epoch 32:  96%|█████████▋| 26/27 [00:01<00:00, 15.82it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=72.70]
Epoch 32: 100%|██████████| 27/27 [00:01<00:00, 15.99it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=72.70]
Epoch 32: 100%|██████████| 27/27 [00:01<00:00, 15.98it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.70]
Epoch 32: 100%|██████████| 27/27 [00:01<00:00, 15.96it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 32:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]         
Epoch 33:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33:   4%|▎         | 1/27 [00:00<00:09,  2.82it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33:   4%|▎         | 1/27 [00:00<00:09,  2.80it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:   7%|▋         | 2/27 [00:00<00:05,  4.74it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:   7%|▋         | 2/27 [00:00<00:05,  4.73it/s, v_num=0, train_loss_step=72.30, train_loss_epoch=72.30]
Epoch 33:  11%|█         | 3/27 [00:00<00:03,  6.30it/s, v_num=0, train_loss_step=72.30, train_loss_epoch=72.30]
Epoch 33:  11%|█         | 3/27 [00:00<00:03,  6.28it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=72.30]
Epoch 33:  15%|█▍        | 4/27 [00:00<00:03,  7.48it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=72.30]
Epoch 33:  15%|█▍        | 4/27 [00:00<00:03,  7.47it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  19%|█▊        | 5/27 [00:00<00:02,  8.36it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  19%|█▊        | 5/27 [00:00<00:02,  8.35it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  22%|██▏       | 6/27 [00:00<00:02,  9.31it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  22%|██▏       | 6/27 [00:00<00:02,  9.30it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  26%|██▌       | 7/27 [00:00<00:01, 10.13it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33:  30%|██▉       | 8/27 [00:00<00:01, 10.79it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33:  30%|██▉       | 8/27 [00:00<00:01, 10.78it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  33%|███▎      | 9/27 [00:00<00:01, 11.40it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  33%|███▎      | 9/27 [00:00<00:01, 11.39it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=72.30]
Epoch 33:  37%|███▋      | 10/27 [00:00<00:01, 11.95it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=72.30]
Epoch 33:  37%|███▋      | 10/27 [00:00<00:01, 11.94it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.30]
Epoch 33:  41%|████      | 11/27 [00:00<00:01, 12.44it/s, v_num=0, train_loss_step=72.10, train_loss_epoch=72.30]
Epoch 33:  41%|████      | 11/27 [00:00<00:01, 12.42it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33:  44%|████▍     | 12/27 [00:00<00:01, 12.93it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33:  44%|████▍     | 12/27 [00:00<00:01, 12.92it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  48%|████▊     | 13/27 [00:00<00:01, 13.26it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  48%|████▊     | 13/27 [00:00<00:01, 13.25it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33:  52%|█████▏    | 14/27 [00:01<00:00, 13.59it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33:  52%|█████▏    | 14/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=71.60, train_loss_epoch=72.30]
Epoch 33:  56%|█████▌    | 15/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=71.60, train_loss_epoch=72.30]
Epoch 33:  56%|█████▌    | 15/27 [00:01<00:00, 13.90it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  59%|█████▉    | 16/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  59%|█████▉    | 16/27 [00:01<00:00, 14.14it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=72.30]
Epoch 33:  63%|██████▎   | 17/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=72.30]
Epoch 33:  63%|██████▎   | 17/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  67%|██████▋   | 18/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  67%|██████▋   | 18/27 [00:01<00:00, 14.59it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=72.30]
Epoch 33:  70%|███████   | 19/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=72.30]
Epoch 33:  70%|███████   | 19/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=72.30]
Epoch 33:  74%|███████▍  | 20/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=72.30]
Epoch 33:  74%|███████▍  | 20/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=71.50, train_loss_epoch=72.30]
Epoch 33:  78%|███████▊  | 21/27 [00:01<00:00, 15.08it/s, v_num=0, train_loss_step=71.50, train_loss_epoch=72.30]
Epoch 33:  78%|███████▊  | 21/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  81%|████████▏ | 22/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  81%|████████▏ | 22/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  85%|████████▌ | 23/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  85%|████████▌ | 23/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  89%|████████▉ | 24/27 [00:01<00:00, 15.41it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  89%|████████▉ | 24/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  93%|█████████▎| 25/27 [00:01<00:00, 15.53it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=72.30]
Epoch 33:  93%|█████████▎| 25/27 [00:01<00:00, 15.52it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  96%|█████████▋| 26/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=72.20, train_loss_epoch=72.30]
Epoch 33:  96%|█████████▋| 26/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33: 100%|██████████| 27/27 [00:01<00:00, 15.85it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=72.30]
Epoch 33: 100%|██████████| 27/27 [00:01<00:00, 15.84it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=72.30]
Epoch 33: 100%|██████████| 27/27 [00:01<00:00, 15.82it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.90]
Epoch 33:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.90]         
Epoch 34:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.90]
Epoch 34:   4%|▎         | 1/27 [00:00<00:08,  2.97it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.90]
Epoch 34:   4%|▎         | 1/27 [00:00<00:08,  2.95it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:   7%|▋         | 2/27 [00:00<00:05,  4.82it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:   7%|▋         | 2/27 [00:00<00:05,  4.81it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  11%|█         | 3/27 [00:00<00:03,  6.29it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  11%|█         | 3/27 [00:00<00:03,  6.28it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34:  15%|█▍        | 4/27 [00:00<00:03,  7.55it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34:  15%|█▍        | 4/27 [00:00<00:03,  7.54it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34:  19%|█▊        | 5/27 [00:00<00:02,  8.67it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34:  19%|█▊        | 5/27 [00:00<00:02,  8.65it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=71.90]
Epoch 34:  22%|██▏       | 6/27 [00:00<00:02,  9.47it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=71.90]
Epoch 34:  22%|██▏       | 6/27 [00:00<00:02,  9.46it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=71.90]
Epoch 34:  26%|██▌       | 7/27 [00:00<00:01, 10.07it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=71.90]
Epoch 34:  26%|██▌       | 7/27 [00:00<00:01, 10.05it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  30%|██▉       | 8/27 [00:00<00:01, 10.42it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  30%|██▉       | 8/27 [00:00<00:01, 10.41it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  33%|███▎      | 9/27 [00:00<00:01, 10.86it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  33%|███▎      | 9/27 [00:00<00:01, 10.85it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=71.90]
Epoch 34:  37%|███▋      | 10/27 [00:00<00:01, 11.24it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=71.90]
Epoch 34:  37%|███▋      | 10/27 [00:00<00:01, 11.23it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=71.90]
Epoch 34:  41%|████      | 11/27 [00:00<00:01, 11.67it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=71.90]
Epoch 34:  41%|████      | 11/27 [00:00<00:01, 11.66it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34:  44%|████▍     | 12/27 [00:00<00:01, 12.07it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34:  44%|████▍     | 12/27 [00:00<00:01, 12.06it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  48%|████▊     | 13/27 [00:01<00:01, 12.46it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  48%|████▊     | 13/27 [00:01<00:01, 12.45it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34:  52%|█████▏    | 14/27 [00:01<00:01, 12.81it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34:  52%|█████▏    | 14/27 [00:01<00:01, 12.80it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.90]
Epoch 34:  56%|█████▌    | 15/27 [00:01<00:00, 13.07it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.90]
Epoch 34:  56%|█████▌    | 15/27 [00:01<00:00, 13.05it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  59%|█████▉    | 16/27 [00:01<00:00, 13.39it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  59%|█████▉    | 16/27 [00:01<00:00, 13.37it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=71.90]
Epoch 34:  63%|██████▎   | 17/27 [00:01<00:00, 13.64it/s, v_num=0, train_loss_step=71.90, train_loss_epoch=71.90]
Epoch 34:  63%|██████▎   | 17/27 [00:01<00:00, 13.63it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=71.90]
Epoch 34:  67%|██████▋   | 18/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=71.90]
Epoch 34:  67%|██████▋   | 18/27 [00:01<00:00, 13.87it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.90]
Epoch 34:  70%|███████   | 19/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.90]
Epoch 34:  70%|███████   | 19/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.90]
Epoch 34:  74%|███████▍  | 20/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.90]
Epoch 34:  74%|███████▍  | 20/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=71.90]
Epoch 34:  78%|███████▊  | 21/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=72.00, train_loss_epoch=71.90]
Epoch 34:  78%|███████▊  | 21/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  81%|████████▏ | 22/27 [00:01<00:00, 14.59it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.90]
Epoch 34:  81%|████████▏ | 22/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.90]
Epoch 34:  85%|████████▌ | 23/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.90]
Epoch 34:  85%|████████▌ | 23/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.90]
Epoch 34:  89%|████████▉ | 24/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.90]
Epoch 34:  89%|████████▉ | 24/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=71.50, train_loss_epoch=71.90]
Epoch 34:  93%|█████████▎| 25/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=71.50, train_loss_epoch=71.90]
Epoch 34:  93%|█████████▎| 25/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.90]
Epoch 34:  96%|█████████▋| 26/27 [00:01<00:00, 15.08it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.90]
Epoch 34:  96%|█████████▋| 26/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.90]
Epoch 34: 100%|██████████| 27/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.90]
Epoch 34: 100%|██████████| 27/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.90]
Epoch 34: 100%|██████████| 27/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.50]
Epoch 34:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.50]         
Epoch 35:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.50]
Epoch 35:   4%|▎         | 1/27 [00:00<00:08,  2.91it/s, v_num=0, train_loss_step=71.80, train_loss_epoch=71.50]
Epoch 35:   4%|▎         | 1/27 [00:00<00:08,  2.89it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.50]
Epoch 35:   7%|▋         | 2/27 [00:00<00:05,  4.99it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.50]
Epoch 35:   7%|▋         | 2/27 [00:00<00:05,  4.97it/s, v_num=0, train_loss_step=71.60, train_loss_epoch=71.50]
Epoch 35:  11%|█         | 3/27 [00:00<00:03,  6.60it/s, v_num=0, train_loss_step=71.60, train_loss_epoch=71.50]
Epoch 35:  11%|█         | 3/27 [00:00<00:03,  6.59it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.50]
Epoch 35:  15%|█▍        | 4/27 [00:00<00:02,  7.85it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.50]
Epoch 35:  15%|█▍        | 4/27 [00:00<00:02,  7.83it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=71.50]
Epoch 35:  19%|█▊        | 5/27 [00:00<00:02,  8.74it/s, v_num=0, train_loss_step=71.70, train_loss_epoch=71.50]
Epoch 35:  19%|█▊        | 5/27 [00:00<00:02,  8.73it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35:  22%|██▏       | 6/27 [00:00<00:02,  9.47it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35:  22%|██▏       | 6/27 [00:00<00:02,  9.46it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.50]
Epoch 35:  26%|██▌       | 7/27 [00:00<00:01, 10.12it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.50]
Epoch 35:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  30%|██▉       | 8/27 [00:00<00:01, 10.71it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  30%|██▉       | 8/27 [00:00<00:01, 10.70it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.50]
Epoch 35:  33%|███▎      | 9/27 [00:00<00:01, 11.23it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.50]
Epoch 35:  33%|███▎      | 9/27 [00:00<00:01, 11.22it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35:  37%|███▋      | 10/27 [00:00<00:01, 11.75it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35:  37%|███▋      | 10/27 [00:00<00:01, 11.74it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.50]
Epoch 35:  41%|████      | 11/27 [00:00<00:01, 12.17it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.50]
Epoch 35:  41%|████      | 11/27 [00:00<00:01, 12.15it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=71.50]
Epoch 35:  44%|████▍     | 12/27 [00:00<00:01, 12.59it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=71.50]
Epoch 35:  44%|████▍     | 12/27 [00:00<00:01, 12.57it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  48%|████▊     | 13/27 [00:01<00:01, 12.99it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  48%|████▊     | 13/27 [00:01<00:01, 12.98it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35:  52%|█████▏    | 14/27 [00:01<00:00, 13.15it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35:  52%|█████▏    | 14/27 [00:01<00:00, 13.14it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35:  56%|█████▌    | 15/27 [00:01<00:00, 13.41it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35:  56%|█████▌    | 15/27 [00:01<00:00, 13.40it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.50]
Epoch 35:  59%|█████▉    | 16/27 [00:01<00:00, 13.70it/s, v_num=0, train_loss_step=71.30, train_loss_epoch=71.50]
Epoch 35:  59%|█████▉    | 16/27 [00:01<00:00, 13.68it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.50]
Epoch 35:  63%|██████▎   | 17/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.50]
Epoch 35:  63%|██████▎   | 17/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  67%|██████▋   | 18/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  67%|██████▋   | 18/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  70%|███████   | 19/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  70%|███████   | 19/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  74%|███████▍  | 20/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.50]
Epoch 35:  74%|███████▍  | 20/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=70.80, train_loss_epoch=71.50]
Epoch 35:  78%|███████▊  | 21/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=70.80, train_loss_epoch=71.50]
Epoch 35:  78%|███████▊  | 21/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.50]
Epoch 35:  81%|████████▏ | 22/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.50]
Epoch 35:  81%|████████▏ | 22/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.50]
Epoch 35:  85%|████████▌ | 23/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.50]
Epoch 35:  85%|████████▌ | 23/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=71.50]
Epoch 35:  89%|████████▉ | 24/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=71.50]
Epoch 35:  89%|████████▉ | 24/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.50]
Epoch 35:  93%|█████████▎| 25/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=71.40, train_loss_epoch=71.50]
Epoch 35:  93%|█████████▎| 25/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.50]
Epoch 35:  96%|█████████▋| 26/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.50]
Epoch 35:  96%|█████████▋| 26/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35: 100%|██████████| 27/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.50]
Epoch 35: 100%|██████████| 27/27 [00:01<00:00, 15.41it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.50]
Epoch 35: 100%|██████████| 27/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 35:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]         
Epoch 36:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:   4%|▎         | 1/27 [00:00<00:09,  2.88it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.10]
Epoch 36:   7%|▋         | 2/27 [00:00<00:05,  5.00it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.10]
Epoch 36:   7%|▋         | 2/27 [00:00<00:05,  4.98it/s, v_num=0, train_loss_step=70.60, train_loss_epoch=71.10]
Epoch 36:  11%|█         | 3/27 [00:00<00:03,  6.66it/s, v_num=0, train_loss_step=70.60, train_loss_epoch=71.10]
Epoch 36:  11%|█         | 3/27 [00:00<00:03,  6.65it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.10]
Epoch 36:  15%|█▍        | 4/27 [00:00<00:02,  7.93it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.10]
Epoch 36:  15%|█▍        | 4/27 [00:00<00:02,  7.91it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=71.10]
Epoch 36:  19%|█▊        | 5/27 [00:00<00:02,  8.96it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=71.10]
Epoch 36:  19%|█▊        | 5/27 [00:00<00:02,  8.95it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.10]
Epoch 36:  22%|██▏       | 6/27 [00:00<00:02,  9.83it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.10]
Epoch 36:  22%|██▏       | 6/27 [00:00<00:02,  9.81it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.10]
Epoch 36:  26%|██▌       | 7/27 [00:00<00:01, 10.47it/s, v_num=0, train_loss_step=71.20, train_loss_epoch=71.10]
Epoch 36:  26%|██▌       | 7/27 [00:00<00:01, 10.46it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.10]
Epoch 36:  30%|██▉       | 8/27 [00:00<00:01, 11.03it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.10]
Epoch 36:  30%|██▉       | 8/27 [00:00<00:01, 11.01it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.10]
Epoch 36:  33%|███▎      | 9/27 [00:00<00:01, 11.55it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.10]
Epoch 36:  33%|███▎      | 9/27 [00:00<00:01, 11.54it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.10]
Epoch 36:  37%|███▋      | 10/27 [00:00<00:01, 12.02it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.10]
Epoch 36:  37%|███▋      | 10/27 [00:00<00:01, 12.01it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.10]
Epoch 36:  41%|████      | 11/27 [00:00<00:01, 12.46it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.10]
Epoch 36:  41%|████      | 11/27 [00:00<00:01, 12.45it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=71.10]
Epoch 36:  44%|████▍     | 12/27 [00:00<00:01, 12.92it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=71.10]
Epoch 36:  44%|████▍     | 12/27 [00:00<00:01, 12.91it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.10]
Epoch 36:  48%|████▊     | 13/27 [00:00<00:01, 13.32it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.10]
Epoch 36:  48%|████▊     | 13/27 [00:00<00:01, 13.31it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.10]
Epoch 36:  52%|█████▏    | 14/27 [00:01<00:00, 13.63it/s, v_num=0, train_loss_step=71.10, train_loss_epoch=71.10]
Epoch 36:  52%|█████▏    | 14/27 [00:01<00:00, 13.61it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=71.10]
Epoch 36:  56%|█████▌    | 15/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=71.10]
Epoch 36:  56%|█████▌    | 15/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:  59%|█████▉    | 16/27 [00:01<00:00, 14.21it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:  59%|█████▉    | 16/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.10]
Epoch 36:  63%|██████▎   | 17/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=71.00, train_loss_epoch=71.10]
Epoch 36:  63%|██████▎   | 17/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=70.60, train_loss_epoch=71.10]
Epoch 36:  67%|██████▋   | 18/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=70.60, train_loss_epoch=71.10]
Epoch 36:  67%|██████▋   | 18/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.10]
Epoch 36:  70%|███████   | 19/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.10]
Epoch 36:  70%|███████   | 19/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:  74%|███████▍  | 20/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:  74%|███████▍  | 20/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.10]
Epoch 36:  78%|███████▊  | 21/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=71.10]
Epoch 36:  78%|███████▊  | 21/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=71.10]
Epoch 36:  81%|████████▏ | 22/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=71.10]
Epoch 36:  81%|████████▏ | 22/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=70.60, train_loss_epoch=71.10]
Epoch 36:  85%|████████▌ | 23/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=70.60, train_loss_epoch=71.10]
Epoch 36:  85%|████████▌ | 23/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=71.10]
Epoch 36:  89%|████████▉ | 24/27 [00:01<00:00, 15.68it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=71.10]
Epoch 36:  89%|████████▉ | 24/27 [00:01<00:00, 15.68it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:  93%|█████████▎| 25/27 [00:01<00:00, 15.86it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:  93%|█████████▎| 25/27 [00:01<00:00, 15.85it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:  96%|█████████▋| 26/27 [00:01<00:00, 15.97it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36:  96%|█████████▋| 26/27 [00:01<00:00, 15.96it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36: 100%|██████████| 27/27 [00:01<00:00, 16.24it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=71.10]
Epoch 36: 100%|██████████| 27/27 [00:01<00:00, 16.23it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=71.10]
Epoch 36: 100%|██████████| 27/27 [00:01<00:00, 16.21it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 36:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]         
Epoch 37:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:   4%|▎         | 1/27 [00:00<00:09,  2.85it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:   4%|▎         | 1/27 [00:00<00:09,  2.83it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:   7%|▋         | 2/27 [00:00<00:05,  4.91it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:   7%|▋         | 2/27 [00:00<00:05,  4.89it/s, v_num=0, train_loss_step=70.80, train_loss_epoch=70.80]
Epoch 37:  11%|█         | 3/27 [00:00<00:03,  6.54it/s, v_num=0, train_loss_step=70.80, train_loss_epoch=70.80]
Epoch 37:  11%|█         | 3/27 [00:00<00:03,  6.53it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=70.80]
Epoch 37:  15%|█▍        | 4/27 [00:00<00:02,  7.72it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=70.80]
Epoch 37:  15%|█▍        | 4/27 [00:00<00:02,  7.71it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=70.80]
Epoch 37:  19%|█▊        | 5/27 [00:00<00:02,  8.78it/s, v_num=0, train_loss_step=70.90, train_loss_epoch=70.80]
Epoch 37:  19%|█▊        | 5/27 [00:00<00:02,  8.77it/s, v_num=0, train_loss_step=70.80, train_loss_epoch=70.80]
Epoch 37:  22%|██▏       | 6/27 [00:00<00:02,  9.61it/s, v_num=0, train_loss_step=70.80, train_loss_epoch=70.80]
Epoch 37:  22%|██▏       | 6/27 [00:00<00:02,  9.59it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  26%|██▌       | 7/27 [00:00<00:01, 10.33it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  26%|██▌       | 7/27 [00:00<00:01, 10.32it/s, v_num=0, train_loss_step=70.20, train_loss_epoch=70.80]
Epoch 37:  30%|██▉       | 8/27 [00:00<00:01, 10.87it/s, v_num=0, train_loss_step=70.20, train_loss_epoch=70.80]
Epoch 37:  30%|██▉       | 8/27 [00:00<00:01, 10.86it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  33%|███▎      | 9/27 [00:00<00:01, 11.45it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  33%|███▎      | 9/27 [00:00<00:01, 11.44it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  37%|███▋      | 10/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  37%|███▋      | 10/27 [00:00<00:01, 11.89it/s, v_num=0, train_loss_step=70.20, train_loss_epoch=70.80]
Epoch 37:  41%|████      | 11/27 [00:00<00:01, 12.33it/s, v_num=0, train_loss_step=70.20, train_loss_epoch=70.80]
Epoch 37:  41%|████      | 11/27 [00:00<00:01, 12.32it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  44%|████▍     | 12/27 [00:00<00:01, 12.77it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  44%|████▍     | 12/27 [00:00<00:01, 12.76it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  48%|████▊     | 13/27 [00:00<00:01, 13.20it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  48%|████▊     | 13/27 [00:00<00:01, 13.18it/s, v_num=0, train_loss_step=70.80, train_loss_epoch=70.80]
Epoch 37:  52%|█████▏    | 14/27 [00:01<00:00, 13.53it/s, v_num=0, train_loss_step=70.80, train_loss_epoch=70.80]
Epoch 37:  52%|█████▏    | 14/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  56%|█████▌    | 15/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  56%|█████▌    | 15/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  59%|█████▉    | 16/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.80]
Epoch 37:  59%|█████▉    | 16/27 [00:01<00:00, 14.14it/s, v_num=0, train_loss_step=70.60, train_loss_epoch=70.80]
Epoch 37:  63%|██████▎   | 17/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=70.60, train_loss_epoch=70.80]
Epoch 37:  63%|██████▎   | 17/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.80]
Epoch 37:  67%|██████▋   | 18/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.80]
Epoch 37:  67%|██████▋   | 18/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.80]
Epoch 37:  70%|███████   | 19/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.80]
Epoch 37:  70%|███████   | 19/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=70.80]
Epoch 37:  74%|███████▍  | 20/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=70.70, train_loss_epoch=70.80]
Epoch 37:  74%|███████▍  | 20/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  78%|███████▊  | 21/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  78%|███████▊  | 21/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  81%|████████▏ | 22/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  81%|████████▏ | 22/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.80]
Epoch 37:  85%|████████▌ | 23/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.80]
Epoch 37:  85%|████████▌ | 23/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  89%|████████▉ | 24/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37:  89%|████████▉ | 24/27 [00:01<00:00, 15.45it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.80]
Epoch 37:  93%|█████████▎| 25/27 [00:01<00:00, 15.61it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.80]
Epoch 37:  93%|█████████▎| 25/27 [00:01<00:00, 15.60it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.80]
Epoch 37:  96%|█████████▋| 26/27 [00:01<00:00, 15.74it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.80]
Epoch 37:  96%|█████████▋| 26/27 [00:01<00:00, 15.74it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37: 100%|██████████| 27/27 [00:01<00:00, 15.96it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.80]
Epoch 37: 100%|██████████| 27/27 [00:01<00:00, 15.95it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.80]
Epoch 37: 100%|██████████| 27/27 [00:01<00:00, 15.94it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 37:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]         
Epoch 38:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 38:   4%|▎         | 1/27 [00:00<00:09,  2.80it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 38:   4%|▎         | 1/27 [00:00<00:09,  2.78it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:   7%|▋         | 2/27 [00:00<00:05,  4.87it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:   7%|▋         | 2/27 [00:00<00:05,  4.86it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.40]
Epoch 38:  11%|█         | 3/27 [00:00<00:03,  6.46it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.40]
Epoch 38:  11%|█         | 3/27 [00:00<00:03,  6.45it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=70.40]
Epoch 38:  15%|█▍        | 4/27 [00:00<00:03,  7.64it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=70.40]
Epoch 38:  15%|█▍        | 4/27 [00:00<00:03,  7.63it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.40]
Epoch 38:  19%|█▊        | 5/27 [00:00<00:02,  8.70it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.40]
Epoch 38:  19%|█▊        | 5/27 [00:00<00:02,  8.68it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 38:  22%|██▏       | 6/27 [00:00<00:02,  9.51it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 38:  22%|██▏       | 6/27 [00:00<00:02,  9.50it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:  26%|██▌       | 7/27 [00:00<00:01, 10.12it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=70.40]
Epoch 38:  30%|██▉       | 8/27 [00:00<00:01, 10.73it/s, v_num=0, train_loss_step=70.50, train_loss_epoch=70.40]
Epoch 38:  30%|██▉       | 8/27 [00:00<00:01, 10.72it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.40]
Epoch 38:  33%|███▎      | 9/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=70.30, train_loss_epoch=70.40]
Epoch 38:  33%|███▎      | 9/27 [00:00<00:01, 11.35it/s, v_num=0, train_loss_step=70.20, train_loss_epoch=70.40]
Epoch 38:  37%|███▋      | 10/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=70.20, train_loss_epoch=70.40]
Epoch 38:  37%|███▋      | 10/27 [00:00<00:01, 11.89it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.40]
Epoch 38:  41%|████      | 11/27 [00:00<00:01, 12.31it/s, v_num=0, train_loss_step=70.40, train_loss_epoch=70.40]
Epoch 38:  41%|████      | 11/27 [00:00<00:01, 12.29it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.40]
Epoch 38:  44%|████▍     | 12/27 [00:00<00:01, 12.73it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.40]
Epoch 38:  44%|████▍     | 12/27 [00:00<00:01, 12.71it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  48%|████▊     | 13/27 [00:00<00:01, 13.10it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  48%|████▊     | 13/27 [00:00<00:01, 13.09it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 38:  52%|█████▏    | 14/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 38:  52%|█████▏    | 14/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  56%|█████▌    | 15/27 [00:01<00:00, 13.76it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  56%|█████▌    | 15/27 [00:01<00:00, 13.75it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 38:  59%|█████▉    | 16/27 [00:01<00:00, 13.97it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.40]
Epoch 38:  59%|█████▉    | 16/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=70.40]
Epoch 38:  63%|██████▎   | 17/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=70.40]
Epoch 38:  63%|██████▎   | 17/27 [00:01<00:00, 14.20it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  67%|██████▋   | 18/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  67%|██████▋   | 18/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  70%|███████   | 19/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  70%|███████   | 19/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  74%|███████▍  | 20/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  74%|███████▍  | 20/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:  78%|███████▊  | 21/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:  78%|███████▊  | 21/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:  81%|████████▏ | 22/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:  81%|████████▏ | 22/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  85%|████████▌ | 23/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.40]
Epoch 38:  85%|████████▌ | 23/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=70.20, train_loss_epoch=70.40]
Epoch 38:  89%|████████▉ | 24/27 [00:01<00:00, 15.43it/s, v_num=0, train_loss_step=70.20, train_loss_epoch=70.40]
Epoch 38:  89%|████████▉ | 24/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:  93%|█████████▎| 25/27 [00:01<00:00, 15.54it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.40]
Epoch 38:  93%|█████████▎| 25/27 [00:01<00:00, 15.53it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.40]
Epoch 38:  96%|█████████▋| 26/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.40]
Epoch 38:  96%|█████████▋| 26/27 [00:01<00:00, 15.62it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.40]
Epoch 38: 100%|██████████| 27/27 [00:01<00:00, 15.85it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.40]
Epoch 38: 100%|██████████| 27/27 [00:01<00:00, 15.84it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.40]
Epoch 38: 100%|██████████| 27/27 [00:01<00:00, 15.82it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 38:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]         
Epoch 39:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:   4%|▎         | 1/27 [00:00<00:09,  2.83it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:   4%|▎         | 1/27 [00:00<00:09,  2.81it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.00]
Epoch 39:   7%|▋         | 2/27 [00:00<00:05,  4.74it/s, v_num=0, train_loss_step=69.90, train_loss_epoch=70.00]
Epoch 39:   7%|▋         | 2/27 [00:00<00:05,  4.73it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  11%|█         | 3/27 [00:00<00:03,  6.27it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  11%|█         | 3/27 [00:00<00:03,  6.25it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.00]
Epoch 39:  15%|█▍        | 4/27 [00:00<00:03,  7.39it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.00]
Epoch 39:  15%|█▍        | 4/27 [00:00<00:03,  7.38it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  19%|█▊        | 5/27 [00:00<00:02,  8.42it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  19%|█▊        | 5/27 [00:00<00:02,  8.40it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  22%|██▏       | 6/27 [00:00<00:02,  9.27it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  22%|██▏       | 6/27 [00:00<00:02,  9.26it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  26%|██▌       | 7/27 [00:00<00:02,  9.63it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  26%|██▌       | 7/27 [00:00<00:02,  9.62it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  30%|██▉       | 8/27 [00:00<00:01, 10.24it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  30%|██▉       | 8/27 [00:00<00:01, 10.23it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  33%|███▎      | 9/27 [00:00<00:01, 10.76it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  33%|███▎      | 9/27 [00:00<00:01, 10.75it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  37%|███▋      | 10/27 [00:00<00:01, 11.26it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  37%|███▋      | 10/27 [00:00<00:01, 11.25it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  41%|████      | 11/27 [00:00<00:01, 11.73it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  41%|████      | 11/27 [00:00<00:01, 11.72it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.00]
Epoch 39:  44%|████▍     | 12/27 [00:00<00:01, 12.14it/s, v_num=0, train_loss_step=70.00, train_loss_epoch=70.00]
Epoch 39:  44%|████▍     | 12/27 [00:00<00:01, 12.13it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  48%|████▊     | 13/27 [00:01<00:01, 12.51it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  48%|████▊     | 13/27 [00:01<00:01, 12.50it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=70.00]
Epoch 39:  52%|█████▏    | 14/27 [00:01<00:01, 12.88it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=70.00]
Epoch 39:  52%|█████▏    | 14/27 [00:01<00:01, 12.86it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  56%|█████▌    | 15/27 [00:01<00:00, 13.15it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  56%|█████▌    | 15/27 [00:01<00:00, 13.14it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  59%|█████▉    | 16/27 [00:01<00:00, 13.45it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=70.00]
Epoch 39:  59%|█████▉    | 16/27 [00:01<00:00, 13.44it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=70.00]
Epoch 39:  63%|██████▎   | 17/27 [00:01<00:00, 13.74it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=70.00]
Epoch 39:  63%|██████▎   | 17/27 [00:01<00:00, 13.73it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.00]
Epoch 39:  67%|██████▋   | 18/27 [00:01<00:00, 13.97it/s, v_num=0, train_loss_step=70.10, train_loss_epoch=70.00]
Epoch 39:  67%|██████▋   | 18/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  70%|███████   | 19/27 [00:01<00:00, 14.21it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  70%|███████   | 19/27 [00:01<00:00, 14.20it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=70.00]
Epoch 39:  74%|███████▍  | 20/27 [00:01<00:00, 14.32it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=70.00]
Epoch 39:  74%|███████▍  | 20/27 [00:01<00:00, 14.31it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=70.00]
Epoch 39:  78%|███████▊  | 21/27 [00:01<00:00, 14.24it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=70.00]
Epoch 39:  78%|███████▊  | 21/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  81%|████████▏ | 22/27 [00:01<00:00, 14.31it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=70.00]
Epoch 39:  81%|████████▏ | 22/27 [00:01<00:00, 14.30it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=70.00]
Epoch 39:  85%|████████▌ | 23/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=70.00]
Epoch 39:  85%|████████▌ | 23/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=70.00]
Epoch 39:  89%|████████▉ | 24/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=70.00]
Epoch 39:  89%|████████▉ | 24/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=70.00]
Epoch 39:  93%|█████████▎| 25/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=70.00]
Epoch 39:  93%|█████████▎| 25/27 [00:01<00:00, 14.57it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=70.00]
Epoch 39:  96%|█████████▋| 26/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=70.00]
Epoch 39:  96%|█████████▋| 26/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=70.00]
Epoch 39: 100%|██████████| 27/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=70.00]
Epoch 39: 100%|██████████| 27/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=70.00]
Epoch 39: 100%|██████████| 27/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.70]
Epoch 39:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.70]         
Epoch 40:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.70]
Epoch 40:   4%|▎         | 1/27 [00:00<00:08,  3.06it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.70]
Epoch 40:   4%|▎         | 1/27 [00:00<00:08,  3.04it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=69.70]
Epoch 40:   7%|▋         | 2/27 [00:00<00:04,  5.09it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=69.70]
Epoch 40:   7%|▋         | 2/27 [00:00<00:04,  5.07it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.70]
Epoch 40:  11%|█         | 3/27 [00:00<00:03,  6.68it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.70]
Epoch 40:  11%|█         | 3/27 [00:00<00:03,  6.66it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=69.70]
Epoch 40:  15%|█▍        | 4/27 [00:00<00:02,  7.87it/s, v_num=0, train_loss_step=69.60, train_loss_epoch=69.70]
Epoch 40:  15%|█▍        | 4/27 [00:00<00:02,  7.86it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.70]
Epoch 40:  19%|█▊        | 5/27 [00:00<00:02,  8.85it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.70]
Epoch 40:  19%|█▊        | 5/27 [00:00<00:02,  8.83it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  22%|██▏       | 6/27 [00:00<00:02,  9.63it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  22%|██▏       | 6/27 [00:00<00:02,  9.61it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  26%|██▌       | 7/27 [00:00<00:01, 10.10it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=69.70]
Epoch 40:  30%|██▉       | 8/27 [00:00<00:01, 10.81it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=69.70]
Epoch 40:  30%|██▉       | 8/27 [00:00<00:01, 10.80it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  33%|███▎      | 9/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  33%|███▎      | 9/27 [00:00<00:01, 11.34it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.70]
Epoch 40:  37%|███▋      | 10/27 [00:00<00:01, 11.84it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.70]
Epoch 40:  37%|███▋      | 10/27 [00:00<00:01, 11.82it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.70]
Epoch 40:  41%|████      | 11/27 [00:00<00:01, 12.31it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.70]
Epoch 40:  41%|████      | 11/27 [00:00<00:01, 12.29it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  44%|████▍     | 12/27 [00:00<00:01, 12.74it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  44%|████▍     | 12/27 [00:00<00:01, 12.73it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.70]
Epoch 40:  48%|████▊     | 13/27 [00:00<00:01, 13.15it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.70]
Epoch 40:  48%|████▊     | 13/27 [00:00<00:01, 13.13it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.70]
Epoch 40:  52%|█████▏    | 14/27 [00:01<00:00, 13.48it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.70]
Epoch 40:  52%|█████▏    | 14/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  56%|█████▌    | 15/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  56%|█████▌    | 15/27 [00:01<00:00, 13.70it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.70]
Epoch 40:  59%|█████▉    | 16/27 [00:01<00:00, 14.00it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.70]
Epoch 40:  59%|█████▉    | 16/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=69.70]
Epoch 40:  63%|██████▎   | 17/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=69.70]
Epoch 40:  63%|██████▎   | 17/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.70]
Epoch 40:  67%|██████▋   | 18/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.70]
Epoch 40:  67%|██████▋   | 18/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=69.70]
Epoch 40:  70%|███████   | 19/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=69.80, train_loss_epoch=69.70]
Epoch 40:  70%|███████   | 19/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.70]
Epoch 40:  74%|███████▍  | 20/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.70]
Epoch 40:  74%|███████▍  | 20/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=69.70]
Epoch 40:  78%|███████▊  | 21/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=69.70]
Epoch 40:  78%|███████▊  | 21/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.70]
Epoch 40:  81%|████████▏ | 22/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.70]
Epoch 40:  81%|████████▏ | 22/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  85%|████████▌ | 23/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.70]
Epoch 40:  85%|████████▌ | 23/27 [00:01<00:00, 15.08it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.70]
Epoch 40:  89%|████████▉ | 24/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.70]
Epoch 40:  89%|████████▉ | 24/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.70]
Epoch 40:  93%|█████████▎| 25/27 [00:01<00:00, 15.34it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.70]
Epoch 40:  93%|█████████▎| 25/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=69.70]
Epoch 40:  96%|█████████▋| 26/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=69.70, train_loss_epoch=69.70]
Epoch 40:  96%|█████████▋| 26/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.70]
Epoch 40: 100%|██████████| 27/27 [00:01<00:00, 15.56it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.70]
Epoch 40: 100%|██████████| 27/27 [00:01<00:00, 15.55it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.70]
Epoch 40: 100%|██████████| 27/27 [00:01<00:00, 15.53it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 40:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]         
Epoch 41:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:   4%|▎         | 1/27 [00:00<00:08,  2.99it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:   4%|▎         | 1/27 [00:00<00:08,  2.97it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.30]
Epoch 41:   7%|▋         | 2/27 [00:00<00:04,  5.13it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.30]
Epoch 41:   7%|▋         | 2/27 [00:00<00:04,  5.12it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=69.30]
Epoch 41:  11%|█         | 3/27 [00:00<00:03,  6.67it/s, v_num=0, train_loss_step=69.50, train_loss_epoch=69.30]
Epoch 41:  11%|█         | 3/27 [00:00<00:03,  6.65it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.30]
Epoch 41:  15%|█▍        | 4/27 [00:00<00:02,  7.98it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.30]
Epoch 41:  15%|█▍        | 4/27 [00:00<00:02,  7.97it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  19%|█▊        | 5/27 [00:00<00:02,  8.78it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  19%|█▊        | 5/27 [00:00<00:02,  8.76it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.30]
Epoch 41:  22%|██▏       | 6/27 [00:00<00:02,  9.58it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.30]
Epoch 41:  22%|██▏       | 6/27 [00:00<00:02,  9.57it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41:  26%|██▌       | 7/27 [00:00<00:01, 10.36it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41:  26%|██▌       | 7/27 [00:00<00:01, 10.34it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41:  30%|██▉       | 8/27 [00:00<00:01, 10.94it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41:  30%|██▉       | 8/27 [00:00<00:01, 10.93it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.30]
Epoch 41:  33%|███▎      | 9/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.30]
Epoch 41:  33%|███▎      | 9/27 [00:00<00:01, 11.49it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.30]
Epoch 41:  37%|███▋      | 10/27 [00:00<00:01, 12.00it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.30]
Epoch 41:  37%|███▋      | 10/27 [00:00<00:01, 11.99it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.30]
Epoch 41:  41%|████      | 11/27 [00:00<00:01, 12.46it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.30]
Epoch 41:  41%|████      | 11/27 [00:00<00:01, 12.45it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.30]
Epoch 41:  44%|████▍     | 12/27 [00:00<00:01, 12.84it/s, v_num=0, train_loss_step=69.40, train_loss_epoch=69.30]
Epoch 41:  44%|████▍     | 12/27 [00:00<00:01, 12.83it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  48%|████▊     | 13/27 [00:00<00:01, 13.13it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  48%|████▊     | 13/27 [00:00<00:01, 13.12it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.30]
Epoch 41:  52%|█████▏    | 14/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=69.20, train_loss_epoch=69.30]
Epoch 41:  52%|█████▏    | 14/27 [00:01<00:00, 13.45it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.30]
Epoch 41:  56%|█████▌    | 15/27 [00:01<00:00, 13.74it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.30]
Epoch 41:  56%|█████▌    | 15/27 [00:01<00:00, 13.73it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  59%|█████▉    | 16/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  59%|█████▉    | 16/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.30]
Epoch 41:  63%|██████▎   | 17/27 [00:01<00:00, 14.09it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.30]
Epoch 41:  63%|██████▎   | 17/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  67%|██████▋   | 18/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  67%|██████▋   | 18/27 [00:01<00:00, 14.13it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.30]
Epoch 41:  70%|███████   | 19/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.30]
Epoch 41:  70%|███████   | 19/27 [00:01<00:00, 14.32it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  74%|███████▍  | 20/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  74%|███████▍  | 20/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41:  78%|███████▊  | 21/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41:  78%|███████▊  | 21/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.30]
Epoch 41:  81%|████████▏ | 22/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.30]
Epoch 41:  81%|████████▏ | 22/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  85%|████████▌ | 23/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41:  85%|████████▌ | 23/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.30]
Epoch 41:  89%|████████▉ | 24/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.30]
Epoch 41:  89%|████████▉ | 24/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41:  93%|█████████▎| 25/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41:  93%|█████████▎| 25/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.30]
Epoch 41:  96%|█████████▋| 26/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.30]
Epoch 41:  96%|█████████▋| 26/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41: 100%|██████████| 27/27 [00:01<00:00, 15.61it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.30]
Epoch 41: 100%|██████████| 27/27 [00:01<00:00, 15.60it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.30]
Epoch 41: 100%|██████████| 27/27 [00:01<00:00, 15.59it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.00]
Epoch 41:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.00]         
Epoch 42:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.00]
Epoch 42:   4%|▎         | 1/27 [00:00<00:08,  3.00it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.00]
Epoch 42:   4%|▎         | 1/27 [00:00<00:08,  2.98it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.00]
Epoch 42:   7%|▋         | 2/27 [00:00<00:04,  5.13it/s, v_num=0, train_loss_step=69.30, train_loss_epoch=69.00]
Epoch 42:   7%|▋         | 2/27 [00:00<00:04,  5.12it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.00]
Epoch 42:  11%|█         | 3/27 [00:00<00:03,  6.84it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.00]
Epoch 42:  11%|█         | 3/27 [00:00<00:03,  6.83it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.00]
Epoch 42:  15%|█▍        | 4/27 [00:00<00:02,  7.89it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.00]
Epoch 42:  15%|█▍        | 4/27 [00:00<00:02,  7.88it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.00]
Epoch 42:  19%|█▊        | 5/27 [00:00<00:02,  8.97it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.00]
Epoch 42:  19%|█▊        | 5/27 [00:00<00:02,  8.95it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.00]
Epoch 42:  22%|██▏       | 6/27 [00:00<00:02,  9.76it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.00]
Epoch 42:  22%|██▏       | 6/27 [00:00<00:02,  9.74it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.00]
Epoch 42:  26%|██▌       | 7/27 [00:00<00:01, 10.34it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.00]
Epoch 42:  26%|██▌       | 7/27 [00:00<00:01, 10.33it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.00]
Epoch 42:  30%|██▉       | 8/27 [00:00<00:01, 10.88it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.00]
Epoch 42:  30%|██▉       | 8/27 [00:00<00:01, 10.87it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.00]
Epoch 42:  33%|███▎      | 9/27 [00:00<00:01, 11.42it/s, v_num=0, train_loss_step=69.10, train_loss_epoch=69.00]
Epoch 42:  33%|███▎      | 9/27 [00:00<00:01, 11.40it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=69.00]
Epoch 42:  37%|███▋      | 10/27 [00:00<00:01, 11.88it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=69.00]
Epoch 42:  37%|███▋      | 10/27 [00:00<00:01, 11.86it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.00]
Epoch 42:  41%|████      | 11/27 [00:00<00:01, 12.26it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.00]
Epoch 42:  41%|████      | 11/27 [00:00<00:01, 12.25it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  44%|████▍     | 12/27 [00:00<00:01, 12.69it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  44%|████▍     | 12/27 [00:00<00:01, 12.68it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.00]
Epoch 42:  48%|████▊     | 13/27 [00:00<00:01, 13.07it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=69.00]
Epoch 42:  48%|████▊     | 13/27 [00:00<00:01, 13.06it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.00]
Epoch 42:  52%|█████▏    | 14/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=68.70, train_loss_epoch=69.00]
Epoch 42:  52%|█████▏    | 14/27 [00:01<00:00, 13.41it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  56%|█████▌    | 15/27 [00:01<00:00, 13.72it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  56%|█████▌    | 15/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.00]
Epoch 42:  59%|█████▉    | 16/27 [00:01<00:00, 14.01it/s, v_num=0, train_loss_step=69.00, train_loss_epoch=69.00]
Epoch 42:  59%|█████▉    | 16/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=69.00]
Epoch 42:  63%|██████▎   | 17/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=69.00]
Epoch 42:  63%|██████▎   | 17/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=69.00]
Epoch 42:  67%|██████▋   | 18/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=69.00]
Epoch 42:  67%|██████▋   | 18/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.00]
Epoch 42:  70%|███████   | 19/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.00]
Epoch 42:  70%|███████   | 19/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  74%|███████▍  | 20/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  74%|███████▍  | 20/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.00]
Epoch 42:  78%|███████▊  | 21/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.00]
Epoch 42:  78%|███████▊  | 21/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.00]
Epoch 42:  81%|████████▏ | 22/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.00]
Epoch 42:  81%|████████▏ | 22/27 [00:01<00:00, 15.08it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  85%|████████▌ | 23/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  85%|████████▌ | 23/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.00]
Epoch 42:  89%|████████▉ | 24/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=69.00]
Epoch 42:  89%|████████▉ | 24/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  93%|█████████▎| 25/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=69.00]
Epoch 42:  93%|█████████▎| 25/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=69.00]
Epoch 42:  96%|█████████▋| 26/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=69.00]
Epoch 42:  96%|█████████▋| 26/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=69.00]
Epoch 42: 100%|██████████| 27/27 [00:01<00:00, 15.86it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=69.00]
Epoch 42: 100%|██████████| 27/27 [00:01<00:00, 15.85it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=69.00]
Epoch 42: 100%|██████████| 27/27 [00:01<00:00, 15.84it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=68.70]
Epoch 42:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=68.70]         
Epoch 43:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=68.70]
Epoch 43:   4%|▎         | 1/27 [00:00<00:08,  2.94it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=68.70]
Epoch 43:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=68.70]
Epoch 43:   7%|▋         | 2/27 [00:00<00:05,  4.93it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=68.70]
Epoch 43:   7%|▋         | 2/27 [00:00<00:05,  4.92it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.70]
Epoch 43:  11%|█         | 3/27 [00:00<00:03,  6.53it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.70]
Epoch 43:  11%|█         | 3/27 [00:00<00:03,  6.52it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=68.70]
Epoch 43:  15%|█▍        | 4/27 [00:00<00:02,  7.74it/s, v_num=0, train_loss_step=68.80, train_loss_epoch=68.70]
Epoch 43:  15%|█▍        | 4/27 [00:00<00:02,  7.73it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.70]
Epoch 43:  19%|█▊        | 5/27 [00:00<00:02,  8.79it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.70]
Epoch 43:  19%|█▊        | 5/27 [00:00<00:02,  8.78it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=68.70]
Epoch 43:  22%|██▏       | 6/27 [00:00<00:02,  9.68it/s, v_num=0, train_loss_step=68.90, train_loss_epoch=68.70]
Epoch 43:  22%|██▏       | 6/27 [00:00<00:02,  9.67it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=68.70]
Epoch 43:  26%|██▌       | 7/27 [00:00<00:01, 10.29it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=68.70]
Epoch 43:  26%|██▌       | 7/27 [00:00<00:01, 10.27it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.70]
Epoch 43:  30%|██▉       | 8/27 [00:00<00:01, 10.87it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.70]
Epoch 43:  30%|██▉       | 8/27 [00:00<00:01, 10.85it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.70]
Epoch 43:  33%|███▎      | 9/27 [00:00<00:01, 11.43it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.70]
Epoch 43:  33%|███▎      | 9/27 [00:00<00:01, 11.42it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  37%|███▋      | 10/27 [00:00<00:01, 11.92it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  37%|███▋      | 10/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.70]
Epoch 43:  41%|████      | 11/27 [00:00<00:01, 12.33it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.70]
Epoch 43:  41%|████      | 11/27 [00:00<00:01, 12.32it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=68.70]
Epoch 43:  44%|████▍     | 12/27 [00:00<00:01, 12.74it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=68.70]
Epoch 43:  44%|████▍     | 12/27 [00:00<00:01, 12.72it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.70]
Epoch 43:  48%|████▊     | 13/27 [00:00<00:01, 13.08it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.70]
Epoch 43:  48%|████▊     | 13/27 [00:00<00:01, 13.07it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  52%|█████▏    | 14/27 [00:01<00:00, 13.39it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  52%|█████▏    | 14/27 [00:01<00:00, 13.37it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=68.70]
Epoch 43:  56%|█████▌    | 15/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=68.70]
Epoch 43:  56%|█████▌    | 15/27 [00:01<00:00, 13.70it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  59%|█████▉    | 16/27 [00:01<00:00, 13.97it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  59%|█████▉    | 16/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  63%|██████▎   | 17/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  63%|██████▎   | 17/27 [00:01<00:00, 14.21it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  67%|██████▋   | 18/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  67%|██████▋   | 18/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=68.70]
Epoch 43:  70%|███████   | 19/27 [00:01<00:00, 14.69it/s, v_num=0, train_loss_step=68.50, train_loss_epoch=68.70]
Epoch 43:  70%|███████   | 19/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.70]
Epoch 43:  74%|███████▍  | 20/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.70]
Epoch 43:  74%|███████▍  | 20/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.70]
Epoch 43:  78%|███████▊  | 21/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.70]
Epoch 43:  78%|███████▊  | 21/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  81%|████████▏ | 22/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.70]
Epoch 43:  81%|████████▏ | 22/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=68.70]
Epoch 43:  85%|████████▌ | 23/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=68.70]
Epoch 43:  85%|████████▌ | 23/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.70]
Epoch 43:  89%|████████▉ | 24/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.70]
Epoch 43:  89%|████████▉ | 24/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.70]
Epoch 43:  93%|█████████▎| 25/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.70]
Epoch 43:  93%|█████████▎| 25/27 [00:01<00:00, 15.48it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.70]
Epoch 43:  96%|█████████▋| 26/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.70]
Epoch 43:  96%|█████████▋| 26/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.70]
Epoch 43: 100%|██████████| 27/27 [00:01<00:00, 15.67it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.70]
Epoch 43: 100%|██████████| 27/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.70]
Epoch 43: 100%|██████████| 27/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.30]
Epoch 43:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.30]         
Epoch 44:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.30]
Epoch 44:   4%|▎         | 1/27 [00:00<00:08,  2.95it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.30]
Epoch 44:   4%|▎         | 1/27 [00:00<00:08,  2.93it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.30]
Epoch 44:   7%|▋         | 2/27 [00:00<00:05,  4.95it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.30]
Epoch 44:   7%|▋         | 2/27 [00:00<00:05,  4.94it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.30]
Epoch 44:  11%|█         | 3/27 [00:00<00:03,  6.54it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.30]
Epoch 44:  11%|█         | 3/27 [00:00<00:03,  6.53it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  15%|█▍        | 4/27 [00:00<00:02,  7.85it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  15%|█▍        | 4/27 [00:00<00:02,  7.84it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.30]
Epoch 44:  19%|█▊        | 5/27 [00:00<00:02,  8.92it/s, v_num=0, train_loss_step=68.60, train_loss_epoch=68.30]
Epoch 44:  19%|█▊        | 5/27 [00:00<00:02,  8.90it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=68.30]
Epoch 44:  22%|██▏       | 6/27 [00:00<00:02,  9.63it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=68.30]
Epoch 44:  22%|██▏       | 6/27 [00:00<00:02,  9.62it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.30]
Epoch 44:  26%|██▌       | 7/27 [00:00<00:01, 10.31it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.30]
Epoch 44:  26%|██▌       | 7/27 [00:00<00:01, 10.29it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.30]
Epoch 44:  30%|██▉       | 8/27 [00:00<00:01, 10.80it/s, v_num=0, train_loss_step=68.10, train_loss_epoch=68.30]
Epoch 44:  30%|██▉       | 8/27 [00:00<00:01, 10.79it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.30]
Epoch 44:  33%|███▎      | 9/27 [00:00<00:01, 11.29it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.30]
Epoch 44:  33%|███▎      | 9/27 [00:00<00:01, 11.28it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.30]
Epoch 44:  37%|███▋      | 10/27 [00:00<00:01, 11.64it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.30]
Epoch 44:  37%|███▋      | 10/27 [00:00<00:01, 11.62it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.30]
Epoch 44:  41%|████      | 11/27 [00:00<00:01, 12.04it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.30]
Epoch 44:  41%|████      | 11/27 [00:00<00:01, 12.02it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  44%|████▍     | 12/27 [00:00<00:01, 12.30it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  44%|████▍     | 12/27 [00:00<00:01, 12.29it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.30]
Epoch 44:  48%|████▊     | 13/27 [00:01<00:01, 12.65it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.30]
Epoch 44:  48%|████▊     | 13/27 [00:01<00:01, 12.64it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.30]
Epoch 44:  52%|█████▏    | 14/27 [00:01<00:01, 12.98it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.30]
Epoch 44:  52%|█████▏    | 14/27 [00:01<00:01, 12.97it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.30]
Epoch 44:  56%|█████▌    | 15/27 [00:01<00:00, 13.31it/s, v_num=0, train_loss_step=68.30, train_loss_epoch=68.30]
Epoch 44:  56%|█████▌    | 15/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.30]
Epoch 44:  59%|█████▉    | 16/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.30]
Epoch 44:  59%|█████▉    | 16/27 [00:01<00:00, 13.42it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  63%|██████▎   | 17/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  63%|██████▎   | 17/27 [00:01<00:00, 13.55it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.30]
Epoch 44:  67%|██████▋   | 18/27 [00:01<00:00, 13.78it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.30]
Epoch 44:  67%|██████▋   | 18/27 [00:01<00:00, 13.77it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=68.30]
Epoch 44:  70%|███████   | 19/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=68.30]
Epoch 44:  70%|███████   | 19/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.30]
Epoch 44:  74%|███████▍  | 20/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.30]
Epoch 44:  74%|███████▍  | 20/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.30]
Epoch 44:  78%|███████▊  | 21/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.30]
Epoch 44:  78%|███████▊  | 21/27 [00:01<00:00, 14.34it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.30]
Epoch 44:  81%|████████▏ | 22/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.30]
Epoch 44:  81%|████████▏ | 22/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.30]
Epoch 44:  85%|████████▌ | 23/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=68.20, train_loss_epoch=68.30]
Epoch 44:  85%|████████▌ | 23/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  89%|████████▉ | 24/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  89%|████████▉ | 24/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  93%|█████████▎| 25/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.30]
Epoch 44:  93%|█████████▎| 25/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=68.30]
Epoch 44:  96%|█████████▋| 26/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=68.30]
Epoch 44:  96%|█████████▋| 26/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.30]
Epoch 44: 100%|██████████| 27/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.30]
Epoch 44: 100%|██████████| 27/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.30]
Epoch 44: 100%|██████████| 27/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 44:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]         
Epoch 45:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:   4%|▎         | 1/27 [00:00<00:09,  2.74it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:   4%|▎         | 1/27 [00:00<00:09,  2.72it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.00]
Epoch 45:   7%|▋         | 2/27 [00:00<00:05,  4.64it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.00]
Epoch 45:   7%|▋         | 2/27 [00:00<00:05,  4.63it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  11%|█         | 3/27 [00:00<00:03,  6.22it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  11%|█         | 3/27 [00:00<00:03,  6.21it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.00]
Epoch 45:  15%|█▍        | 4/27 [00:00<00:03,  7.45it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.00]
Epoch 45:  15%|█▍        | 4/27 [00:00<00:03,  7.44it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  19%|█▊        | 5/27 [00:00<00:02,  8.44it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  19%|█▊        | 5/27 [00:00<00:02,  8.43it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=68.00]
Epoch 45:  22%|██▏       | 6/27 [00:00<00:02,  9.12it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=68.00]
Epoch 45:  22%|██▏       | 6/27 [00:00<00:02,  9.11it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.00]
Epoch 45:  26%|██▌       | 7/27 [00:00<00:02,  9.82it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.00]
Epoch 45:  26%|██▌       | 7/27 [00:00<00:02,  9.81it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.00]
Epoch 45:  30%|██▉       | 8/27 [00:00<00:01, 10.43it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.00]
Epoch 45:  30%|██▉       | 8/27 [00:00<00:01, 10.42it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  33%|███▎      | 9/27 [00:00<00:01, 10.96it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  33%|███▎      | 9/27 [00:00<00:01, 10.95it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.00]
Epoch 45:  37%|███▋      | 10/27 [00:00<00:01, 11.46it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.00]
Epoch 45:  37%|███▋      | 10/27 [00:00<00:01, 11.43it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  41%|████      | 11/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  41%|████      | 11/27 [00:00<00:01, 11.90it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=68.00]
Epoch 45:  44%|████▍     | 12/27 [00:00<00:01, 12.29it/s, v_num=0, train_loss_step=68.40, train_loss_epoch=68.00]
Epoch 45:  44%|████▍     | 12/27 [00:00<00:01, 12.28it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=68.00]
Epoch 45:  48%|████▊     | 13/27 [00:01<00:01, 12.68it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=68.00]
Epoch 45:  48%|████▊     | 13/27 [00:01<00:01, 12.67it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=68.00]
Epoch 45:  52%|█████▏    | 14/27 [00:01<00:01, 12.94it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=68.00]
Epoch 45:  52%|█████▏    | 14/27 [00:01<00:01, 12.93it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.00]
Epoch 45:  56%|█████▌    | 15/27 [00:01<00:00, 13.24it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.00]
Epoch 45:  56%|█████▌    | 15/27 [00:01<00:00, 13.23it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=68.00]
Epoch 45:  59%|█████▉    | 16/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=68.00]
Epoch 45:  59%|█████▉    | 16/27 [00:01<00:00, 13.50it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  63%|██████▎   | 17/27 [00:01<00:00, 13.74it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  63%|██████▎   | 17/27 [00:01<00:00, 13.73it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  67%|██████▋   | 18/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  67%|██████▋   | 18/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.00]
Epoch 45:  70%|███████   | 19/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=68.00]
Epoch 45:  70%|███████   | 19/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  74%|███████▍  | 20/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  74%|███████▍  | 20/27 [00:01<00:00, 14.21it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  78%|███████▊  | 21/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  78%|███████▊  | 21/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  81%|████████▏ | 22/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45:  81%|████████▏ | 22/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  85%|████████▌ | 23/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  85%|████████▌ | 23/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.00]
Epoch 45:  89%|████████▉ | 24/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=67.90, train_loss_epoch=68.00]
Epoch 45:  89%|████████▉ | 24/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.00]
Epoch 45:  93%|█████████▎| 25/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.00]
Epoch 45:  93%|█████████▎| 25/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  96%|█████████▋| 26/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=68.00]
Epoch 45:  96%|█████████▋| 26/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.00]
Epoch 45: 100%|██████████| 27/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=68.00, train_loss_epoch=68.00]
Epoch 45: 100%|██████████| 27/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=68.00]
Epoch 45: 100%|██████████| 27/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 45:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]         
Epoch 46:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:   4%|▎         | 1/27 [00:00<00:08,  3.07it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:   4%|▎         | 1/27 [00:00<00:08,  3.05it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:   7%|▋         | 2/27 [00:00<00:04,  5.29it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:   7%|▋         | 2/27 [00:00<00:04,  5.28it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.70]
Epoch 46:  11%|█         | 3/27 [00:00<00:03,  6.78it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.70]
Epoch 46:  11%|█         | 3/27 [00:00<00:03,  6.76it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  15%|█▍        | 4/27 [00:00<00:02,  8.07it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  15%|█▍        | 4/27 [00:00<00:02,  8.05it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.70]
Epoch 46:  19%|█▊        | 5/27 [00:00<00:02,  8.95it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.70]
Epoch 46:  19%|█▊        | 5/27 [00:00<00:02,  8.93it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.70]
Epoch 46:  22%|██▏       | 6/27 [00:00<00:02,  9.72it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.70]
Epoch 46:  22%|██▏       | 6/27 [00:00<00:02,  9.71it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.70]
Epoch 46:  26%|██▌       | 7/27 [00:00<00:01, 10.38it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.70]
Epoch 46:  26%|██▌       | 7/27 [00:00<00:01, 10.36it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.70]
Epoch 46:  30%|██▉       | 8/27 [00:00<00:01, 11.02it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.70]
Epoch 46:  30%|██▉       | 8/27 [00:00<00:01, 11.01it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.70]
Epoch 46:  33%|███▎      | 9/27 [00:00<00:01, 11.52it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.70]
Epoch 46:  33%|███▎      | 9/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  37%|███▋      | 10/27 [00:00<00:01, 12.06it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  37%|███▋      | 10/27 [00:00<00:01, 12.05it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  41%|████      | 11/27 [00:00<00:01, 12.44it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  41%|████      | 11/27 [00:00<00:01, 12.42it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=67.70]
Epoch 46:  44%|████▍     | 12/27 [00:00<00:01, 12.92it/s, v_num=0, train_loss_step=67.80, train_loss_epoch=67.70]
Epoch 46:  44%|████▍     | 12/27 [00:00<00:01, 12.91it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=67.70]
Epoch 46:  48%|████▊     | 13/27 [00:00<00:01, 13.26it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=67.70]
Epoch 46:  48%|████▊     | 13/27 [00:00<00:01, 13.25it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  52%|█████▏    | 14/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  52%|█████▏    | 14/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  56%|█████▌    | 15/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  56%|█████▌    | 15/27 [00:01<00:00, 13.77it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.70]
Epoch 46:  59%|█████▉    | 16/27 [00:01<00:00, 14.08it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.70]
Epoch 46:  59%|█████▉    | 16/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=67.70]
Epoch 46:  63%|██████▎   | 17/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=67.70, train_loss_epoch=67.70]
Epoch 46:  63%|██████▎   | 17/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  67%|██████▋   | 18/27 [00:01<00:00, 14.48it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  67%|██████▋   | 18/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.70]
Epoch 46:  70%|███████   | 19/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.70]
Epoch 46:  70%|███████   | 19/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  74%|███████▍  | 20/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  74%|███████▍  | 20/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  78%|███████▊  | 21/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  78%|███████▊  | 21/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.70]
Epoch 46:  81%|████████▏ | 22/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.70]
Epoch 46:  81%|████████▏ | 22/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.70]
Epoch 46:  85%|████████▌ | 23/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.70]
Epoch 46:  85%|████████▌ | 23/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  89%|████████▉ | 24/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.70]
Epoch 46:  89%|████████▉ | 24/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  93%|█████████▎| 25/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.70]
Epoch 46:  93%|█████████▎| 25/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.70]
Epoch 46:  96%|█████████▋| 26/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.70]
Epoch 46:  96%|█████████▋| 26/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.70]
Epoch 46: 100%|██████████| 27/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.70]
Epoch 46: 100%|██████████| 27/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.70]
Epoch 46: 100%|██████████| 27/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 46:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]         
Epoch 47:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 47:   4%|▎         | 1/27 [00:00<00:09,  2.73it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 47:   4%|▎         | 1/27 [00:00<00:09,  2.72it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.40]
Epoch 47:   7%|▋         | 2/27 [00:00<00:05,  4.69it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.40]
Epoch 47:   7%|▋         | 2/27 [00:00<00:05,  4.68it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 47:  11%|█         | 3/27 [00:00<00:03,  6.07it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 47:  11%|█         | 3/27 [00:00<00:03,  6.05it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47:  15%|█▍        | 4/27 [00:00<00:03,  7.30it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47:  15%|█▍        | 4/27 [00:00<00:03,  7.28it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.40]
Epoch 47:  19%|█▊        | 5/27 [00:00<00:02,  8.29it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.40]
Epoch 47:  19%|█▊        | 5/27 [00:00<00:02,  8.28it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 47:  22%|██▏       | 6/27 [00:00<00:02,  8.99it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 47:  22%|██▏       | 6/27 [00:00<00:02,  8.97it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.40]
Epoch 47:  26%|██▌       | 7/27 [00:00<00:02,  9.67it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.40]
Epoch 47:  26%|██▌       | 7/27 [00:00<00:02,  9.65it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.40]
Epoch 47:  30%|██▉       | 8/27 [00:00<00:01, 10.30it/s, v_num=0, train_loss_step=67.60, train_loss_epoch=67.40]
Epoch 47:  30%|██▉       | 8/27 [00:00<00:01, 10.29it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.40]
Epoch 47:  33%|███▎      | 9/27 [00:00<00:01, 10.75it/s, v_num=0, train_loss_step=67.40, train_loss_epoch=67.40]
Epoch 47:  33%|███▎      | 9/27 [00:00<00:01, 10.74it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.40]
Epoch 47:  37%|███▋      | 10/27 [00:00<00:01, 11.08it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.40]
Epoch 47:  37%|███▋      | 10/27 [00:00<00:01, 11.07it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  41%|████      | 11/27 [00:00<00:01, 11.43it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  41%|████      | 11/27 [00:00<00:01, 11.42it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.40]
Epoch 47:  44%|████▍     | 12/27 [00:01<00:01, 11.87it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.40]
Epoch 47:  44%|████▍     | 12/27 [00:01<00:01, 11.86it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 47:  48%|████▊     | 13/27 [00:01<00:01, 12.23it/s, v_num=0, train_loss_step=67.50, train_loss_epoch=67.40]
Epoch 47:  48%|████▊     | 13/27 [00:01<00:01, 12.22it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47:  52%|█████▏    | 14/27 [00:01<00:01, 12.60it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47:  52%|█████▏    | 14/27 [00:01<00:01, 12.59it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.40]
Epoch 47:  56%|█████▌    | 15/27 [00:01<00:00, 12.90it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.40]
Epoch 47:  56%|█████▌    | 15/27 [00:01<00:00, 12.88it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.40]
Epoch 47:  59%|█████▉    | 16/27 [00:01<00:00, 13.20it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.40]
Epoch 47:  59%|█████▉    | 16/27 [00:01<00:00, 13.19it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.40]
Epoch 47:  63%|██████▎   | 17/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.40]
Epoch 47:  63%|██████▎   | 17/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  67%|██████▋   | 18/27 [00:01<00:00, 13.68it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  67%|██████▋   | 18/27 [00:01<00:00, 13.67it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.40]
Epoch 47:  70%|███████   | 19/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.40]
Epoch 47:  70%|███████   | 19/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  74%|███████▍  | 20/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  74%|███████▍  | 20/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  78%|███████▊  | 21/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  78%|███████▊  | 21/27 [00:01<00:00, 14.02it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  81%|████████▏ | 22/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.40]
Epoch 47:  81%|████████▏ | 22/27 [00:01<00:00, 14.21it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.40]
Epoch 47:  85%|████████▌ | 23/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.40]
Epoch 47:  85%|████████▌ | 23/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.40]
Epoch 47:  89%|████████▉ | 24/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=67.30, train_loss_epoch=67.40]
Epoch 47:  89%|████████▉ | 24/27 [00:01<00:00, 14.57it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=67.40]
Epoch 47:  93%|█████████▎| 25/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=67.40]
Epoch 47:  93%|█████████▎| 25/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47:  96%|█████████▋| 26/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47:  96%|█████████▋| 26/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47: 100%|██████████| 27/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47: 100%|██████████| 27/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.40]
Epoch 47: 100%|██████████| 27/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 47:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]         
Epoch 48:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:   4%|▎         | 1/27 [00:00<00:09,  2.74it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:   4%|▎         | 1/27 [00:00<00:09,  2.73it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:   7%|▋         | 2/27 [00:00<00:05,  4.74it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:   7%|▋         | 2/27 [00:00<00:05,  4.72it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  11%|█         | 3/27 [00:00<00:03,  6.24it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  11%|█         | 3/27 [00:00<00:03,  6.23it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.10]
Epoch 48:  15%|█▍        | 4/27 [00:00<00:03,  7.48it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.10]
Epoch 48:  15%|█▍        | 4/27 [00:00<00:03,  7.47it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.10]
Epoch 48:  19%|█▊        | 5/27 [00:00<00:02,  8.46it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.10]
Epoch 48:  19%|█▊        | 5/27 [00:00<00:02,  8.45it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.10]
Epoch 48:  22%|██▏       | 6/27 [00:00<00:02,  9.25it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.10]
Epoch 48:  22%|██▏       | 6/27 [00:00<00:02,  9.24it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.10]
Epoch 48:  26%|██▌       | 7/27 [00:00<00:02,  9.71it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.10]
Epoch 48:  26%|██▌       | 7/27 [00:00<00:02,  9.68it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.10]
Epoch 48:  30%|██▉       | 8/27 [00:00<00:01, 10.32it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.10]
Epoch 48:  30%|██▉       | 8/27 [00:00<00:01, 10.31it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=67.10]
Epoch 48:  33%|███▎      | 9/27 [00:00<00:01, 10.89it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=67.10]
Epoch 48:  33%|███▎      | 9/27 [00:00<00:01, 10.88it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  37%|███▋      | 10/27 [00:00<00:01, 11.40it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  37%|███▋      | 10/27 [00:00<00:01, 11.39it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  41%|████      | 11/27 [00:00<00:01, 11.82it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  41%|████      | 11/27 [00:00<00:01, 11.80it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.10]
Epoch 48:  44%|████▍     | 12/27 [00:00<00:01, 12.29it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.10]
Epoch 48:  44%|████▍     | 12/27 [00:00<00:01, 12.26it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  48%|████▊     | 13/27 [00:01<00:01, 12.65it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  48%|████▊     | 13/27 [00:01<00:01, 12.64it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  52%|█████▏    | 14/27 [00:01<00:00, 13.01it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  52%|█████▏    | 14/27 [00:01<00:00, 13.00it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.10]
Epoch 48:  56%|█████▌    | 15/27 [00:01<00:00, 13.16it/s, v_num=0, train_loss_step=67.10, train_loss_epoch=67.10]
Epoch 48:  56%|█████▌    | 15/27 [00:01<00:00, 13.15it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  59%|█████▉    | 16/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  59%|█████▉    | 16/27 [00:01<00:00, 13.42it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  63%|██████▎   | 17/27 [00:01<00:00, 13.70it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  63%|██████▎   | 17/27 [00:01<00:00, 13.69it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  67%|██████▋   | 18/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=67.00, train_loss_epoch=67.10]
Epoch 48:  67%|██████▋   | 18/27 [00:01<00:00, 13.90it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=67.10]
Epoch 48:  70%|███████   | 19/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=67.10]
Epoch 48:  70%|███████   | 19/27 [00:01<00:00, 14.09it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=67.10]
Epoch 48:  74%|███████▍  | 20/27 [00:01<00:00, 14.31it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=67.10]
Epoch 48:  74%|███████▍  | 20/27 [00:01<00:00, 14.30it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.10]
Epoch 48:  78%|███████▊  | 21/27 [00:01<00:00, 14.48it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=67.10]
Epoch 48:  78%|███████▊  | 21/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  81%|████████▏ | 22/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  81%|████████▏ | 22/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  85%|████████▌ | 23/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  85%|████████▌ | 23/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  89%|████████▉ | 24/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48:  89%|████████▉ | 24/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.10]
Epoch 48:  93%|█████████▎| 25/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=67.20, train_loss_epoch=67.10]
Epoch 48:  93%|█████████▎| 25/27 [00:01<00:00, 14.95it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.10]
Epoch 48:  96%|█████████▋| 26/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=67.10]
Epoch 48:  96%|█████████▋| 26/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48: 100%|██████████| 27/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=67.10]
Epoch 48: 100%|██████████| 27/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=67.10]
Epoch 48: 100%|██████████| 27/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.80]
Epoch 48:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.80]         
Epoch 49:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.80]
Epoch 49:   4%|▎         | 1/27 [00:00<00:09,  2.68it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.80]
Epoch 49:   4%|▎         | 1/27 [00:00<00:09,  2.66it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=66.80]
Epoch 49:   7%|▋         | 2/27 [00:00<00:05,  4.55it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=66.80]
Epoch 49:   7%|▋         | 2/27 [00:00<00:05,  4.54it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=66.80]
Epoch 49:  11%|█         | 3/27 [00:00<00:03,  6.10it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=66.80]
Epoch 49:  11%|█         | 3/27 [00:00<00:03,  6.09it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  15%|█▍        | 4/27 [00:00<00:03,  7.29it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  15%|█▍        | 4/27 [00:00<00:03,  7.28it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.80]
Epoch 49:  19%|█▊        | 5/27 [00:00<00:02,  8.28it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.80]
Epoch 49:  19%|█▊        | 5/27 [00:00<00:02,  8.26it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=66.80]
Epoch 49:  22%|██▏       | 6/27 [00:00<00:02,  9.17it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=66.80]
Epoch 49:  22%|██▏       | 6/27 [00:00<00:02,  9.15it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  26%|██▌       | 7/27 [00:00<00:02,  9.88it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  26%|██▌       | 7/27 [00:00<00:02,  9.86it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  30%|██▉       | 8/27 [00:00<00:01, 10.42it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  30%|██▉       | 8/27 [00:00<00:01, 10.40it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.80]
Epoch 49:  33%|███▎      | 9/27 [00:00<00:01, 10.98it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.80]
Epoch 49:  33%|███▎      | 9/27 [00:00<00:01, 10.97it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  37%|███▋      | 10/27 [00:00<00:01, 11.46it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  37%|███▋      | 10/27 [00:00<00:01, 11.44it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=66.80]
Epoch 49:  41%|████      | 11/27 [00:00<00:01, 11.86it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=66.80]
Epoch 49:  41%|████      | 11/27 [00:00<00:01, 11.85it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.80]
Epoch 49:  44%|████▍     | 12/27 [00:00<00:01, 12.31it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.80]
Epoch 49:  44%|████▍     | 12/27 [00:00<00:01, 12.30it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=66.80]
Epoch 49:  48%|████▊     | 13/27 [00:01<00:01, 12.68it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=66.80]
Epoch 49:  48%|████▊     | 13/27 [00:01<00:01, 12.67it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=66.80]
Epoch 49:  52%|█████▏    | 14/27 [00:01<00:00, 13.02it/s, v_num=0, train_loss_step=66.90, train_loss_epoch=66.80]
Epoch 49:  52%|█████▏    | 14/27 [00:01<00:00, 13.01it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=66.80]
Epoch 49:  56%|█████▌    | 15/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=66.80]
Epoch 49:  56%|█████▌    | 15/27 [00:01<00:00, 13.35it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  59%|█████▉    | 16/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  59%|█████▉    | 16/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=66.80]
Epoch 49:  63%|██████▎   | 17/27 [00:01<00:00, 13.84it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=66.80]
Epoch 49:  63%|██████▎   | 17/27 [00:01<00:00, 13.83it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  67%|██████▋   | 18/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  67%|██████▋   | 18/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.80]
Epoch 49:  70%|███████   | 19/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.80]
Epoch 49:  70%|███████   | 19/27 [00:01<00:00, 14.24it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.80]
Epoch 49:  74%|███████▍  | 20/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.80]
Epoch 49:  74%|███████▍  | 20/27 [00:01<00:00, 14.37it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.80]
Epoch 49:  78%|███████▊  | 21/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.80]
Epoch 49:  78%|███████▊  | 21/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  81%|████████▏ | 22/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49:  81%|████████▏ | 22/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.80]
Epoch 49:  85%|████████▌ | 23/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.80]
Epoch 49:  85%|████████▌ | 23/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.80]
Epoch 49:  89%|████████▉ | 24/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.80]
Epoch 49:  89%|████████▉ | 24/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.80]
Epoch 49:  93%|█████████▎| 25/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.80]
Epoch 49:  93%|█████████▎| 25/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=66.80]
Epoch 49:  96%|█████████▋| 26/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=66.80]
Epoch 49:  96%|█████████▋| 26/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49: 100%|██████████| 27/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49: 100%|██████████| 27/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.80]
Epoch 49: 100%|██████████| 27/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.60]
Epoch 49:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.60]         
Epoch 50:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.60]
Epoch 50:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.60]
Epoch 50:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.60]
Epoch 50:   7%|▋         | 2/27 [00:00<00:05,  4.85it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.60]
Epoch 50:   7%|▋         | 2/27 [00:00<00:05,  4.84it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.60]
Epoch 50:  11%|█         | 3/27 [00:00<00:03,  6.17it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.60]
Epoch 50:  11%|█         | 3/27 [00:00<00:03,  6.16it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.60]
Epoch 50:  15%|█▍        | 4/27 [00:00<00:03,  7.42it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.60]
Epoch 50:  15%|█▍        | 4/27 [00:00<00:03,  7.41it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.60]
Epoch 50:  19%|█▊        | 5/27 [00:00<00:02,  8.46it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.60]
Epoch 50:  19%|█▊        | 5/27 [00:00<00:02,  8.44it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.60]
Epoch 50:  22%|██▏       | 6/27 [00:00<00:02,  9.28it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.60]
Epoch 50:  22%|██▏       | 6/27 [00:00<00:02,  9.26it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.60]
Epoch 50:  26%|██▌       | 7/27 [00:00<00:02,  9.78it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.60]
Epoch 50:  26%|██▌       | 7/27 [00:00<00:02,  9.77it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.60]
Epoch 50:  30%|██▉       | 8/27 [00:00<00:01, 10.39it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.60]
Epoch 50:  30%|██▉       | 8/27 [00:00<00:01, 10.38it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50:  33%|███▎      | 9/27 [00:00<00:01, 10.92it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50:  33%|███▎      | 9/27 [00:00<00:01, 10.91it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.60]
Epoch 50:  37%|███▋      | 10/27 [00:00<00:01, 11.39it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.60]
Epoch 50:  37%|███▋      | 10/27 [00:00<00:01, 11.38it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.60]
Epoch 50:  41%|████      | 11/27 [00:00<00:01, 11.81it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.60]
Epoch 50:  41%|████      | 11/27 [00:00<00:01, 11.80it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50:  44%|████▍     | 12/27 [00:00<00:01, 12.26it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50:  44%|████▍     | 12/27 [00:00<00:01, 12.24it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50:  48%|████▊     | 13/27 [00:01<00:01, 12.65it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50:  48%|████▊     | 13/27 [00:01<00:01, 12.64it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.60]
Epoch 50:  52%|█████▏    | 14/27 [00:01<00:01, 12.97it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.60]
Epoch 50:  52%|█████▏    | 14/27 [00:01<00:01, 12.95it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.60]
Epoch 50:  56%|█████▌    | 15/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.60]
Epoch 50:  56%|█████▌    | 15/27 [00:01<00:00, 13.27it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.60]
Epoch 50:  59%|█████▉    | 16/27 [00:01<00:00, 13.55it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.60]
Epoch 50:  59%|█████▉    | 16/27 [00:01<00:00, 13.53it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=66.60]
Epoch 50:  63%|██████▎   | 17/27 [00:01<00:00, 13.77it/s, v_num=0, train_loss_step=66.70, train_loss_epoch=66.60]
Epoch 50:  63%|██████▎   | 17/27 [00:01<00:00, 13.75it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50:  67%|██████▋   | 18/27 [00:01<00:00, 14.01it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50:  67%|██████▋   | 18/27 [00:01<00:00, 14.00it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.60]
Epoch 50:  70%|███████   | 19/27 [00:01<00:00, 14.20it/s, v_num=0, train_loss_step=66.50, train_loss_epoch=66.60]
Epoch 50:  70%|███████   | 19/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=66.60]
Epoch 50:  74%|███████▍  | 20/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=66.80, train_loss_epoch=66.60]
Epoch 50:  74%|███████▍  | 20/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.60]
Epoch 50:  78%|███████▊  | 21/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.60]
Epoch 50:  78%|███████▊  | 21/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.60]
Epoch 50:  81%|████████▏ | 22/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.60]
Epoch 50:  81%|████████▏ | 22/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.60]
Epoch 50:  85%|████████▌ | 23/27 [00:01<00:00, 14.95it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.60]
Epoch 50:  85%|████████▌ | 23/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.60]
Epoch 50:  89%|████████▉ | 24/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.60]
Epoch 50:  89%|████████▉ | 24/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.60]
Epoch 50:  93%|█████████▎| 25/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.60]
Epoch 50:  93%|█████████▎| 25/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.60]
Epoch 50:  96%|█████████▋| 26/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.60]
Epoch 50:  96%|█████████▋| 26/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.60]
Epoch 50: 100%|██████████| 27/27 [00:01<00:00, 15.45it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.60]
Epoch 50: 100%|██████████| 27/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.60]
Epoch 50: 100%|██████████| 27/27 [00:01<00:00, 15.43it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 50:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]         
Epoch 51:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 51:   4%|▎         | 1/27 [00:00<00:09,  2.82it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 51:   4%|▎         | 1/27 [00:00<00:09,  2.80it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:   7%|▋         | 2/27 [00:00<00:05,  4.86it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:   7%|▋         | 2/27 [00:00<00:05,  4.85it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.30]
Epoch 51:  11%|█         | 3/27 [00:00<00:03,  6.46it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.30]
Epoch 51:  11%|█         | 3/27 [00:00<00:03,  6.45it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  15%|█▍        | 4/27 [00:00<00:03,  7.37it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  15%|█▍        | 4/27 [00:00<00:03,  7.36it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.30]
Epoch 51:  19%|█▊        | 5/27 [00:00<00:02,  8.40it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.30]
Epoch 51:  19%|█▊        | 5/27 [00:00<00:02,  8.39it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.30]
Epoch 51:  22%|██▏       | 6/27 [00:00<00:02,  8.98it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.30]
Epoch 51:  22%|██▏       | 6/27 [00:00<00:02,  8.97it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.30]
Epoch 51:  26%|██▌       | 7/27 [00:00<00:02,  9.69it/s, v_num=0, train_loss_step=66.60, train_loss_epoch=66.30]
Epoch 51:  26%|██▌       | 7/27 [00:00<00:02,  9.68it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  30%|██▉       | 8/27 [00:00<00:01, 10.15it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  30%|██▉       | 8/27 [00:00<00:01, 10.14it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.30]
Epoch 51:  33%|███▎      | 9/27 [00:00<00:01, 10.74it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.30]
Epoch 51:  33%|███▎      | 9/27 [00:00<00:01, 10.73it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.30]
Epoch 51:  37%|███▋      | 10/27 [00:00<00:01, 11.18it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.30]
Epoch 51:  37%|███▋      | 10/27 [00:00<00:01, 11.17it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 51:  41%|████      | 11/27 [00:00<00:01, 11.52it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 51:  41%|████      | 11/27 [00:00<00:01, 11.51it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.30]
Epoch 51:  44%|████▍     | 12/27 [00:01<00:01, 11.84it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.30]
Epoch 51:  44%|████▍     | 12/27 [00:01<00:01, 11.83it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.30]
Epoch 51:  48%|████▊     | 13/27 [00:01<00:01, 12.20it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.30]
Epoch 51:  48%|████▊     | 13/27 [00:01<00:01, 12.19it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.30]
Epoch 51:  52%|█████▏    | 14/27 [00:01<00:01, 12.53it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.30]
Epoch 51:  52%|█████▏    | 14/27 [00:01<00:01, 12.52it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 51:  56%|█████▌    | 15/27 [00:01<00:00, 12.86it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 51:  56%|█████▌    | 15/27 [00:01<00:00, 12.85it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.30]
Epoch 51:  59%|█████▉    | 16/27 [00:01<00:00, 13.13it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.30]
Epoch 51:  59%|█████▉    | 16/27 [00:01<00:00, 13.11it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  63%|██████▎   | 17/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  63%|██████▎   | 17/27 [00:01<00:00, 13.42it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.30]
Epoch 51:  67%|██████▋   | 18/27 [00:01<00:00, 13.64it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.30]
Epoch 51:  67%|██████▋   | 18/27 [00:01<00:00, 13.62it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 51:  70%|███████   | 19/27 [00:01<00:00, 13.87it/s, v_num=0, train_loss_step=66.10, train_loss_epoch=66.30]
Epoch 51:  70%|███████   | 19/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=66.30]
Epoch 51:  74%|███████▍  | 20/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=66.30]
Epoch 51:  74%|███████▍  | 20/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51:  78%|███████▊  | 21/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51:  78%|███████▊  | 21/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51:  81%|████████▏ | 22/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51:  81%|████████▏ | 22/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  85%|████████▌ | 23/27 [00:01<00:00, 14.57it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  85%|████████▌ | 23/27 [00:01<00:00, 14.57it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.30]
Epoch 51:  89%|████████▉ | 24/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.30]
Epoch 51:  89%|████████▉ | 24/27 [00:01<00:00, 14.70it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51:  93%|█████████▎| 25/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51:  93%|█████████▎| 25/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  96%|█████████▋| 26/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.30]
Epoch 51:  96%|█████████▋| 26/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51: 100%|██████████| 27/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51: 100%|██████████| 27/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.30]
Epoch 51: 100%|██████████| 27/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 51:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]         
Epoch 52:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52:   4%|▎         | 1/27 [00:00<00:09,  2.88it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=66.00]
Epoch 52:   7%|▋         | 2/27 [00:00<00:05,  4.86it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=66.00]
Epoch 52:   7%|▋         | 2/27 [00:00<00:05,  4.85it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.00]
Epoch 52:  11%|█         | 3/27 [00:00<00:03,  6.38it/s, v_num=0, train_loss_step=66.40, train_loss_epoch=66.00]
Epoch 52:  11%|█         | 3/27 [00:00<00:03,  6.37it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.00]
Epoch 52:  15%|█▍        | 4/27 [00:00<00:02,  7.71it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.00]
Epoch 52:  15%|█▍        | 4/27 [00:00<00:02,  7.70it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.00]
Epoch 52:  19%|█▊        | 5/27 [00:00<00:02,  8.71it/s, v_num=0, train_loss_step=66.00, train_loss_epoch=66.00]
Epoch 52:  19%|█▊        | 5/27 [00:00<00:02,  8.68it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52:  22%|██▏       | 6/27 [00:00<00:02,  9.48it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52:  22%|██▏       | 6/27 [00:00<00:02,  9.47it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.00]
Epoch 52:  26%|██▌       | 7/27 [00:00<00:01, 10.23it/s, v_num=0, train_loss_step=66.20, train_loss_epoch=66.00]
Epoch 52:  26%|██▌       | 7/27 [00:00<00:01, 10.22it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52:  30%|██▉       | 8/27 [00:00<00:01, 10.90it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52:  30%|██▉       | 8/27 [00:00<00:01, 10.88it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.00]
Epoch 52:  33%|███▎      | 9/27 [00:00<00:01, 11.46it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=66.00]
Epoch 52:  33%|███▎      | 9/27 [00:00<00:01, 11.45it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=66.00]
Epoch 52:  37%|███▋      | 10/27 [00:00<00:01, 11.94it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=66.00]
Epoch 52:  37%|███▋      | 10/27 [00:00<00:01, 11.93it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=66.00]
Epoch 52:  41%|████      | 11/27 [00:00<00:01, 12.33it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=66.00]
Epoch 52:  41%|████      | 11/27 [00:00<00:01, 12.32it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=66.00]
Epoch 52:  44%|████▍     | 12/27 [00:00<00:01, 12.77it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=66.00]
Epoch 52:  44%|████▍     | 12/27 [00:00<00:01, 12.76it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  48%|████▊     | 13/27 [00:00<00:01, 13.12it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  48%|████▊     | 13/27 [00:00<00:01, 13.11it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=66.00]
Epoch 52:  52%|█████▏    | 14/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=66.00]
Epoch 52:  52%|█████▏    | 14/27 [00:01<00:00, 13.45it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52:  56%|█████▌    | 15/27 [00:01<00:00, 13.72it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52:  56%|█████▌    | 15/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=66.00]
Epoch 52:  59%|█████▉    | 16/27 [00:01<00:00, 13.97it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=66.00]
Epoch 52:  59%|█████▉    | 16/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  63%|██████▎   | 17/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  63%|██████▎   | 17/27 [00:01<00:00, 14.21it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  67%|██████▋   | 18/27 [00:01<00:00, 14.34it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  67%|██████▋   | 18/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  70%|███████   | 19/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  70%|███████   | 19/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=66.00]
Epoch 52:  74%|███████▍  | 20/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=66.00]
Epoch 52:  74%|███████▍  | 20/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  78%|███████▊  | 21/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  78%|███████▊  | 21/27 [00:01<00:00, 14.57it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=66.00]
Epoch 52:  81%|████████▏ | 22/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=66.00]
Epoch 52:  81%|████████▏ | 22/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=66.00]
Epoch 52:  85%|████████▌ | 23/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=66.00]
Epoch 52:  85%|████████▌ | 23/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=66.00]
Epoch 52:  89%|████████▉ | 24/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=66.00]
Epoch 52:  89%|████████▉ | 24/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  93%|█████████▎| 25/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=66.00]
Epoch 52:  93%|█████████▎| 25/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=66.00]
Epoch 52:  96%|█████████▋| 26/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=66.00]
Epoch 52:  96%|█████████▋| 26/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=66.00]
Epoch 52: 100%|██████████| 27/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=66.00]
Epoch 52: 100%|██████████| 27/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=66.00]
Epoch 52: 100%|██████████| 27/27 [00:01<00:00, 15.45it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=65.80]
Epoch 52:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=65.80]         
Epoch 53:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=65.80]
Epoch 53:   4%|▎         | 1/27 [00:00<00:08,  3.05it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=65.80]
Epoch 53:   4%|▎         | 1/27 [00:00<00:08,  3.02it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=65.80]
Epoch 53:   7%|▋         | 2/27 [00:00<00:05,  4.98it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=65.80]
Epoch 53:   7%|▋         | 2/27 [00:00<00:05,  4.97it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.80]
Epoch 53:  11%|█         | 3/27 [00:00<00:03,  6.48it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.80]
Epoch 53:  11%|█         | 3/27 [00:00<00:03,  6.47it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=65.80]
Epoch 53:  15%|█▍        | 4/27 [00:00<00:02,  7.71it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=65.80]
Epoch 53:  15%|█▍        | 4/27 [00:00<00:02,  7.69it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  19%|█▊        | 5/27 [00:00<00:02,  8.64it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  19%|█▊        | 5/27 [00:00<00:02,  8.63it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=65.80]
Epoch 53:  22%|██▏       | 6/27 [00:00<00:02,  9.50it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=65.80]
Epoch 53:  22%|██▏       | 6/27 [00:00<00:02,  9.49it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  26%|██▌       | 7/27 [00:00<00:01, 10.19it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  26%|██▌       | 7/27 [00:00<00:01, 10.17it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=65.80]
Epoch 53:  30%|██▉       | 8/27 [00:00<00:01, 10.71it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=65.80]
Epoch 53:  30%|██▉       | 8/27 [00:00<00:01, 10.70it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  33%|███▎      | 9/27 [00:00<00:01, 11.19it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  33%|███▎      | 9/27 [00:00<00:01, 11.17it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.80]
Epoch 53:  37%|███▋      | 10/27 [00:00<00:01, 11.55it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.80]
Epoch 53:  37%|███▋      | 10/27 [00:00<00:01, 11.54it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.80]
Epoch 53:  41%|████      | 11/27 [00:00<00:01, 12.03it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.80]
Epoch 53:  41%|████      | 11/27 [00:00<00:01, 12.02it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=65.80]
Epoch 53:  44%|████▍     | 12/27 [00:00<00:01, 12.45it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=65.80]
Epoch 53:  44%|████▍     | 12/27 [00:00<00:01, 12.43it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  48%|████▊     | 13/27 [00:01<00:01, 12.88it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  48%|████▊     | 13/27 [00:01<00:01, 12.86it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  52%|█████▏    | 14/27 [00:01<00:00, 13.25it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  52%|█████▏    | 14/27 [00:01<00:00, 13.24it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.80]
Epoch 53:  56%|█████▌    | 15/27 [00:01<00:00, 13.60it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.80]
Epoch 53:  56%|█████▌    | 15/27 [00:01<00:00, 13.59it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  59%|█████▉    | 16/27 [00:01<00:00, 13.82it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  59%|█████▉    | 16/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=65.80]
Epoch 53:  63%|██████▎   | 17/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=65.90, train_loss_epoch=65.80]
Epoch 53:  63%|██████▎   | 17/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  67%|██████▋   | 18/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  67%|██████▋   | 18/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  70%|███████   | 19/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  70%|███████   | 19/27 [00:01<00:00, 14.49it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  74%|███████▍  | 20/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.80]
Epoch 53:  74%|███████▍  | 20/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  78%|███████▊  | 21/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  78%|███████▊  | 21/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  81%|████████▏ | 22/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.80]
Epoch 53:  81%|████████▏ | 22/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.80]
Epoch 53:  85%|████████▌ | 23/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.80]
Epoch 53:  85%|████████▌ | 23/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.80]
Epoch 53:  89%|████████▉ | 24/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.80]
Epoch 53:  89%|████████▉ | 24/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.80]
Epoch 53:  93%|█████████▎| 25/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.80]
Epoch 53:  93%|█████████▎| 25/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.80]
Epoch 53:  96%|█████████▋| 26/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.80]
Epoch 53:  96%|█████████▋| 26/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=65.80]
Epoch 53: 100%|██████████| 27/27 [00:01<00:00, 15.48it/s, v_num=0, train_loss_step=66.30, train_loss_epoch=65.80]
Epoch 53: 100%|██████████| 27/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.80]
Epoch 53: 100%|██████████| 27/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 53:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]         
Epoch 54:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 54:   4%|▎         | 1/27 [00:00<00:08,  3.06it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 54:   4%|▎         | 1/27 [00:00<00:08,  3.04it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:   7%|▋         | 2/27 [00:00<00:04,  5.15it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:   7%|▋         | 2/27 [00:00<00:04,  5.14it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=65.50]
Epoch 54:  11%|█         | 3/27 [00:00<00:03,  6.69it/s, v_num=0, train_loss_step=65.80, train_loss_epoch=65.50]
Epoch 54:  11%|█         | 3/27 [00:00<00:03,  6.68it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.50]
Epoch 54:  15%|█▍        | 4/27 [00:00<00:02,  7.88it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.50]
Epoch 54:  15%|█▍        | 4/27 [00:00<00:02,  7.87it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=65.50]
Epoch 54:  19%|█▊        | 5/27 [00:00<00:02,  8.86it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=65.50]
Epoch 54:  19%|█▊        | 5/27 [00:00<00:02,  8.85it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.50]
Epoch 54:  22%|██▏       | 6/27 [00:00<00:02,  9.51it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.50]
Epoch 54:  22%|██▏       | 6/27 [00:00<00:02,  9.50it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 54:  26%|██▌       | 7/27 [00:00<00:01, 10.22it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 54:  26%|██▌       | 7/27 [00:00<00:01, 10.20it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 54:  30%|██▉       | 8/27 [00:00<00:01, 10.75it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 54:  30%|██▉       | 8/27 [00:00<00:01, 10.73it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  33%|███▎      | 9/27 [00:00<00:01, 11.29it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  33%|███▎      | 9/27 [00:00<00:01, 11.28it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.50]
Epoch 54:  37%|███▋      | 10/27 [00:00<00:01, 11.66it/s, v_num=0, train_loss_step=65.70, train_loss_epoch=65.50]
Epoch 54:  37%|███▋      | 10/27 [00:00<00:01, 11.65it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.50]
Epoch 54:  41%|████      | 11/27 [00:00<00:01, 12.09it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.50]
Epoch 54:  41%|████      | 11/27 [00:00<00:01, 12.08it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  44%|████▍     | 12/27 [00:00<00:01, 12.54it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  44%|████▍     | 12/27 [00:00<00:01, 12.53it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  48%|████▊     | 13/27 [00:01<00:01, 12.89it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  48%|████▊     | 13/27 [00:01<00:01, 12.88it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.50]
Epoch 54:  52%|█████▏    | 14/27 [00:01<00:00, 13.24it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.50]
Epoch 54:  52%|█████▏    | 14/27 [00:01<00:00, 13.23it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  56%|█████▌    | 15/27 [00:01<00:00, 13.53it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  56%|█████▌    | 15/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  59%|█████▉    | 16/27 [00:01<00:00, 13.82it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  59%|█████▉    | 16/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  63%|██████▎   | 17/27 [00:01<00:00, 14.08it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  63%|██████▎   | 17/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.50]
Epoch 54:  67%|██████▋   | 18/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.50]
Epoch 54:  67%|██████▋   | 18/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  70%|███████   | 19/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  70%|███████   | 19/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  74%|███████▍  | 20/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  74%|███████▍  | 20/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=65.50]
Epoch 54:  78%|███████▊  | 21/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=65.60, train_loss_epoch=65.50]
Epoch 54:  78%|███████▊  | 21/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  81%|████████▏ | 22/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.50]
Epoch 54:  81%|████████▏ | 22/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.50]
Epoch 54:  85%|████████▌ | 23/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.50]
Epoch 54:  85%|████████▌ | 23/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  89%|████████▉ | 24/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.50]
Epoch 54:  89%|████████▉ | 24/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.50]
Epoch 54:  93%|█████████▎| 25/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.50]
Epoch 54:  93%|█████████▎| 25/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 54:  96%|█████████▋| 26/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=65.50, train_loss_epoch=65.50]
Epoch 54:  96%|█████████▋| 26/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.50]
Epoch 54: 100%|██████████| 27/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.50]
Epoch 54: 100%|██████████| 27/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.50]
Epoch 54: 100%|██████████| 27/27 [00:01<00:00, 15.62it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.30]
Epoch 54:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.30]         
Epoch 55:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.30]
Epoch 55:   4%|▎         | 1/27 [00:00<00:08,  3.06it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.30]
Epoch 55:   4%|▎         | 1/27 [00:00<00:08,  3.04it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:   7%|▋         | 2/27 [00:00<00:04,  5.13it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:   7%|▋         | 2/27 [00:00<00:04,  5.11it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.30]
Epoch 55:  11%|█         | 3/27 [00:00<00:03,  6.76it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.30]
Epoch 55:  11%|█         | 3/27 [00:00<00:03,  6.74it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  15%|█▍        | 4/27 [00:00<00:02,  7.95it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  15%|█▍        | 4/27 [00:00<00:02,  7.94it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  19%|█▊        | 5/27 [00:00<00:02,  8.89it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  19%|█▊        | 5/27 [00:00<00:02,  8.88it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  22%|██▏       | 6/27 [00:00<00:02,  9.66it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  22%|██▏       | 6/27 [00:00<00:02,  9.65it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  26%|██▌       | 7/27 [00:00<00:01, 10.39it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  26%|██▌       | 7/27 [00:00<00:01, 10.38it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.30]
Epoch 55:  30%|██▉       | 8/27 [00:00<00:01, 10.97it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.30]
Epoch 55:  30%|██▉       | 8/27 [00:00<00:01, 10.95it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  33%|███▎      | 9/27 [00:00<00:01, 11.49it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  33%|███▎      | 9/27 [00:00<00:01, 11.48it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.30]
Epoch 55:  37%|███▋      | 10/27 [00:00<00:01, 11.97it/s, v_num=0, train_loss_step=65.40, train_loss_epoch=65.30]
Epoch 55:  37%|███▋      | 10/27 [00:00<00:01, 11.96it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  41%|████      | 11/27 [00:00<00:01, 12.40it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  41%|████      | 11/27 [00:00<00:01, 12.39it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  44%|████▍     | 12/27 [00:00<00:01, 12.80it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  44%|████▍     | 12/27 [00:00<00:01, 12.78it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  48%|████▊     | 13/27 [00:00<00:01, 13.16it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  48%|████▊     | 13/27 [00:00<00:01, 13.15it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.30]
Epoch 55:  52%|█████▏    | 14/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.30]
Epoch 55:  52%|█████▏    | 14/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  56%|█████▌    | 15/27 [00:01<00:00, 13.83it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.30]
Epoch 55:  56%|█████▌    | 15/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=65.30]
Epoch 55:  59%|█████▉    | 16/27 [00:01<00:00, 14.10it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=65.30]
Epoch 55:  59%|█████▉    | 16/27 [00:01<00:00, 14.09it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.30]
Epoch 55:  63%|██████▎   | 17/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.30]
Epoch 55:  63%|██████▎   | 17/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.30]
Epoch 55:  67%|██████▋   | 18/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.30]
Epoch 55:  67%|██████▋   | 18/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  70%|███████   | 19/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  70%|███████   | 19/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  74%|███████▍  | 20/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  74%|███████▍  | 20/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  78%|███████▊  | 21/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  78%|███████▊  | 21/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.30]
Epoch 55:  81%|████████▏ | 22/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.30]
Epoch 55:  81%|████████▏ | 22/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.30]
Epoch 55:  85%|████████▌ | 23/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.30]
Epoch 55:  85%|████████▌ | 23/27 [00:01<00:00, 15.08it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  89%|████████▉ | 24/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  89%|████████▉ | 24/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=65.30]
Epoch 55:  93%|█████████▎| 25/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=65.30]
Epoch 55:  93%|█████████▎| 25/27 [00:01<00:00, 15.34it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  96%|█████████▋| 26/27 [00:01<00:00, 15.45it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.30]
Epoch 55:  96%|█████████▋| 26/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.30]
Epoch 55: 100%|██████████| 27/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.30]
Epoch 55: 100%|██████████| 27/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.30]
Epoch 55: 100%|██████████| 27/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.10]
Epoch 55:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.10]         
Epoch 56:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.10]
Epoch 56:   4%|▎         | 1/27 [00:00<00:08,  2.93it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.10]
Epoch 56:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:   7%|▋         | 2/27 [00:00<00:04,  5.03it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:   7%|▋         | 2/27 [00:00<00:04,  5.02it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  11%|█         | 3/27 [00:00<00:03,  6.60it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  11%|█         | 3/27 [00:00<00:03,  6.57it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.10]
Epoch 56:  15%|█▍        | 4/27 [00:00<00:03,  7.62it/s, v_num=0, train_loss_step=65.20, train_loss_epoch=65.10]
Epoch 56:  15%|█▍        | 4/27 [00:00<00:03,  7.61it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  19%|█▊        | 5/27 [00:00<00:02,  8.58it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  19%|█▊        | 5/27 [00:00<00:02,  8.56it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.10]
Epoch 56:  22%|██▏       | 6/27 [00:00<00:02,  9.40it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.10]
Epoch 56:  22%|██▏       | 6/27 [00:00<00:02,  9.39it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.10]
Epoch 56:  26%|██▌       | 7/27 [00:00<00:01, 10.04it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.10]
Epoch 56:  26%|██▌       | 7/27 [00:00<00:01, 10.03it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.10]
Epoch 56:  30%|██▉       | 8/27 [00:00<00:01, 10.64it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.10]
Epoch 56:  30%|██▉       | 8/27 [00:00<00:01, 10.63it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.10]
Epoch 56:  33%|███▎      | 9/27 [00:00<00:01, 11.22it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.10]
Epoch 56:  33%|███▎      | 9/27 [00:00<00:01, 11.21it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.10]
Epoch 56:  37%|███▋      | 10/27 [00:00<00:01, 11.75it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=65.10]
Epoch 56:  37%|███▋      | 10/27 [00:00<00:01, 11.73it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.10]
Epoch 56:  41%|████      | 11/27 [00:00<00:01, 12.18it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.10]
Epoch 56:  41%|████      | 11/27 [00:00<00:01, 12.17it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.10]
Epoch 56:  44%|████▍     | 12/27 [00:00<00:01, 12.63it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.10]
Epoch 56:  44%|████▍     | 12/27 [00:00<00:01, 12.62it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  48%|████▊     | 13/27 [00:00<00:01, 13.02it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  48%|████▊     | 13/27 [00:00<00:01, 13.01it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=65.10]
Epoch 56:  52%|█████▏    | 14/27 [00:01<00:00, 13.34it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=65.10]
Epoch 56:  52%|█████▏    | 14/27 [00:01<00:00, 13.33it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.10]
Epoch 56:  56%|█████▌    | 15/27 [00:01<00:00, 13.68it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.10]
Epoch 56:  56%|█████▌    | 15/27 [00:01<00:00, 13.67it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.10]
Epoch 56:  59%|█████▉    | 16/27 [00:01<00:00, 13.82it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=65.10]
Epoch 56:  59%|█████▉    | 16/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  63%|██████▎   | 17/27 [00:01<00:00, 14.12it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  63%|██████▎   | 17/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.10]
Epoch 56:  67%|██████▋   | 18/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.10]
Epoch 56:  67%|██████▋   | 18/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.10]
Epoch 56:  70%|███████   | 19/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=65.10]
Epoch 56:  70%|███████   | 19/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=65.10]
Epoch 56:  74%|███████▍  | 20/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=65.10]
Epoch 56:  74%|███████▍  | 20/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.10]
Epoch 56:  78%|███████▊  | 21/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.10]
Epoch 56:  78%|███████▊  | 21/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=65.10]
Epoch 56:  81%|████████▏ | 22/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=65.10]
Epoch 56:  81%|████████▏ | 22/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=65.10]
Epoch 56:  85%|████████▌ | 23/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=65.10]
Epoch 56:  85%|████████▌ | 23/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.10]
Epoch 56:  89%|████████▉ | 24/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=65.10]
Epoch 56:  89%|████████▉ | 24/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=65.10]
Epoch 56:  93%|█████████▎| 25/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=65.10]
Epoch 56:  93%|█████████▎| 25/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  96%|█████████▋| 26/27 [00:01<00:00, 15.52it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56:  96%|█████████▋| 26/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56: 100%|██████████| 27/27 [00:01<00:00, 15.74it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=65.10]
Epoch 56: 100%|██████████| 27/27 [00:01<00:00, 15.74it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=65.10]
Epoch 56: 100%|██████████| 27/27 [00:01<00:00, 15.72it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 56:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]         
Epoch 57:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 57:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 57:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 57:   7%|▋         | 2/27 [00:00<00:04,  5.03it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 57:   7%|▋         | 2/27 [00:00<00:04,  5.02it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  11%|█         | 3/27 [00:00<00:03,  6.48it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  11%|█         | 3/27 [00:00<00:03,  6.47it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=64.90]
Epoch 57:  15%|█▍        | 4/27 [00:00<00:03,  7.64it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=64.90]
Epoch 57:  15%|█▍        | 4/27 [00:00<00:03,  7.63it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=64.90]
Epoch 57:  19%|█▊        | 5/27 [00:00<00:02,  8.53it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=64.90]
Epoch 57:  19%|█▊        | 5/27 [00:00<00:02,  8.51it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.90]
Epoch 57:  22%|██▏       | 6/27 [00:00<00:02,  9.31it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.90]
Epoch 57:  22%|██▏       | 6/27 [00:00<00:02,  9.30it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.90]
Epoch 57:  26%|██▌       | 7/27 [00:00<00:02,  9.92it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.90]
Epoch 57:  26%|██▌       | 7/27 [00:00<00:02,  9.91it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.90]
Epoch 57:  30%|██▉       | 8/27 [00:00<00:01, 10.40it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.90]
Epoch 57:  30%|██▉       | 8/27 [00:00<00:01, 10.39it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=64.90]
Epoch 57:  33%|███▎      | 9/27 [00:00<00:01, 10.79it/s, v_num=0, train_loss_step=64.90, train_loss_epoch=64.90]
Epoch 57:  33%|███▎      | 9/27 [00:00<00:01, 10.78it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  37%|███▋      | 10/27 [00:00<00:01, 11.28it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  37%|███▋      | 10/27 [00:00<00:01, 11.26it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.90]
Epoch 57:  41%|████      | 11/27 [00:00<00:01, 11.61it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.90]
Epoch 57:  41%|████      | 11/27 [00:00<00:01, 11.59it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.90]
Epoch 57:  44%|████▍     | 12/27 [00:01<00:01, 11.99it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.90]
Epoch 57:  44%|████▍     | 12/27 [00:01<00:01, 11.98it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  48%|████▊     | 13/27 [00:01<00:01, 12.37it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  48%|████▊     | 13/27 [00:01<00:01, 12.36it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  52%|█████▏    | 14/27 [00:01<00:01, 12.76it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  52%|█████▏    | 14/27 [00:01<00:01, 12.75it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=64.90]
Epoch 57:  56%|█████▌    | 15/27 [00:01<00:00, 13.17it/s, v_num=0, train_loss_step=65.10, train_loss_epoch=64.90]
Epoch 57:  56%|█████▌    | 15/27 [00:01<00:00, 13.16it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  59%|█████▉    | 16/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  59%|█████▉    | 16/27 [00:01<00:00, 13.45it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=64.90]
Epoch 57:  63%|██████▎   | 17/27 [00:01<00:00, 13.72it/s, v_num=0, train_loss_step=65.30, train_loss_epoch=64.90]
Epoch 57:  63%|██████▎   | 17/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.90]
Epoch 57:  67%|██████▋   | 18/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.90]
Epoch 57:  67%|██████▋   | 18/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 57:  70%|███████   | 19/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 57:  70%|███████   | 19/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.90]
Epoch 57:  74%|███████▍  | 20/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.90]
Epoch 57:  74%|███████▍  | 20/27 [00:01<00:00, 14.34it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  78%|███████▊  | 21/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  78%|███████▊  | 21/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  81%|████████▏ | 22/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  81%|████████▏ | 22/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 57:  85%|████████▌ | 23/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.90]
Epoch 57:  85%|████████▌ | 23/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  89%|████████▉ | 24/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  89%|████████▉ | 24/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  93%|█████████▎| 25/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.90]
Epoch 57:  93%|█████████▎| 25/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  96%|█████████▋| 26/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.90]
Epoch 57:  96%|█████████▋| 26/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.90]
Epoch 57: 100%|██████████| 27/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.90]
Epoch 57: 100%|██████████| 27/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.90]
Epoch 57: 100%|██████████| 27/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 57:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]         
Epoch 58:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 58:   4%|▎         | 1/27 [00:00<00:08,  2.99it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 58:   4%|▎         | 1/27 [00:00<00:08,  2.96it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58:   7%|▋         | 2/27 [00:00<00:04,  5.07it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58:   7%|▋         | 2/27 [00:00<00:04,  5.06it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=64.70]
Epoch 58:  11%|█         | 3/27 [00:00<00:03,  6.57it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=64.70]
Epoch 58:  11%|█         | 3/27 [00:00<00:03,  6.56it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=64.70]
Epoch 58:  15%|█▍        | 4/27 [00:00<00:02,  7.84it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=64.70]
Epoch 58:  15%|█▍        | 4/27 [00:00<00:02,  7.83it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.70]
Epoch 58:  19%|█▊        | 5/27 [00:00<00:02,  8.83it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.70]
Epoch 58:  19%|█▊        | 5/27 [00:00<00:02,  8.82it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  22%|██▏       | 6/27 [00:00<00:02,  9.56it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  22%|██▏       | 6/27 [00:00<00:02,  9.55it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 58:  26%|██▌       | 7/27 [00:00<00:01, 10.33it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 58:  26%|██▌       | 7/27 [00:00<00:01, 10.31it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.70]
Epoch 58:  30%|██▉       | 8/27 [00:00<00:01, 10.98it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.70]
Epoch 58:  30%|██▉       | 8/27 [00:00<00:01, 10.96it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  33%|███▎      | 9/27 [00:00<00:01, 11.54it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  33%|███▎      | 9/27 [00:00<00:01, 11.52it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.70]
Epoch 58:  37%|███▋      | 10/27 [00:00<00:01, 12.06it/s, v_num=0, train_loss_step=65.00, train_loss_epoch=64.70]
Epoch 58:  37%|███▋      | 10/27 [00:00<00:01, 12.04it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58:  41%|████      | 11/27 [00:00<00:01, 12.47it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58:  41%|████      | 11/27 [00:00<00:01, 12.45it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  44%|████▍     | 12/27 [00:00<00:01, 12.88it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  44%|████▍     | 12/27 [00:00<00:01, 12.87it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.70]
Epoch 58:  48%|████▊     | 13/27 [00:00<00:01, 13.26it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.70]
Epoch 58:  48%|████▊     | 13/27 [00:00<00:01, 13.25it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.70]
Epoch 58:  52%|█████▏    | 14/27 [00:01<00:00, 13.55it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.70]
Epoch 58:  52%|█████▏    | 14/27 [00:01<00:00, 13.54it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.70]
Epoch 58:  56%|█████▌    | 15/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.70]
Epoch 58:  56%|█████▌    | 15/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.70]
Epoch 58:  59%|█████▉    | 16/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.70]
Epoch 58:  59%|█████▉    | 16/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.70]
Epoch 58:  63%|██████▎   | 17/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.70]
Epoch 58:  63%|██████▎   | 17/27 [00:01<00:00, 14.31it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.70]
Epoch 58:  67%|██████▋   | 18/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.70]
Epoch 58:  67%|██████▋   | 18/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  70%|███████   | 19/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  70%|███████   | 19/27 [00:01<00:00, 14.49it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 58:  74%|███████▍  | 20/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 58:  74%|███████▍  | 20/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58:  78%|███████▊  | 21/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58:  78%|███████▊  | 21/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58:  81%|████████▏ | 22/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58:  81%|████████▏ | 22/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.70]
Epoch 58:  85%|████████▌ | 23/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.70]
Epoch 58:  85%|████████▌ | 23/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.70]
Epoch 58:  89%|████████▉ | 24/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.70]
Epoch 58:  89%|████████▉ | 24/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  93%|█████████▎| 25/27 [00:01<00:00, 15.34it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.70]
Epoch 58:  93%|█████████▎| 25/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 58:  96%|█████████▋| 26/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.70]
Epoch 58:  96%|█████████▋| 26/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58: 100%|██████████| 27/27 [00:01<00:00, 15.67it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.70]
Epoch 58: 100%|██████████| 27/27 [00:01<00:00, 15.67it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.70]
Epoch 58: 100%|██████████| 27/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.40]
Epoch 58:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.40]         
Epoch 59:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.40]
Epoch 59:   4%|▎         | 1/27 [00:00<00:09,  2.88it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.40]
Epoch 59:   4%|▎         | 1/27 [00:00<00:09,  2.86it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=64.40]
Epoch 59:   7%|▋         | 2/27 [00:00<00:05,  4.90it/s, v_num=0, train_loss_step=64.70, train_loss_epoch=64.40]
Epoch 59:   7%|▋         | 2/27 [00:00<00:05,  4.89it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.40]
Epoch 59:  11%|█         | 3/27 [00:00<00:03,  6.40it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.40]
Epoch 59:  11%|█         | 3/27 [00:00<00:03,  6.38it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.40]
Epoch 59:  15%|█▍        | 4/27 [00:00<00:03,  7.60it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.40]
Epoch 59:  15%|█▍        | 4/27 [00:00<00:03,  7.59it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.40]
Epoch 59:  19%|█▊        | 5/27 [00:00<00:02,  8.62it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.40]
Epoch 59:  19%|█▊        | 5/27 [00:00<00:02,  8.61it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.40]
Epoch 59:  22%|██▏       | 6/27 [00:00<00:02,  9.31it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.40]
Epoch 59:  22%|██▏       | 6/27 [00:00<00:02,  9.30it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.40]
Epoch 59:  26%|██▌       | 7/27 [00:00<00:01, 10.00it/s, v_num=0, train_loss_step=64.60, train_loss_epoch=64.40]
Epoch 59:  26%|██▌       | 7/27 [00:00<00:02,  9.99it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.40]
Epoch 59:  30%|██▉       | 8/27 [00:00<00:01, 10.58it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.40]
Epoch 59:  30%|██▉       | 8/27 [00:00<00:01, 10.56it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.40]
Epoch 59:  33%|███▎      | 9/27 [00:00<00:01, 11.12it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.40]
Epoch 59:  33%|███▎      | 9/27 [00:00<00:01, 11.11it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.40]
Epoch 59:  37%|███▋      | 10/27 [00:00<00:01, 11.61it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.40]
Epoch 59:  37%|███▋      | 10/27 [00:00<00:01, 11.60it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.40]
Epoch 59:  41%|████      | 11/27 [00:00<00:01, 12.02it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.40]
Epoch 59:  41%|████      | 11/27 [00:00<00:01, 12.01it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.40]
Epoch 59:  44%|████▍     | 12/27 [00:00<00:01, 12.44it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.40]
Epoch 59:  44%|████▍     | 12/27 [00:00<00:01, 12.43it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.40]
Epoch 59:  48%|████▊     | 13/27 [00:01<00:01, 12.81it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.40]
Epoch 59:  48%|████▊     | 13/27 [00:01<00:01, 12.80it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.40]
Epoch 59:  52%|█████▏    | 14/27 [00:01<00:00, 13.16it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.40]
Epoch 59:  52%|█████▏    | 14/27 [00:01<00:00, 13.15it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.40]
Epoch 59:  56%|█████▌    | 15/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.40]
Epoch 59:  56%|█████▌    | 15/27 [00:01<00:00, 13.50it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.40]
Epoch 59:  59%|█████▉    | 16/27 [00:01<00:00, 13.76it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.40]
Epoch 59:  59%|█████▉    | 16/27 [00:01<00:00, 13.75it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.40]
Epoch 59:  63%|██████▎   | 17/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=64.80, train_loss_epoch=64.40]
Epoch 59:  63%|██████▎   | 17/27 [00:01<00:00, 14.02it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.40]
Epoch 59:  67%|██████▋   | 18/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.40]
Epoch 59:  67%|██████▋   | 18/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.40]
Epoch 59:  70%|███████   | 19/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.40]
Epoch 59:  70%|███████   | 19/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.40]
Epoch 59:  74%|███████▍  | 20/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.40]
Epoch 59:  74%|███████▍  | 20/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.40]
Epoch 59:  78%|███████▊  | 21/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.40]
Epoch 59:  78%|███████▊  | 21/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.40]
Epoch 59:  81%|████████▏ | 22/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.40]
Epoch 59:  81%|████████▏ | 22/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.40]
Epoch 59:  85%|████████▌ | 23/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.40]
Epoch 59:  85%|████████▌ | 23/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.40]
Epoch 59:  89%|████████▉ | 24/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.40]
Epoch 59:  89%|████████▉ | 24/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.40]
Epoch 59:  93%|█████████▎| 25/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.40]
Epoch 59:  93%|█████████▎| 25/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.40]
Epoch 59:  96%|█████████▋| 26/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.40]
Epoch 59:  96%|█████████▋| 26/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.40]
Epoch 59: 100%|██████████| 27/27 [00:01<00:00, 15.52it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.40]
Epoch 59: 100%|██████████| 27/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.40]
Epoch 59: 100%|██████████| 27/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.20]
Epoch 59:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.20]         
Epoch 60:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.20]
Epoch 60:   4%|▎         | 1/27 [00:00<00:08,  2.96it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.20]
Epoch 60:   4%|▎         | 1/27 [00:00<00:08,  2.94it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.20]
Epoch 60:   7%|▋         | 2/27 [00:00<00:04,  5.01it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.20]
Epoch 60:   7%|▋         | 2/27 [00:00<00:05,  5.00it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  11%|█         | 3/27 [00:00<00:03,  6.69it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  11%|█         | 3/27 [00:00<00:03,  6.68it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60:  15%|█▍        | 4/27 [00:00<00:02,  7.95it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60:  15%|█▍        | 4/27 [00:00<00:02,  7.94it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.20]
Epoch 60:  19%|█▊        | 5/27 [00:00<00:02,  8.85it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.20]
Epoch 60:  19%|█▊        | 5/27 [00:00<00:02,  8.83it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.20]
Epoch 60:  22%|██▏       | 6/27 [00:00<00:02,  9.73it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.20]
Epoch 60:  22%|██▏       | 6/27 [00:00<00:02,  9.71it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.20]
Epoch 60:  26%|██▌       | 7/27 [00:00<00:01, 10.47it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.20]
Epoch 60:  26%|██▌       | 7/27 [00:00<00:01, 10.46it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  30%|██▉       | 8/27 [00:00<00:01, 11.02it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  30%|██▉       | 8/27 [00:00<00:01, 11.00it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.20]
Epoch 60:  33%|███▎      | 9/27 [00:00<00:01, 11.38it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.20]
Epoch 60:  33%|███▎      | 9/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.20]
Epoch 60:  37%|███▋      | 10/27 [00:00<00:01, 11.79it/s, v_num=0, train_loss_step=64.50, train_loss_epoch=64.20]
Epoch 60:  37%|███▋      | 10/27 [00:00<00:01, 11.78it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.20]
Epoch 60:  41%|████      | 11/27 [00:00<00:01, 12.14it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=64.20]
Epoch 60:  41%|████      | 11/27 [00:00<00:01, 12.13it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.20]
Epoch 60:  44%|████▍     | 12/27 [00:00<00:01, 12.61it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.20]
Epoch 60:  44%|████▍     | 12/27 [00:00<00:01, 12.60it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  48%|████▊     | 13/27 [00:01<00:01, 12.98it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  48%|████▊     | 13/27 [00:01<00:01, 12.97it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60:  52%|█████▏    | 14/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60:  52%|█████▏    | 14/27 [00:01<00:00, 13.28it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60:  56%|█████▌    | 15/27 [00:01<00:00, 13.61it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60:  56%|█████▌    | 15/27 [00:01<00:00, 13.60it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=64.20]
Epoch 60:  59%|█████▉    | 16/27 [00:01<00:00, 13.89it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=64.20]
Epoch 60:  59%|█████▉    | 16/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.20]
Epoch 60:  63%|██████▎   | 17/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.20]
Epoch 60:  63%|██████▎   | 17/27 [00:01<00:00, 14.14it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60:  67%|██████▋   | 18/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60:  67%|██████▋   | 18/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.20]
Epoch 60:  70%|███████   | 19/27 [00:01<00:00, 14.57it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.20]
Epoch 60:  70%|███████   | 19/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.20]
Epoch 60:  74%|███████▍  | 20/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.20]
Epoch 60:  74%|███████▍  | 20/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.20]
Epoch 60:  78%|███████▊  | 21/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.20]
Epoch 60:  78%|███████▊  | 21/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.20]
Epoch 60:  81%|████████▏ | 22/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.20]
Epoch 60:  81%|████████▏ | 22/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=64.20]
Epoch 60:  85%|████████▌ | 23/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=64.20]
Epoch 60:  85%|████████▌ | 23/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  89%|████████▉ | 24/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  89%|████████▉ | 24/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.20]
Epoch 60:  93%|█████████▎| 25/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.20]
Epoch 60:  93%|█████████▎| 25/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  96%|█████████▋| 26/27 [00:01<00:00, 15.62it/s, v_num=0, train_loss_step=64.20, train_loss_epoch=64.20]
Epoch 60:  96%|█████████▋| 26/27 [00:01<00:00, 15.61it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.20]
Epoch 60: 100%|██████████| 27/27 [00:01<00:00, 15.81it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.20]
Epoch 60: 100%|██████████| 27/27 [00:01<00:00, 15.80it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.20]
Epoch 60: 100%|██████████| 27/27 [00:01<00:00, 15.79it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.10]
Epoch 60:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.10]         
Epoch 61:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.10]
Epoch 61:   4%|▎         | 1/27 [00:00<00:08,  3.08it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.10]
Epoch 61:   4%|▎         | 1/27 [00:00<00:08,  3.06it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.10]
Epoch 61:   7%|▋         | 2/27 [00:00<00:04,  5.15it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.10]
Epoch 61:   7%|▋         | 2/27 [00:00<00:04,  5.14it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61:  11%|█         | 3/27 [00:00<00:03,  6.84it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61:  11%|█         | 3/27 [00:00<00:03,  6.82it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  15%|█▍        | 4/27 [00:00<00:02,  7.80it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  15%|█▍        | 4/27 [00:00<00:02,  7.79it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  19%|█▊        | 5/27 [00:00<00:02,  8.87it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  19%|█▊        | 5/27 [00:00<00:02,  8.86it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61:  22%|██▏       | 6/27 [00:00<00:02,  9.64it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61:  22%|██▏       | 6/27 [00:00<00:02,  9.63it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61:  26%|██▌       | 7/27 [00:00<00:01, 10.33it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61:  26%|██▌       | 7/27 [00:00<00:01, 10.31it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  30%|██▉       | 8/27 [00:00<00:01, 10.94it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  30%|██▉       | 8/27 [00:00<00:01, 10.93it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  33%|███▎      | 9/27 [00:00<00:01, 11.47it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  33%|███▎      | 9/27 [00:00<00:01, 11.46it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  37%|███▋      | 10/27 [00:00<00:01, 11.95it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  37%|███▋      | 10/27 [00:00<00:01, 11.93it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  41%|████      | 11/27 [00:00<00:01, 12.35it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  41%|████      | 11/27 [00:00<00:01, 12.34it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  44%|████▍     | 12/27 [00:00<00:01, 12.80it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  44%|████▍     | 12/27 [00:00<00:01, 12.78it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.10]
Epoch 61:  48%|████▊     | 13/27 [00:00<00:01, 13.14it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.10]
Epoch 61:  48%|████▊     | 13/27 [00:00<00:01, 13.11it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  52%|█████▏    | 14/27 [00:01<00:00, 13.44it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  52%|█████▏    | 14/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  56%|█████▌    | 15/27 [00:01<00:00, 13.61it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  56%|█████▌    | 15/27 [00:01<00:00, 13.59it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.10]
Epoch 61:  59%|█████▉    | 16/27 [00:01<00:00, 13.89it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=64.10]
Epoch 61:  59%|█████▉    | 16/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  63%|██████▎   | 17/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  63%|██████▎   | 17/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=64.10]
Epoch 61:  67%|██████▋   | 18/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=64.10]
Epoch 61:  67%|██████▋   | 18/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  70%|███████   | 19/27 [00:01<00:00, 14.59it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61:  70%|███████   | 19/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  74%|███████▍  | 20/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  74%|███████▍  | 20/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  78%|███████▊  | 21/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  78%|███████▊  | 21/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.10]
Epoch 61:  81%|████████▏ | 22/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=64.10]
Epoch 61:  81%|████████▏ | 22/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61:  85%|████████▌ | 23/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61:  85%|████████▌ | 23/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.10]
Epoch 61:  89%|████████▉ | 24/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.10]
Epoch 61:  89%|████████▉ | 24/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.10]
Epoch 61:  93%|█████████▎| 25/27 [00:01<00:00, 15.42it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=64.10]
Epoch 61:  93%|█████████▎| 25/27 [00:01<00:00, 15.41it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  96%|█████████▋| 26/27 [00:01<00:00, 15.55it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=64.10]
Epoch 61:  96%|█████████▋| 26/27 [00:01<00:00, 15.54it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61: 100%|██████████| 27/27 [00:01<00:00, 15.76it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=64.10]
Epoch 61: 100%|██████████| 27/27 [00:01<00:00, 15.75it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=64.10]
Epoch 61: 100%|██████████| 27/27 [00:01<00:00, 15.73it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=63.90]
Epoch 61:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=63.90]         
Epoch 62:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=63.90]
Epoch 62:   4%|▎         | 1/27 [00:00<00:08,  3.12it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=63.90]
Epoch 62:   4%|▎         | 1/27 [00:00<00:08,  3.09it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.90]
Epoch 62:   7%|▋         | 2/27 [00:00<00:04,  5.03it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.90]
Epoch 62:   7%|▋         | 2/27 [00:00<00:04,  5.01it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62:  11%|█         | 3/27 [00:00<00:03,  6.49it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62:  11%|█         | 3/27 [00:00<00:03,  6.47it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.90]
Epoch 62:  15%|█▍        | 4/27 [00:00<00:02,  7.77it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.90]
Epoch 62:  15%|█▍        | 4/27 [00:00<00:02,  7.76it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62:  19%|█▊        | 5/27 [00:00<00:02,  8.70it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62:  19%|█▊        | 5/27 [00:00<00:02,  8.69it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=63.90]
Epoch 62:  22%|██▏       | 6/27 [00:00<00:02,  9.45it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=63.90]
Epoch 62:  22%|██▏       | 6/27 [00:00<00:02,  9.44it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=63.90]
Epoch 62:  26%|██▌       | 7/27 [00:00<00:01, 10.03it/s, v_num=0, train_loss_step=64.10, train_loss_epoch=63.90]
Epoch 62:  26%|██▌       | 7/27 [00:00<00:01, 10.02it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=63.90]
Epoch 62:  30%|██▉       | 8/27 [00:00<00:01, 10.64it/s, v_num=0, train_loss_step=64.40, train_loss_epoch=63.90]
Epoch 62:  30%|██▉       | 8/27 [00:00<00:01, 10.62it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62:  33%|███▎      | 9/27 [00:00<00:01, 11.16it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62:  33%|███▎      | 9/27 [00:00<00:01, 11.15it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=63.90]
Epoch 62:  37%|███▋      | 10/27 [00:00<00:01, 11.66it/s, v_num=0, train_loss_step=64.30, train_loss_epoch=63.90]
Epoch 62:  37%|███▋      | 10/27 [00:00<00:01, 11.65it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.90]
Epoch 62:  41%|████      | 11/27 [00:00<00:01, 12.07it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.90]
Epoch 62:  41%|████      | 11/27 [00:00<00:01, 12.06it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.90]
Epoch 62:  44%|████▍     | 12/27 [00:00<00:01, 12.47it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.90]
Epoch 62:  44%|████▍     | 12/27 [00:00<00:01, 12.46it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62:  48%|████▊     | 13/27 [00:01<00:01, 12.79it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62:  48%|████▊     | 13/27 [00:01<00:01, 12.78it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.90]
Epoch 62:  52%|█████▏    | 14/27 [00:01<00:00, 13.16it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.90]
Epoch 62:  52%|█████▏    | 14/27 [00:01<00:00, 13.15it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.90]
Epoch 62:  56%|█████▌    | 15/27 [00:01<00:00, 13.41it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.90]
Epoch 62:  56%|█████▌    | 15/27 [00:01<00:00, 13.40it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.90]
Epoch 62:  59%|█████▉    | 16/27 [00:01<00:00, 13.66it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.90]
Epoch 62:  59%|█████▉    | 16/27 [00:01<00:00, 13.65it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.90]
Epoch 62:  63%|██████▎   | 17/27 [00:01<00:00, 13.89it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.90]
Epoch 62:  63%|██████▎   | 17/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=63.90]
Epoch 62:  67%|██████▋   | 18/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=63.90]
Epoch 62:  67%|██████▋   | 18/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.90]
Epoch 62:  70%|███████   | 19/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.90]
Epoch 62:  70%|███████   | 19/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=63.90]
Epoch 62:  74%|███████▍  | 20/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=64.00, train_loss_epoch=63.90]
Epoch 62:  74%|███████▍  | 20/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.90]
Epoch 62:  78%|███████▊  | 21/27 [00:01<00:00, 14.48it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.90]
Epoch 62:  78%|███████▊  | 21/27 [00:01<00:00, 14.48it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.90]
Epoch 62:  81%|████████▏ | 22/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.90]
Epoch 62:  81%|████████▏ | 22/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.90]
Epoch 62:  85%|████████▌ | 23/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.90]
Epoch 62:  85%|████████▌ | 23/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.90]
Epoch 62:  89%|████████▉ | 24/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.90]
Epoch 62:  89%|████████▉ | 24/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.90]
Epoch 62:  93%|█████████▎| 25/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.90]
Epoch 62:  93%|█████████▎| 25/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.90]
Epoch 62:  96%|█████████▋| 26/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.90]
Epoch 62:  96%|█████████▋| 26/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62: 100%|██████████| 27/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62: 100%|██████████| 27/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.90]
Epoch 62: 100%|██████████| 27/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 62:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]         
Epoch 63:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:   4%|▎         | 1/27 [00:00<00:08,  2.95it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.70]
Epoch 63:   7%|▋         | 2/27 [00:00<00:04,  5.07it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.70]
Epoch 63:   7%|▋         | 2/27 [00:00<00:04,  5.06it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:  11%|█         | 3/27 [00:00<00:03,  6.61it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:  11%|█         | 3/27 [00:00<00:03,  6.59it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  15%|█▍        | 4/27 [00:00<00:02,  7.95it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  15%|█▍        | 4/27 [00:00<00:02,  7.94it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.70]
Epoch 63:  19%|█▊        | 5/27 [00:00<00:02,  8.96it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.70]
Epoch 63:  19%|█▊        | 5/27 [00:00<00:02,  8.94it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:  22%|██▏       | 6/27 [00:00<00:02,  9.80it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:  22%|██▏       | 6/27 [00:00<00:02,  9.79it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.70]
Epoch 63:  26%|██▌       | 7/27 [00:00<00:01, 10.36it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.70]
Epoch 63:  26%|██▌       | 7/27 [00:00<00:01, 10.34it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.70]
Epoch 63:  30%|██▉       | 8/27 [00:00<00:01, 11.11it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.70]
Epoch 63:  30%|██▉       | 8/27 [00:00<00:01, 11.10it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.70]
Epoch 63:  33%|███▎      | 9/27 [00:00<00:01, 11.71it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.70]
Epoch 63:  33%|███▎      | 9/27 [00:00<00:01, 11.70it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.70]
Epoch 63:  37%|███▋      | 10/27 [00:00<00:01, 12.22it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.70]
Epoch 63:  37%|███▋      | 10/27 [00:00<00:01, 12.21it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:  41%|████      | 11/27 [00:00<00:01, 12.75it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:  41%|████      | 11/27 [00:00<00:01, 12.73it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.70]
Epoch 63:  44%|████▍     | 12/27 [00:00<00:01, 13.20it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.70]
Epoch 63:  44%|████▍     | 12/27 [00:00<00:01, 13.18it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  48%|████▊     | 13/27 [00:00<00:01, 13.66it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  48%|████▊     | 13/27 [00:00<00:01, 13.64it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  52%|█████▏    | 14/27 [00:00<00:00, 14.03it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  52%|█████▏    | 14/27 [00:00<00:00, 14.01it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.70]
Epoch 63:  56%|█████▌    | 15/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.70]
Epoch 63:  56%|█████▌    | 15/27 [00:01<00:00, 14.20it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=63.70]
Epoch 63:  59%|█████▉    | 16/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=63.70]
Epoch 63:  59%|█████▉    | 16/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.70]
Epoch 63:  63%|██████▎   | 17/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.70]
Epoch 63:  63%|██████▎   | 17/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:  67%|██████▋   | 18/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63:  67%|██████▋   | 18/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.70]
Epoch 63:  70%|███████   | 19/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.70]
Epoch 63:  70%|███████   | 19/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.70]
Epoch 63:  74%|███████▍  | 20/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.70]
Epoch 63:  74%|███████▍  | 20/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=63.70]
Epoch 63:  78%|███████▊  | 21/27 [00:01<00:00, 15.52it/s, v_num=0, train_loss_step=63.90, train_loss_epoch=63.70]
Epoch 63:  78%|███████▊  | 21/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  81%|████████▏ | 22/27 [00:01<00:00, 15.69it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  81%|████████▏ | 22/27 [00:01<00:00, 15.68it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.70]
Epoch 63:  85%|████████▌ | 23/27 [00:01<00:00, 15.83it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.70]
Epoch 63:  85%|████████▌ | 23/27 [00:01<00:00, 15.82it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  89%|████████▉ | 24/27 [00:01<00:00, 15.95it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63:  89%|████████▉ | 24/27 [00:01<00:00, 15.94it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.70]
Epoch 63:  93%|█████████▎| 25/27 [00:01<00:00, 16.07it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.70]
Epoch 63:  93%|█████████▎| 25/27 [00:01<00:00, 16.06it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.70]
Epoch 63:  96%|█████████▋| 26/27 [00:01<00:00, 16.12it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.70]
Epoch 63:  96%|█████████▋| 26/27 [00:01<00:00, 16.11it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63: 100%|██████████| 27/27 [00:01<00:00, 16.38it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.70]
Epoch 63: 100%|██████████| 27/27 [00:01<00:00, 16.37it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.70]
Epoch 63: 100%|██████████| 27/27 [00:01<00:00, 16.35it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.50]
Epoch 63:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.50]         
Epoch 64:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.50]
Epoch 64:   4%|▎         | 1/27 [00:00<00:09,  2.73it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.50]
Epoch 64:   4%|▎         | 1/27 [00:00<00:09,  2.71it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:   7%|▋         | 2/27 [00:00<00:05,  4.55it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:   7%|▋         | 2/27 [00:00<00:05,  4.54it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.50]
Epoch 64:  11%|█         | 3/27 [00:00<00:03,  6.10it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.50]
Epoch 64:  11%|█         | 3/27 [00:00<00:03,  6.09it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:  15%|█▍        | 4/27 [00:00<00:03,  7.34it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:  15%|█▍        | 4/27 [00:00<00:03,  7.33it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.50]
Epoch 64:  19%|█▊        | 5/27 [00:00<00:02,  8.42it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.50]
Epoch 64:  19%|█▊        | 5/27 [00:00<00:02,  8.40it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.50]
Epoch 64:  22%|██▏       | 6/27 [00:00<00:02,  9.21it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.50]
Epoch 64:  22%|██▏       | 6/27 [00:00<00:02,  9.20it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.50]
Epoch 64:  26%|██▌       | 7/27 [00:00<00:02,  9.90it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.50]
Epoch 64:  26%|██▌       | 7/27 [00:00<00:02,  9.89it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:  30%|██▉       | 8/27 [00:00<00:01, 10.55it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:  30%|██▉       | 8/27 [00:00<00:01, 10.54it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.50]
Epoch 64:  33%|███▎      | 9/27 [00:00<00:01, 11.10it/s, v_num=0, train_loss_step=63.70, train_loss_epoch=63.50]
Epoch 64:  33%|███▎      | 9/27 [00:00<00:01, 11.09it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  37%|███▋      | 10/27 [00:00<00:01, 11.61it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  37%|███▋      | 10/27 [00:00<00:01, 11.60it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.50]
Epoch 64:  41%|████      | 11/27 [00:00<00:01, 12.09it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.50]
Epoch 64:  41%|████      | 11/27 [00:00<00:01, 12.08it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.50]
Epoch 64:  44%|████▍     | 12/27 [00:00<00:01, 12.52it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.50]
Epoch 64:  44%|████▍     | 12/27 [00:00<00:01, 12.50it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.50]
Epoch 64:  48%|████▊     | 13/27 [00:01<00:01, 12.93it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.50]
Epoch 64:  48%|████▊     | 13/27 [00:01<00:01, 12.92it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.50]
Epoch 64:  52%|█████▏    | 14/27 [00:01<00:00, 13.31it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.50]
Epoch 64:  52%|█████▏    | 14/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.50]
Epoch 64:  56%|█████▌    | 15/27 [00:01<00:00, 13.48it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.50]
Epoch 64:  56%|█████▌    | 15/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  59%|█████▉    | 16/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  59%|█████▉    | 16/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  63%|██████▎   | 17/27 [00:01<00:00, 14.09it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  63%|██████▎   | 17/27 [00:01<00:00, 14.08it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.50]
Epoch 64:  67%|██████▋   | 18/27 [00:01<00:00, 14.30it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.50]
Epoch 64:  67%|██████▋   | 18/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  70%|███████   | 19/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  70%|███████   | 19/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  74%|███████▍  | 20/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  74%|███████▍  | 20/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.50]
Epoch 64:  78%|███████▊  | 21/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.50]
Epoch 64:  78%|███████▊  | 21/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  81%|████████▏ | 22/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  81%|████████▏ | 22/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:  85%|████████▌ | 23/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:  85%|████████▌ | 23/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  89%|████████▉ | 24/27 [00:01<00:00, 15.52it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  89%|████████▉ | 24/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:  93%|█████████▎| 25/27 [00:01<00:00, 15.67it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64:  93%|█████████▎| 25/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  96%|█████████▋| 26/27 [00:01<00:00, 15.80it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64:  96%|█████████▋| 26/27 [00:01<00:00, 15.79it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64: 100%|██████████| 27/27 [00:01<00:00, 16.03it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.50]
Epoch 64: 100%|██████████| 27/27 [00:01<00:00, 16.02it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.50]
Epoch 64: 100%|██████████| 27/27 [00:01<00:00, 16.01it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.30]
Epoch 64:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.30]         
Epoch 65:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.30]
Epoch 65:   4%|▎         | 1/27 [00:00<00:09,  2.79it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.30]
Epoch 65:   4%|▎         | 1/27 [00:00<00:09,  2.78it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:   7%|▋         | 2/27 [00:00<00:05,  4.71it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:   7%|▋         | 2/27 [00:00<00:05,  4.70it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.30]
Epoch 65:  11%|█         | 3/27 [00:00<00:03,  6.01it/s, v_num=0, train_loss_step=63.80, train_loss_epoch=63.30]
Epoch 65:  11%|█         | 3/27 [00:00<00:04,  6.00it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.30]
Epoch 65:  15%|█▍        | 4/27 [00:00<00:03,  7.23it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.30]
Epoch 65:  15%|█▍        | 4/27 [00:00<00:03,  7.22it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  19%|█▊        | 5/27 [00:00<00:02,  8.21it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  19%|█▊        | 5/27 [00:00<00:02,  8.20it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.30]
Epoch 65:  22%|██▏       | 6/27 [00:00<00:02,  8.97it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.30]
Epoch 65:  22%|██▏       | 6/27 [00:00<00:02,  8.96it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.30]
Epoch 65:  26%|██▌       | 7/27 [00:00<00:02,  9.66it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.30]
Epoch 65:  26%|██▌       | 7/27 [00:00<00:02,  9.65it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.30]
Epoch 65:  30%|██▉       | 8/27 [00:00<00:01, 10.25it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.30]
Epoch 65:  30%|██▉       | 8/27 [00:00<00:01, 10.24it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=63.30]
Epoch 65:  33%|███▎      | 9/27 [00:00<00:01, 10.67it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=63.30]
Epoch 65:  33%|███▎      | 9/27 [00:00<00:01, 10.66it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=63.30]
Epoch 65:  37%|███▋      | 10/27 [00:00<00:01, 11.21it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=63.30]
Epoch 65:  37%|███▋      | 10/27 [00:00<00:01, 11.20it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.30]
Epoch 65:  41%|████      | 11/27 [00:00<00:01, 11.64it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=63.30]
Epoch 65:  41%|████      | 11/27 [00:00<00:01, 11.63it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  44%|████▍     | 12/27 [00:00<00:01, 12.02it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  44%|████▍     | 12/27 [00:00<00:01, 12.01it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.30]
Epoch 65:  48%|████▊     | 13/27 [00:01<00:01, 12.40it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.30]
Epoch 65:  48%|████▊     | 13/27 [00:01<00:01, 12.39it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.30]
Epoch 65:  52%|█████▏    | 14/27 [00:01<00:01, 12.73it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.30]
Epoch 65:  52%|█████▏    | 14/27 [00:01<00:01, 12.72it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.30]
Epoch 65:  56%|█████▌    | 15/27 [00:01<00:00, 12.99it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.30]
Epoch 65:  56%|█████▌    | 15/27 [00:01<00:00, 12.98it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.30]
Epoch 65:  59%|█████▉    | 16/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.30]
Epoch 65:  59%|█████▉    | 16/27 [00:01<00:00, 13.28it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  63%|██████▎   | 17/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  63%|██████▎   | 17/27 [00:01<00:00, 13.50it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.30]
Epoch 65:  67%|██████▋   | 18/27 [00:01<00:00, 13.75it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.30]
Epoch 65:  67%|██████▋   | 18/27 [00:01<00:00, 13.74it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.30]
Epoch 65:  70%|███████   | 19/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.30]
Epoch 65:  70%|███████   | 19/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.30]
Epoch 65:  74%|███████▍  | 20/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=63.60, train_loss_epoch=63.30]
Epoch 65:  74%|███████▍  | 20/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.30]
Epoch 65:  78%|███████▊  | 21/27 [00:01<00:00, 14.08it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.30]
Epoch 65:  78%|███████▊  | 21/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.30]
Epoch 65:  81%|████████▏ | 22/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.30]
Epoch 65:  81%|████████▏ | 22/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  85%|████████▌ | 23/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  85%|████████▌ | 23/27 [00:01<00:00, 14.37it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.30]
Epoch 65:  89%|████████▉ | 24/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.30]
Epoch 65:  89%|████████▉ | 24/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  93%|█████████▎| 25/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65:  93%|█████████▎| 25/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.30]
Epoch 65:  96%|█████████▋| 26/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.30]
Epoch 65:  96%|█████████▋| 26/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65: 100%|██████████| 27/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.30]
Epoch 65: 100%|██████████| 27/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.30]
Epoch 65: 100%|██████████| 27/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.20]
Epoch 65:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.20]         
Epoch 66:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.20]
Epoch 66:   4%|▎         | 1/27 [00:00<00:08,  3.06it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.20]
Epoch 66:   4%|▎         | 1/27 [00:00<00:08,  3.04it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:   7%|▋         | 2/27 [00:00<00:04,  5.07it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:   7%|▋         | 2/27 [00:00<00:04,  5.06it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  11%|█         | 3/27 [00:00<00:03,  6.54it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  11%|█         | 3/27 [00:00<00:03,  6.52it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66:  15%|█▍        | 4/27 [00:00<00:02,  7.81it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66:  15%|█▍        | 4/27 [00:00<00:02,  7.80it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:  19%|█▊        | 5/27 [00:00<00:02,  8.86it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:  19%|█▊        | 5/27 [00:00<00:02,  8.84it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:  22%|██▏       | 6/27 [00:00<00:02,  9.44it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:  22%|██▏       | 6/27 [00:00<00:02,  9.43it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  26%|██▌       | 7/27 [00:00<00:01, 10.13it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.20]
Epoch 66:  30%|██▉       | 8/27 [00:00<00:01, 10.69it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.20]
Epoch 66:  30%|██▉       | 8/27 [00:00<00:01, 10.67it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=63.20]
Epoch 66:  33%|███▎      | 9/27 [00:00<00:01, 11.30it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=63.20]
Epoch 66:  33%|███▎      | 9/27 [00:00<00:01, 11.29it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:  37%|███▋      | 10/27 [00:00<00:01, 11.78it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:  37%|███▋      | 10/27 [00:00<00:01, 11.77it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.20]
Epoch 66:  41%|████      | 11/27 [00:00<00:01, 12.20it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.20]
Epoch 66:  41%|████      | 11/27 [00:00<00:01, 12.19it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.20]
Epoch 66:  44%|████▍     | 12/27 [00:00<00:01, 12.61it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.20]
Epoch 66:  44%|████▍     | 12/27 [00:00<00:01, 12.60it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:  48%|████▊     | 13/27 [00:01<00:01, 12.98it/s, v_num=0, train_loss_step=63.30, train_loss_epoch=63.20]
Epoch 66:  48%|████▊     | 13/27 [00:01<00:01, 12.97it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.20]
Epoch 66:  52%|█████▏    | 14/27 [00:01<00:00, 13.27it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.20]
Epoch 66:  52%|█████▏    | 14/27 [00:01<00:00, 13.26it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.20]
Epoch 66:  56%|█████▌    | 15/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.20]
Epoch 66:  56%|█████▌    | 15/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.20]
Epoch 66:  59%|█████▉    | 16/27 [00:01<00:00, 13.82it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.20]
Epoch 66:  59%|█████▉    | 16/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.20]
Epoch 66:  63%|██████▎   | 17/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.20]
Epoch 66:  63%|██████▎   | 17/27 [00:01<00:00, 13.95it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.20]
Epoch 66:  67%|██████▋   | 18/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.20]
Epoch 66:  67%|██████▋   | 18/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.20]
Epoch 66:  70%|███████   | 19/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.20]
Epoch 66:  70%|███████   | 19/27 [00:01<00:00, 14.34it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  74%|███████▍  | 20/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  74%|███████▍  | 20/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  78%|███████▊  | 21/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  78%|███████▊  | 21/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  81%|████████▏ | 22/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.20]
Epoch 66:  81%|████████▏ | 22/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66:  85%|████████▌ | 23/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66:  85%|████████▌ | 23/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66:  89%|████████▉ | 24/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66:  89%|████████▉ | 24/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.20]
Epoch 66:  93%|█████████▎| 25/27 [00:01<00:00, 15.23it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.20]
Epoch 66:  93%|█████████▎| 25/27 [00:01<00:00, 15.22it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66:  96%|█████████▋| 26/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66:  96%|█████████▋| 26/27 [00:01<00:00, 15.34it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.20]
Epoch 66: 100%|██████████| 27/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.20]
Epoch 66: 100%|██████████| 27/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.20]
Epoch 66: 100%|██████████| 27/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.00]
Epoch 66:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.00]         
Epoch 67:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.00]
Epoch 67:   4%|▎         | 1/27 [00:00<00:08,  2.95it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.00]
Epoch 67:   4%|▎         | 1/27 [00:00<00:08,  2.93it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.00]
Epoch 67:   7%|▋         | 2/27 [00:00<00:05,  4.97it/s, v_num=0, train_loss_step=63.40, train_loss_epoch=63.00]
Epoch 67:   7%|▋         | 2/27 [00:00<00:05,  4.96it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.00]
Epoch 67:  11%|█         | 3/27 [00:00<00:03,  6.59it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.00]
Epoch 67:  11%|█         | 3/27 [00:00<00:03,  6.58it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.00]
Epoch 67:  15%|█▍        | 4/27 [00:00<00:02,  7.72it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.00]
Epoch 67:  15%|█▍        | 4/27 [00:00<00:02,  7.70it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=63.00]
Epoch 67:  19%|█▊        | 5/27 [00:00<00:02,  8.77it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=63.00]
Epoch 67:  19%|█▊        | 5/27 [00:00<00:02,  8.75it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=63.00]
Epoch 67:  22%|██▏       | 6/27 [00:00<00:02,  9.65it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=63.00]
Epoch 67:  22%|██▏       | 6/27 [00:00<00:02,  9.63it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  26%|██▌       | 7/27 [00:00<00:01, 10.24it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  26%|██▌       | 7/27 [00:00<00:01, 10.23it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  30%|██▉       | 8/27 [00:00<00:01, 10.85it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  30%|██▉       | 8/27 [00:00<00:01, 10.83it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.00]
Epoch 67:  33%|███▎      | 9/27 [00:00<00:01, 11.42it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.00]
Epoch 67:  33%|███▎      | 9/27 [00:00<00:01, 11.41it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  37%|███▋      | 10/27 [00:00<00:01, 11.98it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  37%|███▋      | 10/27 [00:00<00:01, 11.96it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  41%|████      | 11/27 [00:00<00:01, 12.38it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  41%|████      | 11/27 [00:00<00:01, 12.37it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.00]
Epoch 67:  44%|████▍     | 12/27 [00:00<00:01, 12.82it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.00]
Epoch 67:  44%|████▍     | 12/27 [00:00<00:01, 12.81it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  48%|████▊     | 13/27 [00:00<00:01, 13.24it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  48%|████▊     | 13/27 [00:00<00:01, 13.23it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  52%|█████▏    | 14/27 [00:01<00:00, 13.53it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  52%|█████▏    | 14/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.00]
Epoch 67:  56%|█████▌    | 15/27 [00:01<00:00, 13.87it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.00]
Epoch 67:  56%|█████▌    | 15/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=63.00]
Epoch 67:  59%|█████▉    | 16/27 [00:01<00:00, 14.21it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=63.00]
Epoch 67:  59%|█████▉    | 16/27 [00:01<00:00, 14.20it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=63.00]
Epoch 67:  63%|██████▎   | 17/27 [00:01<00:00, 14.48it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=63.00]
Epoch 67:  63%|██████▎   | 17/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  67%|██████▋   | 18/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  67%|██████▋   | 18/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.00]
Epoch 67:  70%|███████   | 19/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=63.00]
Epoch 67:  70%|███████   | 19/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  74%|███████▍  | 20/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  74%|███████▍  | 20/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.00]
Epoch 67:  78%|███████▊  | 21/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.00]
Epoch 67:  78%|███████▊  | 21/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  81%|████████▏ | 22/27 [00:01<00:00, 15.34it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  81%|████████▏ | 22/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.00]
Epoch 67:  85%|████████▌ | 23/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=63.00]
Epoch 67:  85%|████████▌ | 23/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=63.00]
Epoch 67:  89%|████████▉ | 24/27 [00:01<00:00, 15.67it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=63.00]
Epoch 67:  89%|████████▉ | 24/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  93%|█████████▎| 25/27 [00:01<00:00, 15.75it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=63.00]
Epoch 67:  93%|█████████▎| 25/27 [00:01<00:00, 15.74it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  96%|█████████▋| 26/27 [00:01<00:00, 15.86it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=63.00]
Epoch 67:  96%|█████████▋| 26/27 [00:01<00:00, 15.85it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.00]
Epoch 67: 100%|██████████| 27/27 [00:01<00:00, 16.06it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=63.00]
Epoch 67: 100%|██████████| 27/27 [00:01<00:00, 16.05it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=63.00]
Epoch 67: 100%|██████████| 27/27 [00:01<00:00, 16.04it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 67:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]         
Epoch 68:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 68:   4%|▎         | 1/27 [00:00<00:08,  3.17it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 68:   4%|▎         | 1/27 [00:00<00:08,  3.15it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:   7%|▋         | 2/27 [00:00<00:04,  5.22it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:   7%|▋         | 2/27 [00:00<00:04,  5.21it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:  11%|█         | 3/27 [00:00<00:03,  6.90it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:  11%|█         | 3/27 [00:00<00:03,  6.89it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=62.90]
Epoch 68:  15%|█▍        | 4/27 [00:00<00:02,  7.78it/s, v_num=0, train_loss_step=63.50, train_loss_epoch=62.90]
Epoch 68:  15%|█▍        | 4/27 [00:00<00:02,  7.76it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  19%|█▊        | 5/27 [00:00<00:02,  8.71it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  19%|█▊        | 5/27 [00:00<00:02,  8.69it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 68:  22%|██▏       | 6/27 [00:00<00:02,  9.44it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 68:  22%|██▏       | 6/27 [00:00<00:02,  9.43it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.90]
Epoch 68:  26%|██▌       | 7/27 [00:00<00:01, 10.05it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.90]
Epoch 68:  26%|██▌       | 7/27 [00:00<00:01, 10.04it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.90]
Epoch 68:  30%|██▉       | 8/27 [00:00<00:01, 10.55it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.90]
Epoch 68:  30%|██▉       | 8/27 [00:00<00:01, 10.54it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 68:  33%|███▎      | 9/27 [00:00<00:01, 11.06it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 68:  33%|███▎      | 9/27 [00:00<00:01, 11.04it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=62.90]
Epoch 68:  37%|███▋      | 10/27 [00:00<00:01, 11.51it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=62.90]
Epoch 68:  37%|███▋      | 10/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=62.90]
Epoch 68:  41%|████      | 11/27 [00:00<00:01, 11.96it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=62.90]
Epoch 68:  41%|████      | 11/27 [00:00<00:01, 11.95it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:  44%|████▍     | 12/27 [00:00<00:01, 12.35it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:  44%|████▍     | 12/27 [00:00<00:01, 12.33it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=62.90]
Epoch 68:  48%|████▊     | 13/27 [00:01<00:01, 12.77it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=62.90]
Epoch 68:  48%|████▊     | 13/27 [00:01<00:01, 12.75it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  52%|█████▏    | 14/27 [00:01<00:00, 13.08it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  52%|█████▏    | 14/27 [00:01<00:00, 13.07it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:  56%|█████▌    | 15/27 [00:01<00:00, 13.41it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:  56%|█████▌    | 15/27 [00:01<00:00, 13.40it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  59%|█████▉    | 16/27 [00:01<00:00, 13.66it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  59%|█████▉    | 16/27 [00:01<00:00, 13.65it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.90]
Epoch 68:  63%|██████▎   | 17/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.90]
Epoch 68:  63%|██████▎   | 17/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.90]
Epoch 68:  67%|██████▋   | 18/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.90]
Epoch 68:  67%|██████▋   | 18/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  70%|███████   | 19/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  70%|███████   | 19/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 68:  74%|███████▍  | 20/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.90]
Epoch 68:  74%|███████▍  | 20/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  78%|███████▊  | 21/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68:  78%|███████▊  | 21/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=62.90]
Epoch 68:  81%|████████▏ | 22/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=62.90]
Epoch 68:  81%|████████▏ | 22/27 [00:01<00:00, 14.59it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:  85%|████████▌ | 23/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.90]
Epoch 68:  85%|████████▌ | 23/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.90]
Epoch 68:  89%|████████▉ | 24/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.90]
Epoch 68:  89%|████████▉ | 24/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.90]
Epoch 68:  93%|█████████▎| 25/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.90]
Epoch 68:  93%|█████████▎| 25/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.90]
Epoch 68:  96%|█████████▋| 26/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.90]
Epoch 68:  96%|█████████▋| 26/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68: 100%|██████████| 27/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.90]
Epoch 68: 100%|██████████| 27/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.90]
Epoch 68: 100%|██████████| 27/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 68:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]         
Epoch 69:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:   4%|▎         | 1/27 [00:00<00:08,  2.96it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:   4%|▎         | 1/27 [00:00<00:08,  2.93it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.70]
Epoch 69:   7%|▋         | 2/27 [00:00<00:04,  5.02it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.70]
Epoch 69:   7%|▋         | 2/27 [00:00<00:04,  5.01it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.70]
Epoch 69:  11%|█         | 3/27 [00:00<00:03,  6.62it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.70]
Epoch 69:  11%|█         | 3/27 [00:00<00:03,  6.61it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.70]
Epoch 69:  15%|█▍        | 4/27 [00:00<00:02,  7.81it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.70]
Epoch 69:  15%|█▍        | 4/27 [00:00<00:02,  7.80it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.70]
Epoch 69:  19%|█▊        | 5/27 [00:00<00:02,  8.83it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.70]
Epoch 69:  19%|█▊        | 5/27 [00:00<00:02,  8.81it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  22%|██▏       | 6/27 [00:00<00:02,  9.47it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  22%|██▏       | 6/27 [00:00<00:02,  9.46it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.70]
Epoch 69:  26%|██▌       | 7/27 [00:00<00:02,  9.90it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.70]
Epoch 69:  26%|██▌       | 7/27 [00:00<00:02,  9.88it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.70]
Epoch 69:  30%|██▉       | 8/27 [00:00<00:01, 10.38it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.70]
Epoch 69:  30%|██▉       | 8/27 [00:00<00:01, 10.37it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.70]
Epoch 69:  33%|███▎      | 9/27 [00:00<00:01, 10.97it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.70]
Epoch 69:  33%|███▎      | 9/27 [00:00<00:01, 10.94it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.70]
Epoch 69:  37%|███▋      | 10/27 [00:00<00:01, 11.41it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.70]
Epoch 69:  37%|███▋      | 10/27 [00:00<00:01, 11.39it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  41%|████      | 11/27 [00:00<00:01, 11.79it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  41%|████      | 11/27 [00:00<00:01, 11.78it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.70]
Epoch 69:  44%|████▍     | 12/27 [00:00<00:01, 12.21it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.70]
Epoch 69:  44%|████▍     | 12/27 [00:00<00:01, 12.20it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.70]
Epoch 69:  48%|████▊     | 13/27 [00:01<00:01, 12.66it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.70]
Epoch 69:  48%|████▊     | 13/27 [00:01<00:01, 12.65it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  52%|█████▏    | 14/27 [00:01<00:00, 13.00it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  52%|█████▏    | 14/27 [00:01<00:01, 12.99it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=62.70]
Epoch 69:  56%|█████▌    | 15/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=62.70]
Epoch 69:  56%|█████▌    | 15/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.70]
Epoch 69:  59%|█████▉    | 16/27 [00:01<00:00, 13.62it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.70]
Epoch 69:  59%|█████▉    | 16/27 [00:01<00:00, 13.61it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.70]
Epoch 69:  63%|██████▎   | 17/27 [00:01<00:00, 13.89it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.70]
Epoch 69:  63%|██████▎   | 17/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  67%|██████▋   | 18/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  67%|██████▋   | 18/27 [00:01<00:00, 14.10it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.70]
Epoch 69:  70%|███████   | 19/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.70]
Epoch 69:  70%|███████   | 19/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.70]
Epoch 69:  74%|███████▍  | 20/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.70]
Epoch 69:  74%|███████▍  | 20/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.70]
Epoch 69:  78%|███████▊  | 21/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.70]
Epoch 69:  78%|███████▊  | 21/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  81%|████████▏ | 22/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.70]
Epoch 69:  81%|████████▏ | 22/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.70]
Epoch 69:  85%|████████▌ | 23/27 [00:01<00:00, 14.82it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.70]
Epoch 69:  85%|████████▌ | 23/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.70]
Epoch 69:  89%|████████▉ | 24/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.70]
Epoch 69:  89%|████████▉ | 24/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.70]
Epoch 69:  93%|█████████▎| 25/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.70]
Epoch 69:  93%|█████████▎| 25/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.70]
Epoch 69:  96%|█████████▋| 26/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.70]
Epoch 69:  96%|█████████▋| 26/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.70]
Epoch 69: 100%|██████████| 27/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.70]
Epoch 69: 100%|██████████| 27/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.70]
Epoch 69: 100%|██████████| 27/27 [00:01<00:00, 15.24it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 69:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]         
Epoch 70:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 70:   4%|▎         | 1/27 [00:00<00:08,  3.11it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 70:   4%|▎         | 1/27 [00:00<00:08,  3.09it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:   7%|▋         | 2/27 [00:00<00:04,  5.28it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:   7%|▋         | 2/27 [00:00<00:04,  5.27it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  11%|█         | 3/27 [00:00<00:03,  6.92it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  11%|█         | 3/27 [00:00<00:03,  6.91it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.60]
Epoch 70:  15%|█▍        | 4/27 [00:00<00:02,  8.19it/s, v_num=0, train_loss_step=63.00, train_loss_epoch=62.60]
Epoch 70:  15%|█▍        | 4/27 [00:00<00:02,  8.18it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  19%|█▊        | 5/27 [00:00<00:02,  9.10it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  19%|█▊        | 5/27 [00:00<00:02,  9.09it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 70:  22%|██▏       | 6/27 [00:00<00:02,  9.71it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 70:  22%|██▏       | 6/27 [00:00<00:02,  9.69it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.60]
Epoch 70:  26%|██▌       | 7/27 [00:00<00:01, 10.35it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.60]
Epoch 70:  26%|██▌       | 7/27 [00:00<00:01, 10.34it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  30%|██▉       | 8/27 [00:00<00:01, 10.95it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  30%|██▉       | 8/27 [00:00<00:01, 10.93it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.60]
Epoch 70:  33%|███▎      | 9/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.60]
Epoch 70:  33%|███▎      | 9/27 [00:00<00:01, 11.48it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  37%|███▋      | 10/27 [00:00<00:01, 11.96it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  37%|███▋      | 10/27 [00:00<00:01, 11.94it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.60]
Epoch 70:  41%|████      | 11/27 [00:00<00:01, 12.21it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.60]
Epoch 70:  41%|████      | 11/27 [00:00<00:01, 12.19it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 70:  44%|████▍     | 12/27 [00:00<00:01, 12.56it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 70:  44%|████▍     | 12/27 [00:00<00:01, 12.55it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  48%|████▊     | 13/27 [00:01<00:01, 12.94it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  48%|████▊     | 13/27 [00:01<00:01, 12.93it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  52%|█████▏    | 14/27 [00:01<00:00, 13.27it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  52%|█████▏    | 14/27 [00:01<00:00, 13.26it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.60]
Epoch 70:  56%|█████▌    | 15/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.60]
Epoch 70:  56%|█████▌    | 15/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  59%|█████▉    | 16/27 [00:01<00:00, 13.87it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  59%|█████▉    | 16/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.60]
Epoch 70:  63%|██████▎   | 17/27 [00:01<00:00, 14.08it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.60]
Epoch 70:  63%|██████▎   | 17/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  67%|██████▋   | 18/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  67%|██████▋   | 18/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  70%|███████   | 19/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  70%|███████   | 19/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  74%|███████▍  | 20/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.60]
Epoch 70:  74%|███████▍  | 20/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.60]
Epoch 70:  78%|███████▊  | 21/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.60]
Epoch 70:  78%|███████▊  | 21/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  81%|████████▏ | 22/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  81%|████████▏ | 22/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 70:  85%|████████▌ | 23/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.60]
Epoch 70:  85%|████████▌ | 23/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.60]
Epoch 70:  89%|████████▉ | 24/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.60]
Epoch 70:  89%|████████▉ | 24/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  93%|█████████▎| 25/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.60]
Epoch 70:  93%|█████████▎| 25/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.60]
Epoch 70:  96%|█████████▋| 26/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.60]
Epoch 70:  96%|█████████▋| 26/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.60]
Epoch 70: 100%|██████████| 27/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.60]
Epoch 70: 100%|██████████| 27/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.60]
Epoch 70: 100%|██████████| 27/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.40]
Epoch 70:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.40]         
Epoch 71:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.40]
Epoch 71:   4%|▎         | 1/27 [00:00<00:08,  3.00it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.40]
Epoch 71:   4%|▎         | 1/27 [00:00<00:08,  2.98it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.40]
Epoch 71:   7%|▋         | 2/27 [00:00<00:04,  5.22it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.40]
Epoch 71:   7%|▋         | 2/27 [00:00<00:04,  5.21it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.40]
Epoch 71:  11%|█         | 3/27 [00:00<00:03,  6.82it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.40]
Epoch 71:  11%|█         | 3/27 [00:00<00:03,  6.80it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.40]
Epoch 71:  15%|█▍        | 4/27 [00:00<00:02,  8.00it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.40]
Epoch 71:  15%|█▍        | 4/27 [00:00<00:02,  7.99it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.40]
Epoch 71:  19%|█▊        | 5/27 [00:00<00:02,  8.88it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.40]
Epoch 71:  19%|█▊        | 5/27 [00:00<00:02,  8.86it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.40]
Epoch 71:  22%|██▏       | 6/27 [00:00<00:02,  9.69it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.40]
Epoch 71:  22%|██▏       | 6/27 [00:00<00:02,  9.68it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.40]
Epoch 71:  26%|██▌       | 7/27 [00:00<00:01, 10.20it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.40]
Epoch 71:  26%|██▌       | 7/27 [00:00<00:01, 10.19it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  30%|██▉       | 8/27 [00:00<00:01, 10.78it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  30%|██▉       | 8/27 [00:00<00:01, 10.77it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.40]
Epoch 71:  33%|███▎      | 9/27 [00:00<00:01, 11.27it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.40]
Epoch 71:  33%|███▎      | 9/27 [00:00<00:01, 11.25it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  37%|███▋      | 10/27 [00:00<00:01, 11.77it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  37%|███▋      | 10/27 [00:00<00:01, 11.76it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.40]
Epoch 71:  41%|████      | 11/27 [00:00<00:01, 12.14it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.40]
Epoch 71:  41%|████      | 11/27 [00:00<00:01, 12.13it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.40]
Epoch 71:  44%|████▍     | 12/27 [00:00<00:01, 12.58it/s, v_num=0, train_loss_step=62.80, train_loss_epoch=62.40]
Epoch 71:  44%|████▍     | 12/27 [00:00<00:01, 12.57it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.40]
Epoch 71:  48%|████▊     | 13/27 [00:01<00:01, 12.97it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.40]
Epoch 71:  48%|████▊     | 13/27 [00:01<00:01, 12.95it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  52%|█████▏    | 14/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  52%|█████▏    | 14/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=62.40]
Epoch 71:  56%|█████▌    | 15/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=62.90, train_loss_epoch=62.40]
Epoch 71:  56%|█████▌    | 15/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  59%|█████▉    | 16/27 [00:01<00:00, 13.85it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  59%|█████▉    | 16/27 [00:01<00:00, 13.84it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.40]
Epoch 71:  63%|██████▎   | 17/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.40]
Epoch 71:  63%|██████▎   | 17/27 [00:01<00:00, 14.14it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.40]
Epoch 71:  67%|██████▋   | 18/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.40]
Epoch 71:  67%|██████▋   | 18/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=62.40]
Epoch 71:  70%|███████   | 19/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=63.20, train_loss_epoch=62.40]
Epoch 71:  70%|███████   | 19/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  74%|███████▍  | 20/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.40]
Epoch 71:  74%|███████▍  | 20/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.40]
Epoch 71:  78%|███████▊  | 21/27 [00:01<00:00, 14.82it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.40]
Epoch 71:  78%|███████▊  | 21/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.40]
Epoch 71:  81%|████████▏ | 22/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.40]
Epoch 71:  81%|████████▏ | 22/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.40]
Epoch 71:  85%|████████▌ | 23/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.40]
Epoch 71:  85%|████████▌ | 23/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.40]
Epoch 71:  89%|████████▉ | 24/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=62.60, train_loss_epoch=62.40]
Epoch 71:  89%|████████▉ | 24/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.40]
Epoch 71:  93%|█████████▎| 25/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.40]
Epoch 71:  93%|█████████▎| 25/27 [00:01<00:00, 15.25it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.40]
Epoch 71:  96%|█████████▋| 26/27 [00:01<00:00, 15.34it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.40]
Epoch 71:  96%|█████████▋| 26/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.40]
Epoch 71: 100%|██████████| 27/27 [00:01<00:00, 15.54it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.40]
Epoch 71: 100%|██████████| 27/27 [00:01<00:00, 15.53it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.40]
Epoch 71: 100%|██████████| 27/27 [00:01<00:00, 15.52it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 71:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]         
Epoch 72:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:   4%|▎         | 1/27 [00:00<00:09,  2.86it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:   4%|▎         | 1/27 [00:00<00:09,  2.84it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.30]
Epoch 72:   7%|▋         | 2/27 [00:00<00:05,  4.92it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.30]
Epoch 72:   7%|▋         | 2/27 [00:00<00:05,  4.91it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:  11%|█         | 3/27 [00:00<00:03,  6.45it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:  11%|█         | 3/27 [00:00<00:03,  6.44it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.30]
Epoch 72:  15%|█▍        | 4/27 [00:00<00:03,  7.56it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.30]
Epoch 72:  15%|█▍        | 4/27 [00:00<00:03,  7.54it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.30]
Epoch 72:  19%|█▊        | 5/27 [00:00<00:02,  8.49it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.30]
Epoch 72:  19%|█▊        | 5/27 [00:00<00:02,  8.48it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.30]
Epoch 72:  22%|██▏       | 6/27 [00:00<00:02,  9.17it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.30]
Epoch 72:  22%|██▏       | 6/27 [00:00<00:02,  9.16it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.30]
Epoch 72:  26%|██▌       | 7/27 [00:00<00:02,  9.89it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.30]
Epoch 72:  26%|██▌       | 7/27 [00:00<00:02,  9.87it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:  30%|██▉       | 8/27 [00:00<00:01, 10.51it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:  30%|██▉       | 8/27 [00:00<00:01, 10.50it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.30]
Epoch 72:  33%|███▎      | 9/27 [00:00<00:01, 11.03it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.30]
Epoch 72:  33%|███▎      | 9/27 [00:00<00:01, 11.01it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.30]
Epoch 72:  37%|███▋      | 10/27 [00:00<00:01, 11.48it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.30]
Epoch 72:  37%|███▋      | 10/27 [00:00<00:01, 11.46it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=62.30]
Epoch 72:  41%|████      | 11/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=63.10, train_loss_epoch=62.30]
Epoch 72:  41%|████      | 11/27 [00:00<00:01, 11.90it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:  44%|████▍     | 12/27 [00:00<00:01, 12.31it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:  44%|████▍     | 12/27 [00:00<00:01, 12.30it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.30]
Epoch 72:  48%|████▊     | 13/27 [00:01<00:01, 12.70it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.30]
Epoch 72:  48%|████▊     | 13/27 [00:01<00:01, 12.69it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  52%|█████▏    | 14/27 [00:01<00:00, 13.04it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  52%|█████▏    | 14/27 [00:01<00:00, 13.03it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  56%|█████▌    | 15/27 [00:01<00:00, 13.35it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  56%|█████▌    | 15/27 [00:01<00:00, 13.34it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  59%|█████▉    | 16/27 [00:01<00:00, 13.67it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  59%|█████▉    | 16/27 [00:01<00:00, 13.66it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.30]
Epoch 72:  63%|██████▎   | 17/27 [00:01<00:00, 13.97it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.30]
Epoch 72:  63%|██████▎   | 17/27 [00:01<00:00, 13.96it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.30]
Epoch 72:  67%|██████▋   | 18/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.30]
Epoch 72:  67%|██████▋   | 18/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.30]
Epoch 72:  70%|███████   | 19/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.30]
Epoch 72:  70%|███████   | 19/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.30]
Epoch 72:  74%|███████▍  | 20/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.30]
Epoch 72:  74%|███████▍  | 20/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=62.30]
Epoch 72:  78%|███████▊  | 21/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=62.30]
Epoch 72:  78%|███████▊  | 21/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  81%|████████▏ | 22/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  81%|████████▏ | 22/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  85%|████████▌ | 23/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.30]
Epoch 72:  85%|████████▌ | 23/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:  89%|████████▉ | 24/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.30]
Epoch 72:  89%|████████▉ | 24/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.30]
Epoch 72:  93%|█████████▎| 25/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.30]
Epoch 72:  93%|█████████▎| 25/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.30]
Epoch 72:  96%|█████████▋| 26/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.30]
Epoch 72:  96%|█████████▋| 26/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.30]
Epoch 72: 100%|██████████| 27/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.30]
Epoch 72: 100%|██████████| 27/27 [00:01<00:00, 15.50it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.30]
Epoch 72: 100%|██████████| 27/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.10]
Epoch 72:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.10]         
Epoch 73:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.10]
Epoch 73:   4%|▎         | 1/27 [00:00<00:07,  3.26it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.10]
Epoch 73:   4%|▎         | 1/27 [00:00<00:08,  3.24it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.10]
Epoch 73:   7%|▋         | 2/27 [00:00<00:04,  5.40it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.10]
Epoch 73:   7%|▋         | 2/27 [00:00<00:04,  5.39it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  11%|█         | 3/27 [00:00<00:03,  7.04it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  11%|█         | 3/27 [00:00<00:03,  7.02it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.10]
Epoch 73:  15%|█▍        | 4/27 [00:00<00:02,  8.19it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.10]
Epoch 73:  15%|█▍        | 4/27 [00:00<00:02,  8.17it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.10]
Epoch 73:  19%|█▊        | 5/27 [00:00<00:02,  9.28it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.10]
Epoch 73:  19%|█▊        | 5/27 [00:00<00:02,  9.26it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  22%|██▏       | 6/27 [00:00<00:02, 10.18it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  22%|██▏       | 6/27 [00:00<00:02, 10.16it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.10]
Epoch 73:  26%|██▌       | 7/27 [00:00<00:01, 10.69it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.10]
Epoch 73:  26%|██▌       | 7/27 [00:00<00:01, 10.67it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=62.10]
Epoch 73:  30%|██▉       | 8/27 [00:00<00:01, 11.12it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=62.10]
Epoch 73:  30%|██▉       | 8/27 [00:00<00:01, 11.10it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.10]
Epoch 73:  33%|███▎      | 9/27 [00:00<00:01, 11.69it/s, v_num=0, train_loss_step=62.50, train_loss_epoch=62.10]
Epoch 73:  33%|███▎      | 9/27 [00:00<00:01, 11.68it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.10]
Epoch 73:  37%|███▋      | 10/27 [00:00<00:01, 12.03it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.10]
Epoch 73:  37%|███▋      | 10/27 [00:00<00:01, 12.01it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.10]
Epoch 73:  41%|████      | 11/27 [00:00<00:01, 12.48it/s, v_num=0, train_loss_step=62.70, train_loss_epoch=62.10]
Epoch 73:  41%|████      | 11/27 [00:00<00:01, 12.46it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.10]
Epoch 73:  44%|████▍     | 12/27 [00:00<00:01, 12.84it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.10]
Epoch 73:  44%|████▍     | 12/27 [00:00<00:01, 12.83it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.10]
Epoch 73:  48%|████▊     | 13/27 [00:00<00:01, 13.14it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.10]
Epoch 73:  48%|████▊     | 13/27 [00:00<00:01, 13.13it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.10]
Epoch 73:  52%|█████▏    | 14/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.10]
Epoch 73:  52%|█████▏    | 14/27 [00:01<00:00, 13.44it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.10]
Epoch 73:  56%|█████▌    | 15/27 [00:01<00:00, 13.76it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.10]
Epoch 73:  56%|█████▌    | 15/27 [00:01<00:00, 13.75it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.10]
Epoch 73:  59%|█████▉    | 16/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.10]
Epoch 73:  59%|█████▉    | 16/27 [00:01<00:00, 14.02it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.10]
Epoch 73:  63%|██████▎   | 17/27 [00:01<00:00, 14.31it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.10]
Epoch 73:  63%|██████▎   | 17/27 [00:01<00:00, 14.30it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  67%|██████▋   | 18/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  67%|██████▋   | 18/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.10]
Epoch 73:  70%|███████   | 19/27 [00:01<00:00, 14.70it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.10]
Epoch 73:  70%|███████   | 19/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.10]
Epoch 73:  74%|███████▍  | 20/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.10]
Epoch 73:  74%|███████▍  | 20/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.10]
Epoch 73:  78%|███████▊  | 21/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.10]
Epoch 73:  78%|███████▊  | 21/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.10]
Epoch 73:  81%|████████▏ | 22/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.10]
Epoch 73:  81%|████████▏ | 22/27 [00:01<00:00, 15.17it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=62.10]
Epoch 73:  85%|████████▌ | 23/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=62.10]
Epoch 73:  85%|████████▌ | 23/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  89%|████████▉ | 24/27 [00:01<00:00, 15.45it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  89%|████████▉ | 24/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  93%|█████████▎| 25/27 [00:01<00:00, 15.57it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.10]
Epoch 73:  93%|█████████▎| 25/27 [00:01<00:00, 15.56it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.10]
Epoch 73:  96%|█████████▋| 26/27 [00:01<00:00, 15.68it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.10]
Epoch 73:  96%|█████████▋| 26/27 [00:01<00:00, 15.67it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.10]
Epoch 73: 100%|██████████| 27/27 [00:01<00:00, 15.88it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.10]
Epoch 73: 100%|██████████| 27/27 [00:01<00:00, 15.87it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.10]
Epoch 73: 100%|██████████| 27/27 [00:01<00:00, 15.85it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.00]
Epoch 73:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.00]         
Epoch 74:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.00]
Epoch 74:   4%|▎         | 1/27 [00:00<00:09,  2.82it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.00]
Epoch 74:   4%|▎         | 1/27 [00:00<00:09,  2.81it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:   7%|▋         | 2/27 [00:00<00:05,  4.91it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:   7%|▋         | 2/27 [00:00<00:05,  4.90it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.00]
Epoch 74:  11%|█         | 3/27 [00:00<00:03,  6.54it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.00]
Epoch 74:  11%|█         | 3/27 [00:00<00:03,  6.52it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  15%|█▍        | 4/27 [00:00<00:02,  7.70it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  15%|█▍        | 4/27 [00:00<00:02,  7.69it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  19%|█▊        | 5/27 [00:00<00:02,  8.50it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  19%|█▊        | 5/27 [00:00<00:02,  8.49it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  22%|██▏       | 6/27 [00:00<00:02,  9.11it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  22%|██▏       | 6/27 [00:00<00:02,  9.09it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.00]
Epoch 74:  26%|██▌       | 7/27 [00:00<00:02,  9.73it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.00]
Epoch 74:  26%|██▌       | 7/27 [00:00<00:02,  9.72it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.00]
Epoch 74:  30%|██▉       | 8/27 [00:00<00:01, 10.35it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.00]
Epoch 74:  30%|██▉       | 8/27 [00:00<00:01, 10.34it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.00]
Epoch 74:  33%|███▎      | 9/27 [00:00<00:01, 10.91it/s, v_num=0, train_loss_step=62.30, train_loss_epoch=62.00]
Epoch 74:  33%|███▎      | 9/27 [00:00<00:01, 10.90it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  37%|███▋      | 10/27 [00:00<00:01, 11.38it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  37%|███▋      | 10/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=62.00]
Epoch 74:  41%|████      | 11/27 [00:00<00:01, 11.80it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=62.00]
Epoch 74:  41%|████      | 11/27 [00:00<00:01, 11.79it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.00]
Epoch 74:  44%|████▍     | 12/27 [00:00<00:01, 12.21it/s, v_num=0, train_loss_step=62.20, train_loss_epoch=62.00]
Epoch 74:  44%|████▍     | 12/27 [00:00<00:01, 12.20it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.00]
Epoch 74:  48%|████▊     | 13/27 [00:01<00:01, 12.57it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=62.00]
Epoch 74:  48%|████▊     | 13/27 [00:01<00:01, 12.56it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.00]
Epoch 74:  52%|█████▏    | 14/27 [00:01<00:01, 12.92it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.00]
Epoch 74:  52%|█████▏    | 14/27 [00:01<00:01, 12.91it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.00]
Epoch 74:  56%|█████▌    | 15/27 [00:01<00:00, 13.23it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=62.00]
Epoch 74:  56%|█████▌    | 15/27 [00:01<00:00, 13.22it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.00]
Epoch 74:  59%|█████▉    | 16/27 [00:01<00:00, 13.49it/s, v_num=0, train_loss_step=62.40, train_loss_epoch=62.00]
Epoch 74:  59%|█████▉    | 16/27 [00:01<00:00, 13.48it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.00]
Epoch 74:  63%|██████▎   | 17/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.00]
Epoch 74:  63%|██████▎   | 17/27 [00:01<00:00, 13.69it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.00]
Epoch 74:  67%|██████▋   | 18/27 [00:01<00:00, 13.93it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.00]
Epoch 74:  67%|██████▋   | 18/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  70%|███████   | 19/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  70%|███████   | 19/27 [00:01<00:00, 14.14it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.00]
Epoch 74:  74%|███████▍  | 20/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=62.00]
Epoch 74:  74%|███████▍  | 20/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  78%|███████▊  | 21/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74:  78%|███████▊  | 21/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  81%|████████▏ | 22/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  81%|████████▏ | 22/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  85%|████████▌ | 23/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  85%|████████▌ | 23/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  89%|████████▉ | 24/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  89%|████████▉ | 24/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  93%|█████████▎| 25/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=62.00]
Epoch 74:  93%|█████████▎| 25/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.00]
Epoch 74:  96%|█████████▋| 26/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=62.00]
Epoch 74:  96%|█████████▋| 26/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74: 100%|██████████| 27/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=62.00]
Epoch 74: 100%|██████████| 27/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=62.00]
Epoch 74: 100%|██████████| 27/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 74:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]         
Epoch 75:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:   4%|▎         | 1/27 [00:00<00:09,  2.81it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:   4%|▎         | 1/27 [00:00<00:09,  2.79it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.90]
Epoch 75:   7%|▋         | 2/27 [00:00<00:05,  4.87it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.90]
Epoch 75:   7%|▋         | 2/27 [00:00<00:05,  4.86it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  11%|█         | 3/27 [00:00<00:03,  6.46it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  11%|█         | 3/27 [00:00<00:03,  6.44it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.90]
Epoch 75:  15%|█▍        | 4/27 [00:00<00:03,  7.52it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.90]
Epoch 75:  15%|█▍        | 4/27 [00:00<00:03,  7.51it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:  19%|█▊        | 5/27 [00:00<00:02,  8.37it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:  19%|█▊        | 5/27 [00:00<00:02,  8.35it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.90]
Epoch 75:  22%|██▏       | 6/27 [00:00<00:02,  9.21it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.90]
Epoch 75:  22%|██▏       | 6/27 [00:00<00:02,  9.19it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.90]
Epoch 75:  26%|██▌       | 7/27 [00:00<00:02,  9.85it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.90]
Epoch 75:  26%|██▌       | 7/27 [00:00<00:02,  9.83it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  30%|██▉       | 8/27 [00:00<00:01, 10.39it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  30%|██▉       | 8/27 [00:00<00:01, 10.38it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.90]
Epoch 75:  33%|███▎      | 9/27 [00:00<00:01, 10.99it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.90]
Epoch 75:  33%|███▎      | 9/27 [00:00<00:01, 10.98it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.90]
Epoch 75:  37%|███▋      | 10/27 [00:00<00:01, 11.45it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.90]
Epoch 75:  37%|███▋      | 10/27 [00:00<00:01, 11.44it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.90]
Epoch 75:  41%|████      | 11/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.90]
Epoch 75:  41%|████      | 11/27 [00:00<00:01, 11.90it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  44%|████▍     | 12/27 [00:00<00:01, 12.30it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  44%|████▍     | 12/27 [00:00<00:01, 12.29it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.90]
Epoch 75:  48%|████▊     | 13/27 [00:01<00:01, 12.64it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.90]
Epoch 75:  48%|████▊     | 13/27 [00:01<00:01, 12.63it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.90]
Epoch 75:  52%|█████▏    | 14/27 [00:01<00:00, 13.02it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.90]
Epoch 75:  52%|█████▏    | 14/27 [00:01<00:00, 13.01it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:  56%|█████▌    | 15/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:  56%|█████▌    | 15/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:  59%|█████▉    | 16/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:  59%|█████▉    | 16/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.90]
Epoch 75:  63%|██████▎   | 17/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.90]
Epoch 75:  63%|██████▎   | 17/27 [00:01<00:00, 13.85it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.90]
Epoch 75:  67%|██████▋   | 18/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.90]
Epoch 75:  67%|██████▋   | 18/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  70%|███████   | 19/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  70%|███████   | 19/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.90]
Epoch 75:  74%|███████▍  | 20/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.90]
Epoch 75:  74%|███████▍  | 20/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.90]
Epoch 75:  78%|███████▊  | 21/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.90]
Epoch 75:  78%|███████▊  | 21/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.90]
Epoch 75:  81%|████████▏ | 22/27 [00:01<00:00, 14.69it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.90]
Epoch 75:  81%|████████▏ | 22/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:  85%|████████▌ | 23/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75:  85%|████████▌ | 23/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.90]
Epoch 75:  89%|████████▉ | 24/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.90]
Epoch 75:  89%|████████▉ | 24/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  93%|█████████▎| 25/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.90]
Epoch 75:  93%|█████████▎| 25/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.90]
Epoch 75:  96%|█████████▋| 26/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.90]
Epoch 75:  96%|█████████▋| 26/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.90]
Epoch 75: 100%|██████████| 27/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.90]
Epoch 75: 100%|██████████| 27/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.90]
Epoch 75: 100%|██████████| 27/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 75:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]         
Epoch 76:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:   4%|▎         | 1/27 [00:00<00:08,  2.94it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:   4%|▎         | 1/27 [00:00<00:08,  2.91it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.70]
Epoch 76:   7%|▋         | 2/27 [00:00<00:04,  5.08it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.70]
Epoch 76:   7%|▋         | 2/27 [00:00<00:04,  5.06it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  11%|█         | 3/27 [00:00<00:03,  6.65it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  11%|█         | 3/27 [00:00<00:03,  6.64it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.70]
Epoch 76:  15%|█▍        | 4/27 [00:00<00:02,  7.92it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.70]
Epoch 76:  15%|█▍        | 4/27 [00:00<00:02,  7.90it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.70]
Epoch 76:  19%|█▊        | 5/27 [00:00<00:02,  8.78it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.70]
Epoch 76:  19%|█▊        | 5/27 [00:00<00:02,  8.76it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  22%|██▏       | 6/27 [00:00<00:02,  9.62it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  22%|██▏       | 6/27 [00:00<00:02,  9.61it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.70]
Epoch 76:  26%|██▌       | 7/27 [00:00<00:01, 10.23it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.70]
Epoch 76:  26%|██▌       | 7/27 [00:00<00:01, 10.22it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.70]
Epoch 76:  30%|██▉       | 8/27 [00:00<00:01, 10.91it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.70]
Epoch 76:  30%|██▉       | 8/27 [00:00<00:01, 10.89it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  33%|███▎      | 9/27 [00:00<00:01, 11.38it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  33%|███▎      | 9/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.70]
Epoch 76:  37%|███▋      | 10/27 [00:00<00:01, 11.88it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.70]
Epoch 76:  37%|███▋      | 10/27 [00:00<00:01, 11.86it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.70]
Epoch 76:  41%|████      | 11/27 [00:00<00:01, 12.27it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.70]
Epoch 76:  41%|████      | 11/27 [00:00<00:01, 12.26it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  44%|████▍     | 12/27 [00:00<00:01, 12.72it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  44%|████▍     | 12/27 [00:00<00:01, 12.71it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  48%|████▊     | 13/27 [00:00<00:01, 13.12it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  48%|████▊     | 13/27 [00:00<00:01, 13.11it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.70]
Epoch 76:  52%|█████▏    | 14/27 [00:01<00:00, 13.48it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.70]
Epoch 76:  52%|█████▏    | 14/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  56%|█████▌    | 15/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  56%|█████▌    | 15/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  59%|█████▉    | 16/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  59%|█████▉    | 16/27 [00:01<00:00, 14.02it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.70]
Epoch 76:  63%|██████▎   | 17/27 [00:01<00:00, 14.30it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.70]
Epoch 76:  63%|██████▎   | 17/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  67%|██████▋   | 18/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  67%|██████▋   | 18/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  70%|███████   | 19/27 [00:01<00:00, 14.69it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  70%|███████   | 19/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  74%|███████▍  | 20/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  74%|███████▍  | 20/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.70]
Epoch 76:  78%|███████▊  | 21/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.70]
Epoch 76:  78%|███████▊  | 21/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.70]
Epoch 76:  81%|████████▏ | 22/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.70]
Epoch 76:  81%|████████▏ | 22/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.70]
Epoch 76:  85%|████████▌ | 23/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.70]
Epoch 76:  85%|████████▌ | 23/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  89%|████████▉ | 24/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  89%|████████▉ | 24/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  93%|█████████▎| 25/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76:  93%|█████████▎| 25/27 [00:01<00:00, 15.64it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  96%|█████████▋| 26/27 [00:01<00:00, 15.80it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.70]
Epoch 76:  96%|█████████▋| 26/27 [00:01<00:00, 15.79it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.70]
Epoch 76: 100%|██████████| 27/27 [00:01<00:00, 16.01it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.70]
Epoch 76: 100%|██████████| 27/27 [00:01<00:00, 16.01it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.70]
Epoch 76: 100%|██████████| 27/27 [00:01<00:00, 15.99it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 76:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]         
Epoch 77:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:   4%|▎         | 1/27 [00:00<00:09,  2.81it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:   4%|▎         | 1/27 [00:00<00:09,  2.79it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.60]
Epoch 77:   7%|▋         | 2/27 [00:00<00:05,  4.76it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.60]
Epoch 77:   7%|▋         | 2/27 [00:00<00:05,  4.75it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=61.60]
Epoch 77:  11%|█         | 3/27 [00:00<00:03,  6.29it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=61.60]
Epoch 77:  11%|█         | 3/27 [00:00<00:03,  6.28it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  15%|█▍        | 4/27 [00:00<00:03,  7.55it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  15%|█▍        | 4/27 [00:00<00:03,  7.53it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.60]
Epoch 77:  19%|█▊        | 5/27 [00:00<00:02,  8.52it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.60]
Epoch 77:  19%|█▊        | 5/27 [00:00<00:02,  8.51it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.60]
Epoch 77:  22%|██▏       | 6/27 [00:00<00:02,  9.30it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.60]
Epoch 77:  22%|██▏       | 6/27 [00:00<00:02,  9.29it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.60]
Epoch 77:  26%|██▌       | 7/27 [00:00<00:01, 10.05it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.60]
Epoch 77:  26%|██▌       | 7/27 [00:00<00:01, 10.03it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.60]
Epoch 77:  30%|██▉       | 8/27 [00:00<00:01, 10.60it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.60]
Epoch 77:  30%|██▉       | 8/27 [00:00<00:01, 10.59it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.60]
Epoch 77:  33%|███▎      | 9/27 [00:00<00:01, 11.15it/s, v_num=0, train_loss_step=62.00, train_loss_epoch=61.60]
Epoch 77:  33%|███▎      | 9/27 [00:00<00:01, 11.13it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:  37%|███▋      | 10/27 [00:00<00:01, 11.63it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:  37%|███▋      | 10/27 [00:00<00:01, 11.62it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  41%|████      | 11/27 [00:00<00:01, 12.04it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  41%|████      | 11/27 [00:00<00:01, 12.03it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  44%|████▍     | 12/27 [00:00<00:01, 12.49it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  44%|████▍     | 12/27 [00:00<00:01, 12.48it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:  48%|████▊     | 13/27 [00:01<00:01, 12.84it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:  48%|████▊     | 13/27 [00:01<00:01, 12.83it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.60]
Epoch 77:  52%|█████▏    | 14/27 [00:01<00:00, 13.19it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.60]
Epoch 77:  52%|█████▏    | 14/27 [00:01<00:00, 13.18it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  56%|█████▌    | 15/27 [00:01<00:00, 13.50it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  56%|█████▌    | 15/27 [00:01<00:00, 13.49it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:  59%|█████▉    | 16/27 [00:01<00:00, 13.74it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:  59%|█████▉    | 16/27 [00:01<00:00, 13.73it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.60]
Epoch 77:  63%|██████▎   | 17/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.60]
Epoch 77:  63%|██████▎   | 17/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  67%|██████▋   | 18/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  67%|██████▋   | 18/27 [00:01<00:00, 14.15it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  70%|███████   | 19/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  70%|███████   | 19/27 [00:01<00:00, 14.32it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.60]
Epoch 77:  74%|███████▍  | 20/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.60]
Epoch 77:  74%|███████▍  | 20/27 [00:01<00:00, 14.49it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.60]
Epoch 77:  78%|███████▊  | 21/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.60]
Epoch 77:  78%|███████▊  | 21/27 [00:01<00:00, 14.70it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.60]
Epoch 77:  81%|████████▏ | 22/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.60]
Epoch 77:  81%|████████▏ | 22/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.60]
Epoch 77:  85%|████████▌ | 23/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.60]
Epoch 77:  85%|████████▌ | 23/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=61.60]
Epoch 77:  89%|████████▉ | 24/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=62.10, train_loss_epoch=61.60]
Epoch 77:  89%|████████▉ | 24/27 [00:01<00:00, 15.17it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:  93%|█████████▎| 25/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.60]
Epoch 77:  93%|█████████▎| 25/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  96%|█████████▋| 26/27 [00:01<00:00, 15.41it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.60]
Epoch 77:  96%|█████████▋| 26/27 [00:01<00:00, 15.40it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.60]
Epoch 77: 100%|██████████| 27/27 [00:01<00:00, 15.63it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.60]
Epoch 77: 100%|██████████| 27/27 [00:01<00:00, 15.62it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.60]
Epoch 77: 100%|██████████| 27/27 [00:01<00:00, 15.61it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.50]
Epoch 77:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.50]         
Epoch 78:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.50]
Epoch 78:   4%|▎         | 1/27 [00:00<00:08,  3.03it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.50]
Epoch 78:   4%|▎         | 1/27 [00:00<00:08,  3.02it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.50]
Epoch 78:   7%|▋         | 2/27 [00:00<00:04,  5.05it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.50]
Epoch 78:   7%|▋         | 2/27 [00:00<00:04,  5.03it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  11%|█         | 3/27 [00:00<00:03,  6.27it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  11%|█         | 3/27 [00:00<00:03,  6.26it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  15%|█▍        | 4/27 [00:00<00:03,  7.48it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  15%|█▍        | 4/27 [00:00<00:03,  7.46it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.50]
Epoch 78:  19%|█▊        | 5/27 [00:00<00:02,  8.62it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.50]
Epoch 78:  19%|█▊        | 5/27 [00:00<00:02,  8.61it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  22%|██▏       | 6/27 [00:00<00:02,  9.41it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  22%|██▏       | 6/27 [00:00<00:02,  9.39it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.50]
Epoch 78:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.50]
Epoch 78:  26%|██▌       | 7/27 [00:00<00:01, 10.10it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.50]
Epoch 78:  30%|██▉       | 8/27 [00:00<00:01, 10.65it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.50]
Epoch 78:  30%|██▉       | 8/27 [00:00<00:01, 10.64it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  33%|███▎      | 9/27 [00:00<00:01, 11.23it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  33%|███▎      | 9/27 [00:00<00:01, 11.22it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.50]
Epoch 78:  37%|███▋      | 10/27 [00:00<00:01, 11.72it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.50]
Epoch 78:  37%|███▋      | 10/27 [00:00<00:01, 11.71it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  41%|████      | 11/27 [00:00<00:01, 12.17it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  41%|████      | 11/27 [00:00<00:01, 12.16it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  44%|████▍     | 12/27 [00:00<00:01, 12.61it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.50]
Epoch 78:  44%|████▍     | 12/27 [00:00<00:01, 12.60it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  48%|████▊     | 13/27 [00:01<00:01, 12.96it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  48%|████▊     | 13/27 [00:01<00:01, 12.95it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.50]
Epoch 78:  52%|█████▏    | 14/27 [00:01<00:00, 13.33it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.50]
Epoch 78:  52%|█████▏    | 14/27 [00:01<00:00, 13.32it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  56%|█████▌    | 15/27 [00:01<00:00, 13.65it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  56%|█████▌    | 15/27 [00:01<00:00, 13.64it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  59%|█████▉    | 16/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  59%|█████▉    | 16/27 [00:01<00:00, 13.90it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.50]
Epoch 78:  63%|██████▎   | 17/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.50]
Epoch 78:  63%|██████▎   | 17/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.50]
Epoch 78:  67%|██████▋   | 18/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.50]
Epoch 78:  67%|██████▋   | 18/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  70%|███████   | 19/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  70%|███████   | 19/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.50]
Epoch 78:  74%|███████▍  | 20/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.50]
Epoch 78:  74%|███████▍  | 20/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.50]
Epoch 78:  78%|███████▊  | 21/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.50]
Epoch 78:  78%|███████▊  | 21/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.50]
Epoch 78:  81%|████████▏ | 22/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.50]
Epoch 78:  81%|████████▏ | 22/27 [00:01<00:00, 15.17it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  85%|████████▌ | 23/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78:  85%|████████▌ | 23/27 [00:01<00:00, 15.21it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.50]
Epoch 78:  89%|████████▉ | 24/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.50]
Epoch 78:  89%|████████▉ | 24/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.50]
Epoch 78:  93%|█████████▎| 25/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.50]
Epoch 78:  93%|█████████▎| 25/27 [00:01<00:00, 15.51it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.50]
Epoch 78:  96%|█████████▋| 26/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.50]
Epoch 78:  96%|█████████▋| 26/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.50]
Epoch 78: 100%|██████████| 27/27 [00:01<00:00, 15.87it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.50]
Epoch 78: 100%|██████████| 27/27 [00:01<00:00, 15.86it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.50]
Epoch 78: 100%|██████████| 27/27 [00:01<00:00, 15.84it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.40]
Epoch 78:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.40]         
Epoch 79:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.40]
Epoch 79:   4%|▎         | 1/27 [00:00<00:09,  2.84it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.40]
Epoch 79:   4%|▎         | 1/27 [00:00<00:09,  2.82it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.40]
Epoch 79:   7%|▋         | 2/27 [00:00<00:05,  4.94it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.40]
Epoch 79:   7%|▋         | 2/27 [00:00<00:05,  4.93it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.40]
Epoch 79:  11%|█         | 3/27 [00:00<00:03,  6.45it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.40]
Epoch 79:  11%|█         | 3/27 [00:00<00:03,  6.44it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  15%|█▍        | 4/27 [00:00<00:02,  7.77it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  15%|█▍        | 4/27 [00:00<00:02,  7.76it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.40]
Epoch 79:  19%|█▊        | 5/27 [00:00<00:02,  8.67it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.40]
Epoch 79:  19%|█▊        | 5/27 [00:00<00:02,  8.65it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.40]
Epoch 79:  22%|██▏       | 6/27 [00:00<00:02,  9.57it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.40]
Epoch 79:  22%|██▏       | 6/27 [00:00<00:02,  9.56it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.40]
Epoch 79:  26%|██▌       | 7/27 [00:00<00:01, 10.32it/s, v_num=0, train_loss_step=61.70, train_loss_epoch=61.40]
Epoch 79:  26%|██▌       | 7/27 [00:00<00:01, 10.30it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.40]
Epoch 79:  30%|██▉       | 8/27 [00:00<00:01, 10.96it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.40]
Epoch 79:  30%|██▉       | 8/27 [00:00<00:01, 10.94it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.40]
Epoch 79:  33%|███▎      | 9/27 [00:00<00:01, 11.62it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.40]
Epoch 79:  33%|███▎      | 9/27 [00:00<00:01, 11.60it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.40]
Epoch 79:  37%|███▋      | 10/27 [00:00<00:01, 12.03it/s, v_num=0, train_loss_step=61.90, train_loss_epoch=61.40]
Epoch 79:  37%|███▋      | 10/27 [00:00<00:01, 12.02it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.40]
Epoch 79:  41%|████      | 11/27 [00:00<00:01, 12.50it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.40]
Epoch 79:  41%|████      | 11/27 [00:00<00:01, 12.48it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.40]
Epoch 79:  44%|████▍     | 12/27 [00:00<00:01, 12.92it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.40]
Epoch 79:  44%|████▍     | 12/27 [00:00<00:01, 12.90it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  48%|████▊     | 13/27 [00:00<00:01, 13.32it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  48%|████▊     | 13/27 [00:00<00:01, 13.31it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=61.40]
Epoch 79:  52%|█████▏    | 14/27 [00:01<00:00, 13.67it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=61.40]
Epoch 79:  52%|█████▏    | 14/27 [00:01<00:00, 13.65it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.40]
Epoch 79:  56%|█████▌    | 15/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=61.80, train_loss_epoch=61.40]
Epoch 79:  56%|█████▌    | 15/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.40]
Epoch 79:  59%|█████▉    | 16/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.40]
Epoch 79:  59%|█████▉    | 16/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  63%|██████▎   | 17/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  63%|██████▎   | 17/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.40]
Epoch 79:  67%|██████▋   | 18/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.40]
Epoch 79:  67%|██████▋   | 18/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.40]
Epoch 79:  70%|███████   | 19/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.40]
Epoch 79:  70%|███████   | 19/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  74%|███████▍  | 20/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  74%|███████▍  | 20/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.40]
Epoch 79:  78%|███████▊  | 21/27 [00:01<00:00, 15.44it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.40]
Epoch 79:  78%|███████▊  | 21/27 [00:01<00:00, 15.43it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  81%|████████▏ | 22/27 [00:01<00:00, 15.58it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  81%|████████▏ | 22/27 [00:01<00:00, 15.56it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.40]
Epoch 79:  85%|████████▌ | 23/27 [00:01<00:00, 15.73it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.40]
Epoch 79:  85%|████████▌ | 23/27 [00:01<00:00, 15.72it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.40]
Epoch 79:  89%|████████▉ | 24/27 [00:01<00:00, 15.82it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.40]
Epoch 79:  89%|████████▉ | 24/27 [00:01<00:00, 15.81it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  93%|█████████▎| 25/27 [00:01<00:00, 15.96it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.40]
Epoch 79:  93%|█████████▎| 25/27 [00:01<00:00, 15.96it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.40]
Epoch 79:  96%|█████████▋| 26/27 [00:01<00:00, 16.09it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.40]
Epoch 79:  96%|█████████▋| 26/27 [00:01<00:00, 16.08it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.40]
Epoch 79: 100%|██████████| 27/27 [00:01<00:00, 16.31it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.40]
Epoch 79: 100%|██████████| 27/27 [00:01<00:00, 16.30it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.40]
Epoch 79: 100%|██████████| 27/27 [00:01<00:00, 16.29it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.30]
Epoch 79:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.30]         
Epoch 80:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.30]
Epoch 80:   4%|▎         | 1/27 [00:00<00:09,  2.76it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.30]
Epoch 80:   4%|▎         | 1/27 [00:00<00:09,  2.74it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.30]
Epoch 80:   7%|▋         | 2/27 [00:00<00:05,  4.80it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.30]
Epoch 80:   7%|▋         | 2/27 [00:00<00:05,  4.79it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.30]
Epoch 80:  11%|█         | 3/27 [00:00<00:03,  6.44it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.30]
Epoch 80:  11%|█         | 3/27 [00:00<00:03,  6.43it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.30]
Epoch 80:  15%|█▍        | 4/27 [00:00<00:02,  7.76it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.30]
Epoch 80:  15%|█▍        | 4/27 [00:00<00:02,  7.75it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  19%|█▊        | 5/27 [00:00<00:02,  8.83it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  19%|█▊        | 5/27 [00:00<00:02,  8.82it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.30]
Epoch 80:  22%|██▏       | 6/27 [00:00<00:02,  9.57it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.30]
Epoch 80:  22%|██▏       | 6/27 [00:00<00:02,  9.55it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80:  26%|██▌       | 7/27 [00:00<00:01, 10.22it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80:  26%|██▌       | 7/27 [00:00<00:01, 10.20it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.30]
Epoch 80:  30%|██▉       | 8/27 [00:00<00:01, 10.81it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.30]
Epoch 80:  30%|██▉       | 8/27 [00:00<00:01, 10.80it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.30]
Epoch 80:  33%|███▎      | 9/27 [00:00<00:01, 11.37it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.30]
Epoch 80:  33%|███▎      | 9/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.30]
Epoch 80:  37%|███▋      | 10/27 [00:00<00:01, 11.96it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.30]
Epoch 80:  37%|███▋      | 10/27 [00:00<00:01, 11.95it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  41%|████      | 11/27 [00:00<00:01, 12.46it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  41%|████      | 11/27 [00:00<00:01, 12.44it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=61.30]
Epoch 80:  44%|████▍     | 12/27 [00:00<00:01, 12.91it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=61.30]
Epoch 80:  44%|████▍     | 12/27 [00:00<00:01, 12.90it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.30]
Epoch 80:  48%|████▊     | 13/27 [00:00<00:01, 13.29it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.30]
Epoch 80:  48%|████▊     | 13/27 [00:00<00:01, 13.28it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.30]
Epoch 80:  52%|█████▏    | 14/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=61.50, train_loss_epoch=61.30]
Epoch 80:  52%|█████▏    | 14/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.30]
Epoch 80:  56%|█████▌    | 15/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.30]
Epoch 80:  56%|█████▌    | 15/27 [00:01<00:00, 13.93it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.30]
Epoch 80:  59%|█████▉    | 16/27 [00:01<00:00, 14.12it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.30]
Epoch 80:  59%|█████▉    | 16/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.30]
Epoch 80:  63%|██████▎   | 17/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.30]
Epoch 80:  63%|██████▎   | 17/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.30]
Epoch 80:  67%|██████▋   | 18/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.30]
Epoch 80:  67%|██████▋   | 18/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80:  70%|███████   | 19/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80:  70%|███████   | 19/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.30]
Epoch 80:  74%|███████▍  | 20/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.30]
Epoch 80:  74%|███████▍  | 20/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  78%|███████▊  | 21/27 [00:01<00:00, 15.18it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  78%|███████▊  | 21/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  81%|████████▏ | 22/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  81%|████████▏ | 22/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  85%|████████▌ | 23/27 [00:01<00:00, 15.62it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.30]
Epoch 80:  85%|████████▌ | 23/27 [00:01<00:00, 15.61it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80:  89%|████████▉ | 24/27 [00:01<00:00, 15.79it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80:  89%|████████▉ | 24/27 [00:01<00:00, 15.78it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.30]
Epoch 80:  93%|█████████▎| 25/27 [00:01<00:00, 15.93it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.30]
Epoch 80:  93%|█████████▎| 25/27 [00:01<00:00, 15.92it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80:  96%|█████████▋| 26/27 [00:01<00:00, 16.03it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80:  96%|█████████▋| 26/27 [00:01<00:00, 16.02it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80: 100%|██████████| 27/27 [00:01<00:00, 16.29it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.30]
Epoch 80: 100%|██████████| 27/27 [00:01<00:00, 16.28it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.30]
Epoch 80: 100%|██████████| 27/27 [00:01<00:00, 16.26it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.10]
Epoch 80:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.10]         
Epoch 81:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.10]
Epoch 81:   4%|▎         | 1/27 [00:00<00:09,  2.85it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.10]
Epoch 81:   4%|▎         | 1/27 [00:00<00:09,  2.83it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.10]
Epoch 81:   7%|▋         | 2/27 [00:00<00:05,  4.93it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.10]
Epoch 81:   7%|▋         | 2/27 [00:00<00:05,  4.92it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.10]
Epoch 81:  11%|█         | 3/27 [00:00<00:03,  6.53it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.10]
Epoch 81:  11%|█         | 3/27 [00:00<00:03,  6.51it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.10]
Epoch 81:  15%|█▍        | 4/27 [00:00<00:02,  7.83it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.10]
Epoch 81:  15%|█▍        | 4/27 [00:00<00:02,  7.82it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  19%|█▊        | 5/27 [00:00<00:02,  8.55it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  19%|█▊        | 5/27 [00:00<00:02,  8.54it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  22%|██▏       | 6/27 [00:00<00:02,  9.33it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  22%|██▏       | 6/27 [00:00<00:02,  9.32it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.10]
Epoch 81:  26%|██▌       | 7/27 [00:00<00:01, 10.01it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.10]
Epoch 81:  26%|██▌       | 7/27 [00:00<00:02,  9.99it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.10]
Epoch 81:  30%|██▉       | 8/27 [00:00<00:01, 10.65it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.10]
Epoch 81:  30%|██▉       | 8/27 [00:00<00:01, 10.64it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.10]
Epoch 81:  33%|███▎      | 9/27 [00:00<00:01, 11.23it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.10]
Epoch 81:  33%|███▎      | 9/27 [00:00<00:01, 11.21it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.10]
Epoch 81:  37%|███▋      | 10/27 [00:00<00:01, 11.72it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.10]
Epoch 81:  37%|███▋      | 10/27 [00:00<00:01, 11.71it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.10]
Epoch 81:  41%|████      | 11/27 [00:00<00:01, 12.19it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.10]
Epoch 81:  41%|████      | 11/27 [00:00<00:01, 12.18it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.10]
Epoch 81:  44%|████▍     | 12/27 [00:00<00:01, 12.63it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.10]
Epoch 81:  44%|████▍     | 12/27 [00:00<00:01, 12.62it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.10]
Epoch 81:  48%|████▊     | 13/27 [00:00<00:01, 13.02it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.10]
Epoch 81:  48%|████▊     | 13/27 [00:00<00:01, 13.01it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.10]
Epoch 81:  52%|█████▏    | 14/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.10]
Epoch 81:  52%|█████▏    | 14/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  56%|█████▌    | 15/27 [00:01<00:00, 13.63it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  56%|█████▌    | 15/27 [00:01<00:00, 13.62it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.10]
Epoch 81:  59%|█████▉    | 16/27 [00:01<00:00, 13.93it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.10]
Epoch 81:  59%|█████▉    | 16/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=61.10]
Epoch 81:  63%|██████▎   | 17/27 [00:01<00:00, 14.19it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=61.10]
Epoch 81:  63%|██████▎   | 17/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  67%|██████▋   | 18/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  67%|██████▋   | 18/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.10]
Epoch 81:  70%|███████   | 19/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.10]
Epoch 81:  70%|███████   | 19/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.10]
Epoch 81:  74%|███████▍  | 20/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.10]
Epoch 81:  74%|███████▍  | 20/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.10]
Epoch 81:  78%|███████▊  | 21/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=61.60, train_loss_epoch=61.10]
Epoch 81:  78%|███████▊  | 21/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.10]
Epoch 81:  81%|████████▏ | 22/27 [00:01<00:00, 15.17it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=61.10]
Epoch 81:  81%|████████▏ | 22/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.10]
Epoch 81:  85%|████████▌ | 23/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=61.40, train_loss_epoch=61.10]
Epoch 81:  85%|████████▌ | 23/27 [00:01<00:00, 15.32it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.10]
Epoch 81:  89%|████████▉ | 24/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.10]
Epoch 81:  89%|████████▉ | 24/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  93%|█████████▎| 25/27 [00:01<00:00, 15.58it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.10]
Epoch 81:  93%|█████████▎| 25/27 [00:01<00:00, 15.57it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.10]
Epoch 81:  96%|█████████▋| 26/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.10]
Epoch 81:  96%|█████████▋| 26/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.10]
Epoch 81: 100%|██████████| 27/27 [00:01<00:00, 15.86it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.10]
Epoch 81: 100%|██████████| 27/27 [00:01<00:00, 15.85it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.10]
Epoch 81: 100%|██████████| 27/27 [00:01<00:00, 15.84it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.00]
Epoch 81:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.00]         
Epoch 82:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.00]
Epoch 82:   4%|▎         | 1/27 [00:00<00:08,  3.03it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.00]
Epoch 82:   4%|▎         | 1/27 [00:00<00:08,  3.01it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:   7%|▋         | 2/27 [00:00<00:04,  5.30it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:   7%|▋         | 2/27 [00:00<00:04,  5.29it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.00]
Epoch 82:  11%|█         | 3/27 [00:00<00:03,  6.93it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.00]
Epoch 82:  11%|█         | 3/27 [00:00<00:03,  6.91it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.00]
Epoch 82:  15%|█▍        | 4/27 [00:00<00:02,  8.24it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=61.00]
Epoch 82:  15%|█▍        | 4/27 [00:00<00:02,  8.22it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.00]
Epoch 82:  19%|█▊        | 5/27 [00:00<00:02,  9.41it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.00]
Epoch 82:  19%|█▊        | 5/27 [00:00<00:02,  9.40it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  22%|██▏       | 6/27 [00:00<00:02, 10.17it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  22%|██▏       | 6/27 [00:00<00:02, 10.15it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82:  26%|██▌       | 7/27 [00:00<00:01, 10.85it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82:  26%|██▌       | 7/27 [00:00<00:01, 10.83it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  30%|██▉       | 8/27 [00:00<00:01, 11.57it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  30%|██▉       | 8/27 [00:00<00:01, 11.55it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82:  33%|███▎      | 9/27 [00:00<00:01, 12.28it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82:  33%|███▎      | 9/27 [00:00<00:01, 12.26it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.00]
Epoch 82:  37%|███▋      | 10/27 [00:00<00:01, 12.93it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.00]
Epoch 82:  37%|███▋      | 10/27 [00:00<00:01, 12.90it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  41%|████      | 11/27 [00:00<00:01, 13.32it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  41%|████      | 11/27 [00:00<00:01, 13.31it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  44%|████▍     | 12/27 [00:00<00:01, 13.69it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  44%|████▍     | 12/27 [00:00<00:01, 13.67it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  48%|████▊     | 13/27 [00:00<00:01, 13.96it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  48%|████▊     | 13/27 [00:00<00:01, 13.94it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  52%|█████▏    | 14/27 [00:00<00:00, 14.32it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  52%|█████▏    | 14/27 [00:00<00:00, 14.31it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.00]
Epoch 82:  56%|█████▌    | 15/27 [00:01<00:00, 14.53it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=61.00]
Epoch 82:  56%|█████▌    | 15/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82:  59%|█████▉    | 16/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82:  59%|█████▉    | 16/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  63%|██████▎   | 17/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  63%|██████▎   | 17/27 [00:01<00:00, 15.09it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  67%|██████▋   | 18/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  67%|██████▋   | 18/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  70%|███████   | 19/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  70%|███████   | 19/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.00]
Epoch 82:  74%|███████▍  | 20/27 [00:01<00:00, 15.59it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.00]
Epoch 82:  74%|███████▍  | 20/27 [00:01<00:00, 15.58it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  78%|███████▊  | 21/27 [00:01<00:00, 15.76it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=61.00]
Epoch 82:  78%|███████▊  | 21/27 [00:01<00:00, 15.75it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  81%|████████▏ | 22/27 [00:01<00:00, 15.89it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  81%|████████▏ | 22/27 [00:01<00:00, 15.88it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  85%|████████▌ | 23/27 [00:01<00:00, 16.02it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=61.00]
Epoch 82:  85%|████████▌ | 23/27 [00:01<00:00, 16.02it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82:  89%|████████▉ | 24/27 [00:01<00:00, 16.11it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82:  89%|████████▉ | 24/27 [00:01<00:00, 16.10it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.00]
Epoch 82:  93%|█████████▎| 25/27 [00:01<00:00, 16.24it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=61.00]
Epoch 82:  93%|█████████▎| 25/27 [00:01<00:00, 16.24it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.00]
Epoch 82:  96%|█████████▋| 26/27 [00:01<00:00, 16.42it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.00]
Epoch 82:  96%|█████████▋| 26/27 [00:01<00:00, 16.41it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82: 100%|██████████| 27/27 [00:01<00:00, 16.65it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=61.00]
Epoch 82: 100%|██████████| 27/27 [00:01<00:00, 16.64it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=61.00]
Epoch 82: 100%|██████████| 27/27 [00:01<00:00, 16.60it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=60.90]
Epoch 82:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=60.90]         
Epoch 83:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=60.90]
Epoch 83:   4%|▎         | 1/27 [00:00<00:08,  2.94it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=60.90]
Epoch 83:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.90]
Epoch 83:   7%|▋         | 2/27 [00:00<00:05,  4.93it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.90]
Epoch 83:   7%|▋         | 2/27 [00:00<00:05,  4.92it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  11%|█         | 3/27 [00:00<00:03,  6.45it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  11%|█         | 3/27 [00:00<00:03,  6.44it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.90]
Epoch 83:  15%|█▍        | 4/27 [00:00<00:02,  7.71it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.90]
Epoch 83:  15%|█▍        | 4/27 [00:00<00:02,  7.70it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=60.90]
Epoch 83:  19%|█▊        | 5/27 [00:00<00:02,  8.82it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=60.90]
Epoch 83:  19%|█▊        | 5/27 [00:00<00:02,  8.80it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  22%|██▏       | 6/27 [00:00<00:02,  9.50it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  22%|██▏       | 6/27 [00:00<00:02,  9.49it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.90]
Epoch 83:  26%|██▌       | 7/27 [00:00<00:01, 10.29it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.90]
Epoch 83:  26%|██▌       | 7/27 [00:00<00:01, 10.28it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  30%|██▉       | 8/27 [00:00<00:01, 10.94it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  30%|██▉       | 8/27 [00:00<00:01, 10.92it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.90]
Epoch 83:  33%|███▎      | 9/27 [00:00<00:01, 11.57it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.90]
Epoch 83:  33%|███▎      | 9/27 [00:00<00:01, 11.56it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=60.90]
Epoch 83:  37%|███▋      | 10/27 [00:00<00:01, 12.08it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=60.90]
Epoch 83:  37%|███▋      | 10/27 [00:00<00:01, 12.07it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.90]
Epoch 83:  41%|████      | 11/27 [00:00<00:01, 12.52it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.90]
Epoch 83:  41%|████      | 11/27 [00:00<00:01, 12.50it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.90]
Epoch 83:  44%|████▍     | 12/27 [00:00<00:01, 12.99it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.90]
Epoch 83:  44%|████▍     | 12/27 [00:00<00:01, 12.98it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.90]
Epoch 83:  48%|████▊     | 13/27 [00:00<00:01, 13.40it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.90]
Epoch 83:  48%|████▊     | 13/27 [00:00<00:01, 13.39it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.90]
Epoch 83:  52%|█████▏    | 14/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.90]
Epoch 83:  52%|█████▏    | 14/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.90]
Epoch 83:  56%|█████▌    | 15/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.90]
Epoch 83:  56%|█████▌    | 15/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.90]
Epoch 83:  59%|█████▉    | 16/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.90]
Epoch 83:  59%|█████▉    | 16/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.90]
Epoch 83:  63%|██████▎   | 17/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.90]
Epoch 83:  63%|██████▎   | 17/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.90]
Epoch 83:  67%|██████▋   | 18/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.90]
Epoch 83:  67%|██████▋   | 18/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=60.90]
Epoch 83:  70%|███████   | 19/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=60.90]
Epoch 83:  70%|███████   | 19/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.90]
Epoch 83:  74%|███████▍  | 20/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.90]
Epoch 83:  74%|███████▍  | 20/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  78%|███████▊  | 21/27 [00:01<00:00, 15.57it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  78%|███████▊  | 21/27 [00:01<00:00, 15.56it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.90]
Epoch 83:  81%|████████▏ | 22/27 [00:01<00:00, 15.66it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.90]
Epoch 83:  81%|████████▏ | 22/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=60.90]
Epoch 83:  85%|████████▌ | 23/27 [00:01<00:00, 15.78it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=60.90]
Epoch 83:  85%|████████▌ | 23/27 [00:01<00:00, 15.77it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.90]
Epoch 83:  89%|████████▉ | 24/27 [00:01<00:00, 15.87it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.90]
Epoch 83:  89%|████████▉ | 24/27 [00:01<00:00, 15.86it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  93%|█████████▎| 25/27 [00:01<00:00, 15.98it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.90]
Epoch 83:  93%|█████████▎| 25/27 [00:01<00:00, 15.97it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.90]
Epoch 83:  96%|█████████▋| 26/27 [00:01<00:00, 16.06it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.90]
Epoch 83:  96%|█████████▋| 26/27 [00:01<00:00, 16.05it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.90]
Epoch 83: 100%|██████████| 27/27 [00:01<00:00, 16.26it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.90]
Epoch 83: 100%|██████████| 27/27 [00:01<00:00, 16.26it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.90]
Epoch 83: 100%|██████████| 27/27 [00:01<00:00, 16.24it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.80]
Epoch 83:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.80]         
Epoch 84:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.80]
Epoch 84:   4%|▎         | 1/27 [00:00<00:09,  2.79it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.80]
Epoch 84:   4%|▎         | 1/27 [00:00<00:09,  2.77it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:   7%|▋         | 2/27 [00:00<00:05,  4.69it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:   7%|▋         | 2/27 [00:00<00:05,  4.68it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  11%|█         | 3/27 [00:00<00:03,  6.12it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  11%|█         | 3/27 [00:00<00:03,  6.11it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.80]
Epoch 84:  15%|█▍        | 4/27 [00:00<00:03,  7.36it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.80]
Epoch 84:  15%|█▍        | 4/27 [00:00<00:03,  7.35it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  19%|█▊        | 5/27 [00:00<00:02,  8.41it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  19%|█▊        | 5/27 [00:00<00:02,  8.39it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  22%|██▏       | 6/27 [00:00<00:02,  9.06it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  22%|██▏       | 6/27 [00:00<00:02,  9.05it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.80]
Epoch 84:  26%|██▌       | 7/27 [00:00<00:02,  9.58it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.80]
Epoch 84:  26%|██▌       | 7/27 [00:00<00:02,  9.56it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.80]
Epoch 84:  30%|██▉       | 8/27 [00:00<00:01, 10.26it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.80]
Epoch 84:  30%|██▉       | 8/27 [00:00<00:01, 10.25it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.80]
Epoch 84:  33%|███▎      | 9/27 [00:00<00:01, 10.79it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.80]
Epoch 84:  33%|███▎      | 9/27 [00:00<00:01, 10.78it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.80]
Epoch 84:  37%|███▋      | 10/27 [00:00<00:01, 11.21it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.80]
Epoch 84:  37%|███▋      | 10/27 [00:00<00:01, 11.20it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.80]
Epoch 84:  41%|████      | 11/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.80]
Epoch 84:  41%|████      | 11/27 [00:00<00:01, 11.48it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.80]
Epoch 84:  44%|████▍     | 12/27 [00:01<00:01, 11.94it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.80]
Epoch 84:  44%|████▍     | 12/27 [00:01<00:01, 11.93it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.80]
Epoch 84:  48%|████▊     | 13/27 [00:01<00:01, 12.32it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.80]
Epoch 84:  48%|████▊     | 13/27 [00:01<00:01, 12.31it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  52%|█████▏    | 14/27 [00:01<00:01, 12.71it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  52%|█████▏    | 14/27 [00:01<00:01, 12.70it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.80]
Epoch 84:  56%|█████▌    | 15/27 [00:01<00:00, 13.03it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.80]
Epoch 84:  56%|█████▌    | 15/27 [00:01<00:00, 13.01it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.80]
Epoch 84:  59%|█████▉    | 16/27 [00:01<00:00, 13.37it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.80]
Epoch 84:  59%|█████▉    | 16/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.80]
Epoch 84:  63%|██████▎   | 17/27 [00:01<00:00, 13.65it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.80]
Epoch 84:  63%|██████▎   | 17/27 [00:01<00:00, 13.64it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.80]
Epoch 84:  67%|██████▋   | 18/27 [00:01<00:00, 13.73it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.80]
Epoch 84:  67%|██████▋   | 18/27 [00:01<00:00, 13.72it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.80]
Epoch 84:  70%|███████   | 19/27 [00:01<00:00, 13.84it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.80]
Epoch 84:  70%|███████   | 19/27 [00:01<00:00, 13.83it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.80]
Epoch 84:  74%|███████▍  | 20/27 [00:01<00:00, 13.92it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.80]
Epoch 84:  74%|███████▍  | 20/27 [00:01<00:00, 13.91it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.80]
Epoch 84:  78%|███████▊  | 21/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.80]
Epoch 84:  78%|███████▊  | 21/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  81%|████████▏ | 22/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84:  81%|████████▏ | 22/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.80]
Epoch 84:  85%|████████▌ | 23/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.80]
Epoch 84:  85%|████████▌ | 23/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.80]
Epoch 84:  89%|████████▉ | 24/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.80]
Epoch 84:  89%|████████▉ | 24/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.80]
Epoch 84:  93%|█████████▎| 25/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.80]
Epoch 84:  93%|█████████▎| 25/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=60.80]
Epoch 84:  96%|█████████▋| 26/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=60.80]
Epoch 84:  96%|█████████▋| 26/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=60.80]
Epoch 84: 100%|██████████| 27/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=60.80]
Epoch 84: 100%|██████████| 27/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.80]
Epoch 84: 100%|██████████| 27/27 [00:01<00:00, 14.96it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.70]
Epoch 84:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.70]         
Epoch 85:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.70]
Epoch 85:   4%|▎         | 1/27 [00:00<00:08,  3.00it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.70]
Epoch 85:   4%|▎         | 1/27 [00:00<00:08,  2.98it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.70]
Epoch 85:   7%|▋         | 2/27 [00:00<00:04,  5.11it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.70]
Epoch 85:   7%|▋         | 2/27 [00:00<00:04,  5.10it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.70]
Epoch 85:  11%|█         | 3/27 [00:00<00:03,  6.54it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.70]
Epoch 85:  11%|█         | 3/27 [00:00<00:03,  6.53it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.70]
Epoch 85:  15%|█▍        | 4/27 [00:00<00:02,  7.81it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.70]
Epoch 85:  15%|█▍        | 4/27 [00:00<00:02,  7.79it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.70]
Epoch 85:  19%|█▊        | 5/27 [00:00<00:02,  8.66it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.70]
Epoch 85:  19%|█▊        | 5/27 [00:00<00:02,  8.64it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85:  22%|██▏       | 6/27 [00:00<00:02,  9.33it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85:  22%|██▏       | 6/27 [00:00<00:02,  9.32it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85:  26%|██▌       | 7/27 [00:00<00:02, 10.00it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85:  26%|██▌       | 7/27 [00:00<00:02,  9.99it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=60.70]
Epoch 85:  30%|██▉       | 8/27 [00:00<00:01, 10.63it/s, v_num=0, train_loss_step=61.30, train_loss_epoch=60.70]
Epoch 85:  30%|██▉       | 8/27 [00:00<00:01, 10.62it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.70]
Epoch 85:  33%|███▎      | 9/27 [00:00<00:01, 11.07it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.70]
Epoch 85:  33%|███▎      | 9/27 [00:00<00:01, 11.06it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.70]
Epoch 85:  37%|███▋      | 10/27 [00:00<00:01, 11.39it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.70]
Epoch 85:  37%|███▋      | 10/27 [00:00<00:01, 11.38it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.70]
Epoch 85:  41%|████      | 11/27 [00:00<00:01, 11.80it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.70]
Epoch 85:  41%|████      | 11/27 [00:00<00:01, 11.79it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.70]
Epoch 85:  44%|████▍     | 12/27 [00:00<00:01, 12.10it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.70]
Epoch 85:  44%|████▍     | 12/27 [00:00<00:01, 12.09it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.70]
Epoch 85:  48%|████▊     | 13/27 [00:01<00:01, 12.45it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.70]
Epoch 85:  48%|████▊     | 13/27 [00:01<00:01, 12.44it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.70]
Epoch 85:  52%|█████▏    | 14/27 [00:01<00:01, 12.78it/s, v_num=0, train_loss_step=61.10, train_loss_epoch=60.70]
Epoch 85:  52%|█████▏    | 14/27 [00:01<00:01, 12.77it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=60.70]
Epoch 85:  56%|█████▌    | 15/27 [00:01<00:00, 13.06it/s, v_num=0, train_loss_step=61.20, train_loss_epoch=60.70]
Epoch 85:  56%|█████▌    | 15/27 [00:01<00:00, 13.05it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=60.70]
Epoch 85:  59%|█████▉    | 16/27 [00:01<00:00, 13.33it/s, v_num=0, train_loss_step=61.00, train_loss_epoch=60.70]
Epoch 85:  59%|█████▉    | 16/27 [00:01<00:00, 13.32it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.70]
Epoch 85:  63%|██████▎   | 17/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.70]
Epoch 85:  63%|██████▎   | 17/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85:  67%|██████▋   | 18/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85:  67%|██████▋   | 18/27 [00:01<00:00, 13.79it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.70]
Epoch 85:  70%|███████   | 19/27 [00:01<00:00, 14.00it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.70]
Epoch 85:  70%|███████   | 19/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.70]
Epoch 85:  74%|███████▍  | 20/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.70]
Epoch 85:  74%|███████▍  | 20/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.70]
Epoch 85:  78%|███████▊  | 21/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.70]
Epoch 85:  78%|███████▊  | 21/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.70]
Epoch 85:  81%|████████▏ | 22/27 [00:01<00:00, 14.50it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.70]
Epoch 85:  81%|████████▏ | 22/27 [00:01<00:00, 14.49it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85:  85%|████████▌ | 23/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85:  85%|████████▌ | 23/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.70]
Epoch 85:  89%|████████▉ | 24/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.70]
Epoch 85:  89%|████████▉ | 24/27 [00:01<00:00, 14.76it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.70]
Epoch 85:  93%|█████████▎| 25/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.70]
Epoch 85:  93%|█████████▎| 25/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.70]
Epoch 85:  96%|█████████▋| 26/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.70]
Epoch 85:  96%|█████████▋| 26/27 [00:01<00:00, 15.05it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85: 100%|██████████| 27/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.70]
Epoch 85: 100%|██████████| 27/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.70]
Epoch 85: 100%|██████████| 27/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.60]
Epoch 85:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.60]         
Epoch 86:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.60]
Epoch 86:   4%|▎         | 1/27 [00:00<00:08,  2.95it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.60]
Epoch 86:   4%|▎         | 1/27 [00:00<00:08,  2.93it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:   7%|▋         | 2/27 [00:00<00:05,  4.95it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:   7%|▋         | 2/27 [00:00<00:05,  4.94it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  11%|█         | 3/27 [00:00<00:03,  6.50it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  11%|█         | 3/27 [00:00<00:03,  6.49it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  15%|█▍        | 4/27 [00:00<00:03,  7.64it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  15%|█▍        | 4/27 [00:00<00:03,  7.63it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.60]
Epoch 86:  19%|█▊        | 5/27 [00:00<00:02,  8.70it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.60]
Epoch 86:  19%|█▊        | 5/27 [00:00<00:02,  8.69it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.60]
Epoch 86:  22%|██▏       | 6/27 [00:00<00:02,  9.33it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.60]
Epoch 86:  22%|██▏       | 6/27 [00:00<00:02,  9.31it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  26%|██▌       | 7/27 [00:00<00:02,  9.91it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  26%|██▌       | 7/27 [00:00<00:02,  9.89it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.60]
Epoch 86:  30%|██▉       | 8/27 [00:00<00:01, 10.55it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.60]
Epoch 86:  30%|██▉       | 8/27 [00:00<00:01, 10.54it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  33%|███▎      | 9/27 [00:00<00:01, 11.13it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  33%|███▎      | 9/27 [00:00<00:01, 11.12it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  37%|███▋      | 10/27 [00:00<00:01, 11.63it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  37%|███▋      | 10/27 [00:00<00:01, 11.61it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  41%|████      | 11/27 [00:00<00:01, 12.16it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  41%|████      | 11/27 [00:00<00:01, 12.14it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  44%|████▍     | 12/27 [00:00<00:01, 12.55it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  44%|████▍     | 12/27 [00:00<00:01, 12.54it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  48%|████▊     | 13/27 [00:01<00:01, 12.90it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  48%|████▊     | 13/27 [00:01<00:01, 12.89it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  52%|█████▏    | 14/27 [00:01<00:00, 13.19it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  52%|█████▏    | 14/27 [00:01<00:00, 13.18it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.60]
Epoch 86:  56%|█████▌    | 15/27 [00:01<00:00, 13.47it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.60]
Epoch 86:  56%|█████▌    | 15/27 [00:01<00:00, 13.46it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.60]
Epoch 86:  59%|█████▉    | 16/27 [00:01<00:00, 13.76it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.60]
Epoch 86:  59%|█████▉    | 16/27 [00:01<00:00, 13.75it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.60]
Epoch 86:  63%|██████▎   | 17/27 [00:01<00:00, 13.89it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.60]
Epoch 86:  63%|██████▎   | 17/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  67%|██████▋   | 18/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  67%|██████▋   | 18/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.60]
Epoch 86:  70%|███████   | 19/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.60]
Epoch 86:  70%|███████   | 19/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.60]
Epoch 86:  74%|███████▍  | 20/27 [00:01<00:00, 14.44it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.60]
Epoch 86:  74%|███████▍  | 20/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.60]
Epoch 86:  78%|███████▊  | 21/27 [00:01<00:00, 14.59it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.60]
Epoch 86:  78%|███████▊  | 21/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  81%|████████▏ | 22/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  81%|████████▏ | 22/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  85%|████████▌ | 23/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.60]
Epoch 86:  85%|████████▌ | 23/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  89%|████████▉ | 24/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  89%|████████▉ | 24/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  93%|█████████▎| 25/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.60]
Epoch 86:  93%|█████████▎| 25/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  96%|█████████▋| 26/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.60]
Epoch 86:  96%|█████████▋| 26/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.60]
Epoch 86: 100%|██████████| 27/27 [00:01<00:00, 15.49it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.60]
Epoch 86: 100%|██████████| 27/27 [00:01<00:00, 15.48it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.60]
Epoch 86: 100%|██████████| 27/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.50]
Epoch 86:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.50]         
Epoch 87:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.50]
Epoch 87:   4%|▎         | 1/27 [00:00<00:08,  3.02it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.50]
Epoch 87:   4%|▎         | 1/27 [00:00<00:08,  3.00it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.50]
Epoch 87:   7%|▋         | 2/27 [00:00<00:04,  5.10it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.50]
Epoch 87:   7%|▋         | 2/27 [00:00<00:04,  5.09it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.50]
Epoch 87:  11%|█         | 3/27 [00:00<00:03,  6.62it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.50]
Epoch 87:  11%|█         | 3/27 [00:00<00:03,  6.61it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.50]
Epoch 87:  15%|█▍        | 4/27 [00:00<00:02,  7.89it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.50]
Epoch 87:  15%|█▍        | 4/27 [00:00<00:02,  7.88it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.50]
Epoch 87:  19%|█▊        | 5/27 [00:00<00:02,  8.70it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.50]
Epoch 87:  19%|█▊        | 5/27 [00:00<00:02,  8.68it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.50]
Epoch 87:  22%|██▏       | 6/27 [00:00<00:02,  9.18it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.50]
Epoch 87:  22%|██▏       | 6/27 [00:00<00:02,  9.16it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.50]
Epoch 87:  26%|██▌       | 7/27 [00:00<00:02,  9.94it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.50]
Epoch 87:  26%|██▌       | 7/27 [00:00<00:02,  9.93it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.50]
Epoch 87:  30%|██▉       | 8/27 [00:00<00:01, 10.45it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.50]
Epoch 87:  30%|██▉       | 8/27 [00:00<00:01, 10.44it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.50]
Epoch 87:  33%|███▎      | 9/27 [00:00<00:01, 10.94it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.50]
Epoch 87:  33%|███▎      | 9/27 [00:00<00:01, 10.92it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.50]
Epoch 87:  37%|███▋      | 10/27 [00:00<00:01, 11.40it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.50]
Epoch 87:  37%|███▋      | 10/27 [00:00<00:01, 11.39it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.50]
Epoch 87:  41%|████      | 11/27 [00:00<00:01, 11.80it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.50]
Epoch 87:  41%|████      | 11/27 [00:00<00:01, 11.79it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.50]
Epoch 87:  44%|████▍     | 12/27 [00:00<00:01, 12.25it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.50]
Epoch 87:  44%|████▍     | 12/27 [00:00<00:01, 12.24it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.50]
Epoch 87:  48%|████▊     | 13/27 [00:01<00:01, 12.66it/s, v_num=0, train_loss_step=60.90, train_loss_epoch=60.50]
Epoch 87:  48%|████▊     | 13/27 [00:01<00:01, 12.64it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.50]
Epoch 87:  52%|█████▏    | 14/27 [00:01<00:01, 12.81it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.50]
Epoch 87:  52%|█████▏    | 14/27 [00:01<00:01, 12.79it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.50]
Epoch 87:  56%|█████▌    | 15/27 [00:01<00:00, 12.99it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.50]
Epoch 87:  56%|█████▌    | 15/27 [00:01<00:00, 12.98it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.50]
Epoch 87:  59%|█████▉    | 16/27 [00:01<00:00, 13.14it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.50]
Epoch 87:  59%|█████▉    | 16/27 [00:01<00:00, 13.13it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.50]
Epoch 87:  63%|██████▎   | 17/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.50]
Epoch 87:  63%|██████▎   | 17/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.50]
Epoch 87:  67%|██████▋   | 18/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.50]
Epoch 87:  67%|██████▋   | 18/27 [00:01<00:00, 13.35it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.50]
Epoch 87:  70%|███████   | 19/27 [00:01<00:00, 13.52it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.50]
Epoch 87:  70%|███████   | 19/27 [00:01<00:00, 13.51it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.50]
Epoch 87:  74%|███████▍  | 20/27 [00:01<00:00, 13.72it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.50]
Epoch 87:  74%|███████▍  | 20/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.50]
Epoch 87:  78%|███████▊  | 21/27 [00:01<00:00, 13.89it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.50]
Epoch 87:  78%|███████▊  | 21/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.50]
Epoch 87:  81%|████████▏ | 22/27 [00:01<00:00, 13.99it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.50]
Epoch 87:  81%|████████▏ | 22/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.50]
Epoch 87:  85%|████████▌ | 23/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.50]
Epoch 87:  85%|████████▌ | 23/27 [00:01<00:00, 14.10it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.50]
Epoch 87:  89%|████████▉ | 24/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.50]
Epoch 87:  89%|████████▉ | 24/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.50]
Epoch 87:  93%|█████████▎| 25/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.50]
Epoch 87:  93%|█████████▎| 25/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.50]
Epoch 87:  96%|█████████▋| 26/27 [00:01<00:00, 14.53it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.50]
Epoch 87:  96%|█████████▋| 26/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.50]
Epoch 87: 100%|██████████| 27/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.50]
Epoch 87: 100%|██████████| 27/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.50]
Epoch 87: 100%|██████████| 27/27 [00:01<00:00, 14.73it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.40]
Epoch 87:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.40]         
Epoch 88:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.40]
Epoch 88:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.40]
Epoch 88:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:   7%|▋         | 2/27 [00:00<00:05,  4.87it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:   7%|▋         | 2/27 [00:00<00:05,  4.86it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.40]
Epoch 88:  11%|█         | 3/27 [00:00<00:03,  6.31it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.40]
Epoch 88:  11%|█         | 3/27 [00:00<00:03,  6.30it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  15%|█▍        | 4/27 [00:00<00:03,  7.37it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  15%|█▍        | 4/27 [00:00<00:03,  7.36it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  19%|█▊        | 5/27 [00:00<00:02,  8.37it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  19%|█▊        | 5/27 [00:00<00:02,  8.35it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88:  22%|██▏       | 6/27 [00:00<00:02,  9.20it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88:  22%|██▏       | 6/27 [00:00<00:02,  9.19it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  26%|██▌       | 7/27 [00:00<00:02,  9.67it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  26%|██▌       | 7/27 [00:00<00:02,  9.65it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.40]
Epoch 88:  30%|██▉       | 8/27 [00:00<00:01, 10.19it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.40]
Epoch 88:  30%|██▉       | 8/27 [00:00<00:01, 10.18it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.40]
Epoch 88:  33%|███▎      | 9/27 [00:00<00:01, 10.77it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.40]
Epoch 88:  33%|███▎      | 9/27 [00:00<00:01, 10.76it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.40]
Epoch 88:  37%|███▋      | 10/27 [00:00<00:01, 11.30it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.40]
Epoch 88:  37%|███▋      | 10/27 [00:00<00:01, 11.29it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88:  41%|████      | 11/27 [00:00<00:01, 11.71it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88:  41%|████      | 11/27 [00:00<00:01, 11.70it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  44%|████▍     | 12/27 [00:00<00:01, 12.13it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  44%|████▍     | 12/27 [00:00<00:01, 12.12it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  48%|████▊     | 13/27 [00:01<00:01, 12.49it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  48%|████▊     | 13/27 [00:01<00:01, 12.48it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  52%|█████▏    | 14/27 [00:01<00:01, 12.80it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  52%|█████▏    | 14/27 [00:01<00:01, 12.79it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.40]
Epoch 88:  56%|█████▌    | 15/27 [00:01<00:00, 13.11it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.40]
Epoch 88:  56%|█████▌    | 15/27 [00:01<00:00, 13.10it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.40]
Epoch 88:  59%|█████▉    | 16/27 [00:01<00:00, 13.37it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.40]
Epoch 88:  59%|█████▉    | 16/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  63%|██████▎   | 17/27 [00:01<00:00, 13.63it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  63%|██████▎   | 17/27 [00:01<00:00, 13.62it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.40]
Epoch 88:  67%|██████▋   | 18/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.40]
Epoch 88:  67%|██████▋   | 18/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.40]
Epoch 88:  70%|███████   | 19/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.40]
Epoch 88:  70%|███████   | 19/27 [00:01<00:00, 14.02it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  74%|███████▍  | 20/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  74%|███████▍  | 20/27 [00:01<00:00, 14.21it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.40]
Epoch 88:  78%|███████▊  | 21/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.40]
Epoch 88:  78%|███████▊  | 21/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  81%|████████▏ | 22/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.40]
Epoch 88:  81%|████████▏ | 22/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88:  85%|████████▌ | 23/27 [00:01<00:00, 14.68it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88:  85%|████████▌ | 23/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88:  89%|████████▉ | 24/27 [00:01<00:00, 14.82it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88:  89%|████████▉ | 24/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.40]
Epoch 88:  93%|█████████▎| 25/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.40]
Epoch 88:  93%|█████████▎| 25/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  96%|█████████▋| 26/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.40]
Epoch 88:  96%|█████████▋| 26/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.40]
Epoch 88: 100%|██████████| 27/27 [00:01<00:00, 14.94it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.40]
Epoch 88: 100%|██████████| 27/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.40]
Epoch 88: 100%|██████████| 27/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.30]
Epoch 88:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.30]         
Epoch 89:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.30]
Epoch 89:   4%|▎         | 1/27 [00:00<00:09,  2.73it/s, v_num=0, train_loss_step=60.40, train_loss_epoch=60.30]
Epoch 89:   4%|▎         | 1/27 [00:00<00:09,  2.71it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:   7%|▋         | 2/27 [00:00<00:05,  4.72it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:   7%|▋         | 2/27 [00:00<00:05,  4.71it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  11%|█         | 3/27 [00:00<00:03,  6.10it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  11%|█         | 3/27 [00:00<00:03,  6.09it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.30]
Epoch 89:  15%|█▍        | 4/27 [00:00<00:03,  7.27it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.30]
Epoch 89:  15%|█▍        | 4/27 [00:00<00:03,  7.25it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.30]
Epoch 89:  19%|█▊        | 5/27 [00:00<00:02,  8.27it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.30]
Epoch 89:  19%|█▊        | 5/27 [00:00<00:02,  8.25it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.30]
Epoch 89:  22%|██▏       | 6/27 [00:00<00:02,  9.17it/s, v_num=0, train_loss_step=60.80, train_loss_epoch=60.30]
Epoch 89:  22%|██▏       | 6/27 [00:00<00:02,  9.16it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  26%|██▌       | 7/27 [00:00<00:02,  9.59it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  26%|██▌       | 7/27 [00:00<00:02,  9.57it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.30]
Epoch 89:  30%|██▉       | 8/27 [00:00<00:01, 10.21it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.30]
Epoch 89:  30%|██▉       | 8/27 [00:00<00:01, 10.20it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  33%|███▎      | 9/27 [00:00<00:01, 10.83it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  33%|███▎      | 9/27 [00:00<00:01, 10.82it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.30]
Epoch 89:  37%|███▋      | 10/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.30]
Epoch 89:  37%|███▋      | 10/27 [00:00<00:01, 11.35it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.30]
Epoch 89:  41%|████      | 11/27 [00:00<00:01, 11.82it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.30]
Epoch 89:  41%|████      | 11/27 [00:00<00:01, 11.81it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  44%|████▍     | 12/27 [00:00<00:01, 12.19it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  44%|████▍     | 12/27 [00:00<00:01, 12.18it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  48%|████▊     | 13/27 [00:01<00:01, 12.49it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  48%|████▊     | 13/27 [00:01<00:01, 12.48it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.30]
Epoch 89:  52%|█████▏    | 14/27 [00:01<00:01, 12.79it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.30]
Epoch 89:  52%|█████▏    | 14/27 [00:01<00:01, 12.78it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.30]
Epoch 89:  56%|█████▌    | 15/27 [00:01<00:00, 13.08it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.30]
Epoch 89:  56%|█████▌    | 15/27 [00:01<00:00, 13.07it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  59%|█████▉    | 16/27 [00:01<00:00, 13.38it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  59%|█████▉    | 16/27 [00:01<00:00, 13.37it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  63%|██████▎   | 17/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  63%|██████▎   | 17/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  67%|██████▋   | 18/27 [00:01<00:00, 13.82it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.30]
Epoch 89:  67%|██████▋   | 18/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  70%|███████   | 19/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  70%|███████   | 19/27 [00:01<00:00, 13.97it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.30]
Epoch 89:  74%|███████▍  | 20/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.30]
Epoch 89:  74%|███████▍  | 20/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.30]
Epoch 89:  78%|███████▊  | 21/27 [00:01<00:00, 14.33it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.30]
Epoch 89:  78%|███████▊  | 21/27 [00:01<00:00, 14.32it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.30]
Epoch 89:  81%|████████▏ | 22/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.30]
Epoch 89:  81%|████████▏ | 22/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.30]
Epoch 89:  85%|████████▌ | 23/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.30]
Epoch 89:  85%|████████▌ | 23/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  89%|████████▉ | 24/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89:  89%|████████▉ | 24/27 [00:01<00:00, 14.78it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.30]
Epoch 89:  93%|█████████▎| 25/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.30]
Epoch 89:  93%|█████████▎| 25/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.30]
Epoch 89:  96%|█████████▋| 26/27 [00:01<00:00, 14.83it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.30]
Epoch 89:  96%|█████████▋| 26/27 [00:01<00:00, 14.82it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.30]
Epoch 89: 100%|██████████| 27/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.30]
Epoch 89: 100%|██████████| 27/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.30]
Epoch 89: 100%|██████████| 27/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 89:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]         
Epoch 90:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:   4%|▎         | 1/27 [00:00<00:09,  2.72it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:   4%|▎         | 1/27 [00:00<00:09,  2.70it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:   7%|▋         | 2/27 [00:00<00:05,  4.71it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:   7%|▋         | 2/27 [00:00<00:05,  4.70it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.20]
Epoch 90:  11%|█         | 3/27 [00:00<00:03,  6.23it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.20]
Epoch 90:  11%|█         | 3/27 [00:00<00:03,  6.22it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:  15%|█▍        | 4/27 [00:00<00:03,  7.29it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:  15%|█▍        | 4/27 [00:00<00:03,  7.28it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:  19%|█▊        | 5/27 [00:00<00:02,  8.29it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:  19%|█▊        | 5/27 [00:00<00:02,  8.28it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  22%|██▏       | 6/27 [00:00<00:02,  9.09it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  22%|██▏       | 6/27 [00:00<00:02,  9.08it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  26%|██▌       | 7/27 [00:00<00:02,  9.84it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  26%|██▌       | 7/27 [00:00<00:02,  9.83it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.20]
Epoch 90:  30%|██▉       | 8/27 [00:00<00:01, 10.21it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.20]
Epoch 90:  30%|██▉       | 8/27 [00:00<00:01, 10.19it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.20]
Epoch 90:  33%|███▎      | 9/27 [00:00<00:01, 10.67it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.20]
Epoch 90:  33%|███▎      | 9/27 [00:00<00:01, 10.66it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.20]
Epoch 90:  37%|███▋      | 10/27 [00:00<00:01, 11.05it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.20]
Epoch 90:  37%|███▋      | 10/27 [00:00<00:01, 11.04it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  41%|████      | 11/27 [00:00<00:01, 11.44it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  41%|████      | 11/27 [00:00<00:01, 11.43it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:  44%|████▍     | 12/27 [00:01<00:01, 11.87it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:  44%|████▍     | 12/27 [00:01<00:01, 11.85it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:  48%|████▊     | 13/27 [00:01<00:01, 12.22it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:  48%|████▊     | 13/27 [00:01<00:01, 12.21it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.20]
Epoch 90:  52%|█████▏    | 14/27 [00:01<00:01, 12.57it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.20]
Epoch 90:  52%|█████▏    | 14/27 [00:01<00:01, 12.56it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:  56%|█████▌    | 15/27 [00:01<00:00, 12.88it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:  56%|█████▌    | 15/27 [00:01<00:00, 12.87it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:  59%|█████▉    | 16/27 [00:01<00:00, 13.11it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:  59%|█████▉    | 16/27 [00:01<00:00, 13.10it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  63%|██████▎   | 17/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  63%|██████▎   | 17/27 [00:01<00:00, 13.35it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:  67%|██████▋   | 18/27 [00:01<00:00, 13.50it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.20]
Epoch 90:  67%|██████▋   | 18/27 [00:01<00:00, 13.49it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.20]
Epoch 90:  70%|███████   | 19/27 [00:01<00:00, 13.68it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.20]
Epoch 90:  70%|███████   | 19/27 [00:01<00:00, 13.67it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  74%|███████▍  | 20/27 [00:01<00:00, 13.81it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  74%|███████▍  | 20/27 [00:01<00:00, 13.80it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=60.20]
Epoch 90:  78%|███████▊  | 21/27 [00:01<00:00, 14.01it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=60.20]
Epoch 90:  78%|███████▊  | 21/27 [00:01<00:00, 14.00it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.20]
Epoch 90:  81%|████████▏ | 22/27 [00:01<00:00, 14.18it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.20]
Epoch 90:  81%|████████▏ | 22/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:  85%|████████▌ | 23/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.20]
Epoch 90:  85%|████████▌ | 23/27 [00:01<00:00, 14.25it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  89%|████████▉ | 24/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.20]
Epoch 90:  89%|████████▉ | 24/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.20]
Epoch 90:  93%|█████████▎| 25/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.20]
Epoch 90:  93%|█████████▎| 25/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.20]
Epoch 90:  96%|█████████▋| 26/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.20]
Epoch 90:  96%|█████████▋| 26/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=60.20]
Epoch 90: 100%|██████████| 27/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=60.20]
Epoch 90: 100%|██████████| 27/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.20]
Epoch 90: 100%|██████████| 27/27 [00:01<00:00, 14.84it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.10]
Epoch 90:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.10]         
Epoch 91:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.10]
Epoch 91:   4%|▎         | 1/27 [00:00<00:09,  2.72it/s, v_num=0, train_loss_step=60.70, train_loss_epoch=60.10]
Epoch 91:   4%|▎         | 1/27 [00:00<00:09,  2.71it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:   7%|▋         | 2/27 [00:00<00:05,  4.65it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:   7%|▋         | 2/27 [00:00<00:05,  4.64it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:  11%|█         | 3/27 [00:00<00:03,  6.04it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:  11%|█         | 3/27 [00:00<00:03,  6.03it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=60.10]
Epoch 91:  15%|█▍        | 4/27 [00:00<00:03,  7.09it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=60.10]
Epoch 91:  15%|█▍        | 4/27 [00:00<00:03,  7.08it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:  19%|█▊        | 5/27 [00:00<00:02,  8.11it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:  19%|█▊        | 5/27 [00:00<00:02,  8.10it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91:  22%|██▏       | 6/27 [00:00<00:02,  8.84it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91:  22%|██▏       | 6/27 [00:00<00:02,  8.83it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.10]
Epoch 91:  26%|██▌       | 7/27 [00:00<00:02,  9.52it/s, v_num=0, train_loss_step=60.60, train_loss_epoch=60.10]
Epoch 91:  26%|██▌       | 7/27 [00:00<00:02,  9.51it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.10]
Epoch 91:  30%|██▉       | 8/27 [00:00<00:01, 10.03it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.10]
Epoch 91:  30%|██▉       | 8/27 [00:00<00:01, 10.00it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.10]
Epoch 91:  33%|███▎      | 9/27 [00:00<00:01, 10.57it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.10]
Epoch 91:  33%|███▎      | 9/27 [00:00<00:01, 10.56it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:  37%|███▋      | 10/27 [00:00<00:01, 11.08it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:  37%|███▋      | 10/27 [00:00<00:01, 11.06it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91:  41%|████      | 11/27 [00:00<00:01, 11.51it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91:  41%|████      | 11/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.10]
Epoch 91:  44%|████▍     | 12/27 [00:01<00:01, 11.93it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.10]
Epoch 91:  44%|████▍     | 12/27 [00:01<00:01, 11.91it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.10]
Epoch 91:  48%|████▊     | 13/27 [00:01<00:01, 12.31it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.10]
Epoch 91:  48%|████▊     | 13/27 [00:01<00:01, 12.29it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=60.10]
Epoch 91:  52%|█████▏    | 14/27 [00:01<00:01, 12.66it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=60.10]
Epoch 91:  52%|█████▏    | 14/27 [00:01<00:01, 12.65it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.10]
Epoch 91:  56%|█████▌    | 15/27 [00:01<00:00, 13.01it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=60.10]
Epoch 91:  56%|█████▌    | 15/27 [00:01<00:00, 13.00it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.10]
Epoch 91:  59%|█████▉    | 16/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.10]
Epoch 91:  59%|█████▉    | 16/27 [00:01<00:00, 13.28it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=60.10]
Epoch 91:  63%|██████▎   | 17/27 [00:01<00:00, 13.57it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=60.10]
Epoch 91:  63%|██████▎   | 17/27 [00:01<00:00, 13.56it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.10]
Epoch 91:  67%|██████▋   | 18/27 [00:01<00:00, 13.78it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.10]
Epoch 91:  67%|██████▋   | 18/27 [00:01<00:00, 13.76it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91:  70%|███████   | 19/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91:  70%|███████   | 19/27 [00:01<00:00, 14.03it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.10]
Epoch 91:  74%|███████▍  | 20/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.10]
Epoch 91:  74%|███████▍  | 20/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=60.10]
Epoch 91:  78%|███████▊  | 21/27 [00:01<00:00, 14.38it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=60.10]
Epoch 91:  78%|███████▊  | 21/27 [00:01<00:00, 14.37it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.10]
Epoch 91:  81%|████████▏ | 22/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.10]
Epoch 91:  81%|████████▏ | 22/27 [00:01<00:00, 14.54it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91:  85%|████████▌ | 23/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91:  85%|████████▌ | 23/27 [00:01<00:00, 14.60it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.10]
Epoch 91:  89%|████████▉ | 24/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.10]
Epoch 91:  89%|████████▉ | 24/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.10]
Epoch 91:  93%|█████████▎| 25/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.10]
Epoch 91:  93%|█████████▎| 25/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:  96%|█████████▋| 26/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.10]
Epoch 91:  96%|█████████▋| 26/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.10]
Epoch 91: 100%|██████████| 27/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.10]
Epoch 91: 100%|██████████| 27/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.10]
Epoch 91: 100%|██████████| 27/27 [00:01<00:00, 15.15it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 91:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]         
Epoch 92:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92:   4%|▎         | 1/27 [00:00<00:09,  2.89it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92:   4%|▎         | 1/27 [00:00<00:09,  2.87it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:   7%|▋         | 2/27 [00:00<00:05,  4.85it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:   7%|▋         | 2/27 [00:00<00:05,  4.84it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  11%|█         | 3/27 [00:00<00:03,  6.46it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  11%|█         | 3/27 [00:00<00:03,  6.44it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.00]
Epoch 92:  15%|█▍        | 4/27 [00:00<00:03,  7.43it/s, v_num=0, train_loss_step=60.50, train_loss_epoch=60.00]
Epoch 92:  15%|█▍        | 4/27 [00:00<00:03,  7.41it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92:  19%|█▊        | 5/27 [00:00<00:02,  8.49it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92:  19%|█▊        | 5/27 [00:00<00:02,  8.48it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  22%|██▏       | 6/27 [00:00<00:02,  9.07it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  22%|██▏       | 6/27 [00:00<00:02,  9.06it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=60.00]
Epoch 92:  26%|██▌       | 7/27 [00:00<00:02,  9.71it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=60.00]
Epoch 92:  26%|██▌       | 7/27 [00:00<00:02,  9.69it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.00]
Epoch 92:  30%|██▉       | 8/27 [00:00<00:01, 10.15it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.00]
Epoch 92:  30%|██▉       | 8/27 [00:00<00:01, 10.14it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92:  33%|███▎      | 9/27 [00:00<00:01, 10.65it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92:  33%|███▎      | 9/27 [00:00<00:01, 10.64it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.00]
Epoch 92:  37%|███▋      | 10/27 [00:00<00:01, 11.16it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.00]
Epoch 92:  37%|███▋      | 10/27 [00:00<00:01, 11.15it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92:  41%|████      | 11/27 [00:00<00:01, 11.50it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92:  41%|████      | 11/27 [00:00<00:01, 11.49it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  44%|████▍     | 12/27 [00:01<00:01, 11.96it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  44%|████▍     | 12/27 [00:01<00:01, 11.95it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  48%|████▊     | 13/27 [00:01<00:01, 12.34it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  48%|████▊     | 13/27 [00:01<00:01, 12.33it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.00]
Epoch 92:  52%|█████▏    | 14/27 [00:01<00:01, 12.68it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.00]
Epoch 92:  52%|█████▏    | 14/27 [00:01<00:01, 12.66it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  56%|█████▌    | 15/27 [00:01<00:00, 12.98it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  56%|█████▌    | 15/27 [00:01<00:00, 12.97it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.00]
Epoch 92:  59%|█████▉    | 16/27 [00:01<00:00, 13.29it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.00]
Epoch 92:  59%|█████▉    | 16/27 [00:01<00:00, 13.28it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:  63%|██████▎   | 17/27 [00:01<00:00, 13.62it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:  63%|██████▎   | 17/27 [00:01<00:00, 13.61it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:  67%|██████▋   | 18/27 [00:01<00:00, 13.89it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:  67%|██████▋   | 18/27 [00:01<00:00, 13.88it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  70%|███████   | 19/27 [00:01<00:00, 14.10it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  70%|███████   | 19/27 [00:01<00:00, 14.09it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:  74%|███████▍  | 20/27 [00:01<00:00, 14.30it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:  74%|███████▍  | 20/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  78%|███████▊  | 21/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  78%|███████▊  | 21/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  81%|████████▏ | 22/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=60.00]
Epoch 92:  81%|████████▏ | 22/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:  85%|████████▌ | 23/27 [00:01<00:00, 14.81it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=60.00]
Epoch 92:  85%|████████▌ | 23/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.00]
Epoch 92:  89%|████████▉ | 24/27 [00:01<00:00, 14.98it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=60.00]
Epoch 92:  89%|████████▉ | 24/27 [00:01<00:00, 14.97it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.00]
Epoch 92:  93%|█████████▎| 25/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=60.00]
Epoch 92:  93%|█████████▎| 25/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.00]
Epoch 92:  96%|█████████▋| 26/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.00]
Epoch 92:  96%|█████████▋| 26/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.00]
Epoch 92: 100%|██████████| 27/27 [00:01<00:00, 15.48it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=60.00]
Epoch 92: 100%|██████████| 27/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=60.00]
Epoch 92: 100%|██████████| 27/27 [00:01<00:00, 15.45it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.90]
Epoch 92:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.90]         
Epoch 93:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.90]
Epoch 93:   4%|▎         | 1/27 [00:00<00:09,  2.88it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.90]
Epoch 93:   4%|▎         | 1/27 [00:00<00:09,  2.86it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=59.90]
Epoch 93:   7%|▋         | 2/27 [00:00<00:05,  4.85it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=59.90]
Epoch 93:   7%|▋         | 2/27 [00:00<00:05,  4.84it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.90]
Epoch 93:  11%|█         | 3/27 [00:00<00:03,  6.31it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.90]
Epoch 93:  11%|█         | 3/27 [00:00<00:03,  6.30it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.90]
Epoch 93:  15%|█▍        | 4/27 [00:00<00:03,  7.65it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.90]
Epoch 93:  15%|█▍        | 4/27 [00:00<00:03,  7.63it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93:  19%|█▊        | 5/27 [00:00<00:02,  8.82it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93:  19%|█▊        | 5/27 [00:00<00:02,  8.80it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.90]
Epoch 93:  22%|██▏       | 6/27 [00:00<00:02,  9.73it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.90]
Epoch 93:  22%|██▏       | 6/27 [00:00<00:02,  9.71it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=59.90]
Epoch 93:  26%|██▌       | 7/27 [00:00<00:01, 10.48it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=59.90]
Epoch 93:  26%|██▌       | 7/27 [00:00<00:01, 10.47it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.90]
Epoch 93:  30%|██▉       | 8/27 [00:00<00:01, 11.03it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.90]
Epoch 93:  30%|██▉       | 8/27 [00:00<00:01, 11.02it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  33%|███▎      | 9/27 [00:00<00:01, 11.64it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  33%|███▎      | 9/27 [00:00<00:01, 11.62it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.90]
Epoch 93:  37%|███▋      | 10/27 [00:00<00:01, 12.20it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.90]
Epoch 93:  37%|███▋      | 10/27 [00:00<00:01, 12.19it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.90]
Epoch 93:  41%|████      | 11/27 [00:00<00:01, 12.79it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.90]
Epoch 93:  41%|████      | 11/27 [00:00<00:01, 12.78it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93:  44%|████▍     | 12/27 [00:00<00:01, 13.33it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93:  44%|████▍     | 12/27 [00:00<00:01, 13.32it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.90]
Epoch 93:  48%|████▊     | 13/27 [00:00<00:01, 13.84it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.90]
Epoch 93:  48%|████▊     | 13/27 [00:00<00:01, 13.81it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.90]
Epoch 93:  52%|█████▏    | 14/27 [00:00<00:00, 14.21it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.90]
Epoch 93:  52%|█████▏    | 14/27 [00:00<00:00, 14.19it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  56%|█████▌    | 15/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  56%|█████▌    | 15/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  59%|█████▉    | 16/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  59%|█████▉    | 16/27 [00:01<00:00, 14.89it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.90]
Epoch 93:  63%|██████▎   | 17/27 [00:01<00:00, 15.04it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.90]
Epoch 93:  63%|██████▎   | 17/27 [00:01<00:00, 15.03it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.90]
Epoch 93:  67%|██████▋   | 18/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.90]
Epoch 93:  67%|██████▋   | 18/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.90]
Epoch 93:  70%|███████   | 19/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.90]
Epoch 93:  70%|███████   | 19/27 [00:01<00:00, 15.31it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93:  74%|███████▍  | 20/27 [00:01<00:00, 15.55it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93:  74%|███████▍  | 20/27 [00:01<00:00, 15.54it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.90]
Epoch 93:  78%|███████▊  | 21/27 [00:01<00:00, 15.78it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.90]
Epoch 93:  78%|███████▊  | 21/27 [00:01<00:00, 15.77it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  81%|████████▏ | 22/27 [00:01<00:00, 15.97it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  81%|████████▏ | 22/27 [00:01<00:00, 15.96it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.90]
Epoch 93:  85%|████████▌ | 23/27 [00:01<00:00, 16.15it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.90]
Epoch 93:  85%|████████▌ | 23/27 [00:01<00:00, 16.14it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93:  89%|████████▉ | 24/27 [00:01<00:00, 16.27it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93:  89%|████████▉ | 24/27 [00:01<00:00, 16.25it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=59.90]
Epoch 93:  93%|█████████▎| 25/27 [00:01<00:00, 16.33it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=59.90]
Epoch 93:  93%|█████████▎| 25/27 [00:01<00:00, 16.32it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  96%|█████████▋| 26/27 [00:01<00:00, 16.48it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.90]
Epoch 93:  96%|█████████▋| 26/27 [00:01<00:00, 16.47it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.90]
Epoch 93: 100%|██████████| 27/27 [00:01<00:00, 16.71it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.90]
Epoch 93: 100%|██████████| 27/27 [00:01<00:00, 16.70it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.90]
Epoch 93: 100%|██████████| 27/27 [00:01<00:00, 16.69it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.80]
Epoch 93:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.80]         
Epoch 94:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.80]
Epoch 94:   4%|▎         | 1/27 [00:00<00:09,  2.86it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.80]
Epoch 94:   4%|▎         | 1/27 [00:00<00:09,  2.84it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=59.80]
Epoch 94:   7%|▋         | 2/27 [00:00<00:05,  4.86it/s, v_num=0, train_loss_step=60.20, train_loss_epoch=59.80]
Epoch 94:   7%|▋         | 2/27 [00:00<00:05,  4.85it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94:  11%|█         | 3/27 [00:00<00:03,  6.24it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94:  11%|█         | 3/27 [00:00<00:03,  6.23it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.80]
Epoch 94:  15%|█▍        | 4/27 [00:00<00:03,  7.34it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.80]
Epoch 94:  15%|█▍        | 4/27 [00:00<00:03,  7.33it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94:  19%|█▊        | 5/27 [00:00<00:02,  8.35it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94:  19%|█▊        | 5/27 [00:00<00:02,  8.33it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94:  22%|██▏       | 6/27 [00:00<00:02,  9.10it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94:  22%|██▏       | 6/27 [00:00<00:02,  9.09it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.80]
Epoch 94:  26%|██▌       | 7/27 [00:00<00:02,  9.81it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.80]
Epoch 94:  26%|██▌       | 7/27 [00:00<00:02,  9.79it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.80]
Epoch 94:  30%|██▉       | 8/27 [00:00<00:01, 10.40it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.80]
Epoch 94:  30%|██▉       | 8/27 [00:00<00:01, 10.39it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94:  33%|███▎      | 9/27 [00:00<00:01, 10.94it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94:  33%|███▎      | 9/27 [00:00<00:01, 10.93it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.80]
Epoch 94:  37%|███▋      | 10/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.80]
Epoch 94:  37%|███▋      | 10/27 [00:00<00:01, 11.35it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=59.80]
Epoch 94:  41%|████      | 11/27 [00:00<00:01, 11.76it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=59.80]
Epoch 94:  41%|████      | 11/27 [00:00<00:01, 11.75it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.80]
Epoch 94:  44%|████▍     | 12/27 [00:01<00:01, 11.99it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.80]
Epoch 94:  44%|████▍     | 12/27 [00:01<00:01, 11.98it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94:  48%|████▊     | 13/27 [00:01<00:01, 12.34it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94:  48%|████▊     | 13/27 [00:01<00:01, 12.33it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.80]
Epoch 94:  52%|█████▏    | 14/27 [00:01<00:01, 12.65it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.80]
Epoch 94:  52%|█████▏    | 14/27 [00:01<00:01, 12.64it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94:  56%|█████▌    | 15/27 [00:01<00:00, 12.94it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94:  56%|█████▌    | 15/27 [00:01<00:00, 12.93it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.80]
Epoch 94:  59%|█████▉    | 16/27 [00:01<00:00, 13.17it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.80]
Epoch 94:  59%|█████▉    | 16/27 [00:01<00:00, 13.16it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94:  63%|██████▎   | 17/27 [00:01<00:00, 13.44it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94:  63%|██████▎   | 17/27 [00:01<00:00, 13.43it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94:  67%|██████▋   | 18/27 [00:01<00:00, 13.69it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94:  67%|██████▋   | 18/27 [00:01<00:00, 13.68it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.80]
Epoch 94:  70%|███████   | 19/27 [00:01<00:00, 13.94it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.80]
Epoch 94:  70%|███████   | 19/27 [00:01<00:00, 13.93it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.80]
Epoch 94:  74%|███████▍  | 20/27 [00:01<00:00, 14.12it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.80]
Epoch 94:  74%|███████▍  | 20/27 [00:01<00:00, 14.11it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.80]
Epoch 94:  78%|███████▊  | 21/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.80]
Epoch 94:  78%|███████▊  | 21/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.80]
Epoch 94:  81%|████████▏ | 22/27 [00:01<00:00, 14.36it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.80]
Epoch 94:  81%|████████▏ | 22/27 [00:01<00:00, 14.35it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.80]
Epoch 94:  85%|████████▌ | 23/27 [00:01<00:00, 14.52it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.80]
Epoch 94:  85%|████████▌ | 23/27 [00:01<00:00, 14.51it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.80]
Epoch 94:  89%|████████▉ | 24/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.80]
Epoch 94:  89%|████████▉ | 24/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.80]
Epoch 94:  93%|█████████▎| 25/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.80]
Epoch 94:  93%|█████████▎| 25/27 [00:01<00:00, 14.77it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.80]
Epoch 94:  96%|█████████▋| 26/27 [00:01<00:00, 14.91it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.80]
Epoch 94:  96%|█████████▋| 26/27 [00:01<00:00, 14.90it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94: 100%|██████████| 27/27 [00:01<00:00, 15.12it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.80]
Epoch 94: 100%|██████████| 27/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.80]
Epoch 94: 100%|██████████| 27/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 94:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]         
Epoch 95:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:   4%|▎         | 1/27 [00:00<00:09,  2.82it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:   4%|▎         | 1/27 [00:00<00:09,  2.80it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:   7%|▋         | 2/27 [00:00<00:05,  4.87it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:   7%|▋         | 2/27 [00:00<00:05,  4.85it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.70]
Epoch 95:  11%|█         | 3/27 [00:00<00:03,  6.40it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.70]
Epoch 95:  11%|█         | 3/27 [00:00<00:03,  6.38it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.70]
Epoch 95:  15%|█▍        | 4/27 [00:00<00:03,  7.64it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.70]
Epoch 95:  15%|█▍        | 4/27 [00:00<00:03,  7.63it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.70]
Epoch 95:  19%|█▊        | 5/27 [00:00<00:02,  8.71it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.70]
Epoch 95:  19%|█▊        | 5/27 [00:00<00:02,  8.70it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.70]
Epoch 95:  22%|██▏       | 6/27 [00:00<00:02,  9.53it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.70]
Epoch 95:  22%|██▏       | 6/27 [00:00<00:02,  9.52it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.70]
Epoch 95:  26%|██▌       | 7/27 [00:00<00:01, 10.12it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.70]
Epoch 95:  26%|██▌       | 7/27 [00:00<00:01, 10.11it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.70]
Epoch 95:  30%|██▉       | 8/27 [00:00<00:01, 10.63it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.70]
Epoch 95:  30%|██▉       | 8/27 [00:00<00:01, 10.62it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=59.70]
Epoch 95:  33%|███▎      | 9/27 [00:00<00:01, 11.05it/s, v_num=0, train_loss_step=60.30, train_loss_epoch=59.70]
Epoch 95:  33%|███▎      | 9/27 [00:00<00:01, 11.04it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  37%|███▋      | 10/27 [00:00<00:01, 11.52it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  37%|███▋      | 10/27 [00:00<00:01, 11.51it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.70]
Epoch 95:  41%|████      | 11/27 [00:00<00:01, 11.96it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.70]
Epoch 95:  41%|████      | 11/27 [00:00<00:01, 11.95it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.70]
Epoch 95:  44%|████▍     | 12/27 [00:00<00:01, 12.38it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.70]
Epoch 95:  44%|████▍     | 12/27 [00:00<00:01, 12.37it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:  48%|████▊     | 13/27 [00:01<00:01, 12.74it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:  48%|████▊     | 13/27 [00:01<00:01, 12.72it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.70]
Epoch 95:  52%|█████▏    | 14/27 [00:01<00:00, 13.07it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.70]
Epoch 95:  52%|█████▏    | 14/27 [00:01<00:00, 13.06it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.70]
Epoch 95:  56%|█████▌    | 15/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.70]
Epoch 95:  56%|█████▌    | 15/27 [00:01<00:00, 13.35it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  59%|█████▉    | 16/27 [00:01<00:00, 13.65it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  59%|█████▉    | 16/27 [00:01<00:00, 13.64it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.70]
Epoch 95:  63%|██████▎   | 17/27 [00:01<00:00, 13.87it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.70]
Epoch 95:  63%|██████▎   | 17/27 [00:01<00:00, 13.85it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:  67%|██████▋   | 18/27 [00:01<00:00, 14.07it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:  67%|██████▋   | 18/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:  70%|███████   | 19/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:  70%|███████   | 19/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  74%|███████▍  | 20/27 [00:01<00:00, 14.41it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  74%|███████▍  | 20/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  78%|███████▊  | 21/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  78%|███████▊  | 21/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  81%|████████▏ | 22/27 [00:01<00:00, 14.72it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.70]
Epoch 95:  81%|████████▏ | 22/27 [00:01<00:00, 14.71it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.70]
Epoch 95:  85%|████████▌ | 23/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.70]
Epoch 95:  85%|████████▌ | 23/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.70]
Epoch 95:  89%|████████▉ | 24/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.70]
Epoch 95:  89%|████████▉ | 24/27 [00:01<00:00, 14.99it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:  93%|█████████▎| 25/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.70]
Epoch 95:  93%|█████████▎| 25/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.70]
Epoch 95:  96%|█████████▋| 26/27 [00:01<00:00, 15.20it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.70]
Epoch 95:  96%|█████████▋| 26/27 [00:01<00:00, 15.19it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.70]
Epoch 95: 100%|██████████| 27/27 [00:01<00:00, 15.39it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.70]
Epoch 95: 100%|██████████| 27/27 [00:01<00:00, 15.38it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.70]
Epoch 95: 100%|██████████| 27/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 95:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]         
Epoch 96:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:   4%|▎         | 1/27 [00:00<00:08,  2.94it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:   4%|▎         | 1/27 [00:00<00:08,  2.91it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:   7%|▋         | 2/27 [00:00<00:05,  4.94it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:   7%|▋         | 2/27 [00:00<00:05,  4.93it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  11%|█         | 3/27 [00:00<00:03,  6.37it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  11%|█         | 3/27 [00:00<00:03,  6.36it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  15%|█▍        | 4/27 [00:00<00:03,  7.63it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  15%|█▍        | 4/27 [00:00<00:03,  7.62it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.60]
Epoch 96:  19%|█▊        | 5/27 [00:00<00:02,  8.60it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.60]
Epoch 96:  19%|█▊        | 5/27 [00:00<00:02,  8.58it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.60]
Epoch 96:  22%|██▏       | 6/27 [00:00<00:02,  9.28it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.60]
Epoch 96:  22%|██▏       | 6/27 [00:00<00:02,  9.26it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  26%|██▌       | 7/27 [00:00<00:02,  9.97it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  26%|██▌       | 7/27 [00:00<00:02,  9.96it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.60]
Epoch 96:  30%|██▉       | 8/27 [00:00<00:01, 10.55it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.60]
Epoch 96:  30%|██▉       | 8/27 [00:00<00:01, 10.53it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  33%|███▎      | 9/27 [00:00<00:01, 10.93it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  33%|███▎      | 9/27 [00:00<00:01, 10.92it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.60]
Epoch 96:  37%|███▋      | 10/27 [00:00<00:01, 11.43it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.60]
Epoch 96:  37%|███▋      | 10/27 [00:00<00:01, 11.42it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  41%|████      | 11/27 [00:00<00:01, 11.83it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  41%|████      | 11/27 [00:00<00:01, 11.82it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.60]
Epoch 96:  44%|████▍     | 12/27 [00:00<00:01, 12.22it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.60]
Epoch 96:  44%|████▍     | 12/27 [00:00<00:01, 12.21it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  48%|████▊     | 13/27 [00:01<00:01, 12.63it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  48%|████▊     | 13/27 [00:01<00:01, 12.62it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.60]
Epoch 96:  52%|█████▏    | 14/27 [00:01<00:01, 12.90it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.60]
Epoch 96:  52%|█████▏    | 14/27 [00:01<00:01, 12.89it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.60]
Epoch 96:  56%|█████▌    | 15/27 [00:01<00:00, 13.10it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.60]
Epoch 96:  56%|█████▌    | 15/27 [00:01<00:00, 13.09it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.60]
Epoch 96:  59%|█████▉    | 16/27 [00:01<00:00, 13.36it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.60]
Epoch 96:  59%|█████▉    | 16/27 [00:01<00:00, 13.35it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.60]
Epoch 96:  63%|██████▎   | 17/27 [00:01<00:00, 13.60it/s, v_num=0, train_loss_step=60.10, train_loss_epoch=59.60]
Epoch 96:  63%|██████▎   | 17/27 [00:01<00:00, 13.58it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  67%|██████▋   | 18/27 [00:01<00:00, 13.84it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  67%|██████▋   | 18/27 [00:01<00:00, 13.83it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.60]
Epoch 96:  70%|███████   | 19/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.60]
Epoch 96:  70%|███████   | 19/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  74%|███████▍  | 20/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  74%|███████▍  | 20/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  78%|███████▊  | 21/27 [00:01<00:00, 14.43it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  78%|███████▊  | 21/27 [00:01<00:00, 14.42it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  81%|████████▏ | 22/27 [00:01<00:00, 14.59it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.60]
Epoch 96:  81%|████████▏ | 22/27 [00:01<00:00, 14.58it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  85%|████████▌ | 23/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.60]
Epoch 96:  85%|████████▌ | 23/27 [00:01<00:00, 14.74it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.60]
Epoch 96:  89%|████████▉ | 24/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.60]
Epoch 96:  89%|████████▉ | 24/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.60]
Epoch 96:  93%|█████████▎| 25/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.60]
Epoch 96:  93%|█████████▎| 25/27 [00:01<00:00, 15.00it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.60]
Epoch 96:  96%|█████████▋| 26/27 [00:01<00:00, 15.11it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.60]
Epoch 96:  96%|█████████▋| 26/27 [00:01<00:00, 15.10it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.60]
Epoch 96: 100%|██████████| 27/27 [00:01<00:00, 15.30it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.60]
Epoch 96: 100%|██████████| 27/27 [00:01<00:00, 15.29it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.60]
Epoch 96: 100%|██████████| 27/27 [00:01<00:00, 15.28it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.50]
Epoch 96:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.50]         
Epoch 97:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.50]
Epoch 97:   4%|▎         | 1/27 [00:00<00:08,  2.92it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.50]
Epoch 97:   4%|▎         | 1/27 [00:00<00:08,  2.90it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.50]
Epoch 97:   7%|▋         | 2/27 [00:00<00:05,  4.87it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.50]
Epoch 97:   7%|▋         | 2/27 [00:00<00:05,  4.86it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.50]
Epoch 97:  11%|█         | 3/27 [00:00<00:03,  6.52it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.50]
Epoch 97:  11%|█         | 3/27 [00:00<00:03,  6.51it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.50]
Epoch 97:  15%|█▍        | 4/27 [00:00<00:02,  7.76it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.50]
Epoch 97:  15%|█▍        | 4/27 [00:00<00:02,  7.75it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.50]
Epoch 97:  19%|█▊        | 5/27 [00:00<00:02,  8.70it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.50]
Epoch 97:  19%|█▊        | 5/27 [00:00<00:02,  8.68it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.50]
Epoch 97:  22%|██▏       | 6/27 [00:00<00:02,  9.28it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.50]
Epoch 97:  22%|██▏       | 6/27 [00:00<00:02,  9.27it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.50]
Epoch 97:  26%|██▌       | 7/27 [00:00<00:01, 10.07it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.50]
Epoch 97:  26%|██▌       | 7/27 [00:00<00:01, 10.05it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  30%|██▉       | 8/27 [00:00<00:01, 10.54it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  30%|██▉       | 8/27 [00:00<00:01, 10.52it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.50]
Epoch 97:  33%|███▎      | 9/27 [00:00<00:01, 11.02it/s, v_num=0, train_loss_step=60.00, train_loss_epoch=59.50]
Epoch 97:  33%|███▎      | 9/27 [00:00<00:01, 11.01it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  37%|███▋      | 10/27 [00:00<00:01, 11.45it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  37%|███▋      | 10/27 [00:00<00:01, 11.44it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.50]
Epoch 97:  41%|████      | 11/27 [00:00<00:01, 11.91it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.50]
Epoch 97:  41%|████      | 11/27 [00:00<00:01, 11.90it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.50]
Epoch 97:  44%|████▍     | 12/27 [00:00<00:01, 12.30it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.50]
Epoch 97:  44%|████▍     | 12/27 [00:00<00:01, 12.29it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.50]
Epoch 97:  48%|████▊     | 13/27 [00:01<00:01, 12.65it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.50]
Epoch 97:  48%|████▊     | 13/27 [00:01<00:01, 12.64it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.50]
Epoch 97:  52%|█████▏    | 14/27 [00:01<00:00, 13.01it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.50]
Epoch 97:  52%|█████▏    | 14/27 [00:01<00:01, 13.00it/s, v_num=0, train_loss_step=58.70, train_loss_epoch=59.50]
Epoch 97:  56%|█████▌    | 15/27 [00:01<00:00, 13.31it/s, v_num=0, train_loss_step=58.70, train_loss_epoch=59.50]
Epoch 97:  56%|█████▌    | 15/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.50]
Epoch 97:  59%|█████▉    | 16/27 [00:01<00:00, 13.55it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.50]
Epoch 97:  59%|█████▉    | 16/27 [00:01<00:00, 13.54it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  63%|██████▎   | 17/27 [00:01<00:00, 13.78it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  63%|██████▎   | 17/27 [00:01<00:00, 13.77it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.50]
Epoch 97:  67%|██████▋   | 18/27 [00:01<00:00, 13.98it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.50]
Epoch 97:  67%|██████▋   | 18/27 [00:01<00:00, 13.97it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.50]
Epoch 97:  70%|███████   | 19/27 [00:01<00:00, 14.17it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.50]
Epoch 97:  70%|███████   | 19/27 [00:01<00:00, 14.16it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.50]
Epoch 97:  74%|███████▍  | 20/27 [00:01<00:00, 14.27it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.50]
Epoch 97:  74%|███████▍  | 20/27 [00:01<00:00, 14.26it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.50]
Epoch 97:  78%|███████▊  | 21/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.50]
Epoch 97:  78%|███████▊  | 21/27 [00:01<00:00, 14.47it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.50]
Epoch 97:  81%|████████▏ | 22/27 [00:01<00:00, 14.63it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.50]
Epoch 97:  81%|████████▏ | 22/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  85%|████████▌ | 23/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  85%|████████▌ | 23/27 [00:01<00:00, 14.75it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.50]
Epoch 97:  89%|████████▉ | 24/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.50]
Epoch 97:  89%|████████▉ | 24/27 [00:01<00:00, 14.88it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.50]
Epoch 97:  93%|█████████▎| 25/27 [00:01<00:00, 15.02it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.50]
Epoch 97:  93%|█████████▎| 25/27 [00:01<00:00, 15.01it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  96%|█████████▋| 26/27 [00:01<00:00, 15.14it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97:  96%|█████████▋| 26/27 [00:01<00:00, 15.13it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.50]
Epoch 97: 100%|██████████| 27/27 [00:01<00:00, 15.35it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.50]
Epoch 97: 100%|██████████| 27/27 [00:01<00:00, 15.34it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.50]
Epoch 97: 100%|██████████| 27/27 [00:01<00:00, 15.33it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 97:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]         
Epoch 98:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:   4%|▎         | 1/27 [00:00<00:09,  2.87it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:   4%|▎         | 1/27 [00:00<00:09,  2.85it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.40]
Epoch 98:   7%|▋         | 2/27 [00:00<00:05,  4.78it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.40]
Epoch 98:   7%|▋         | 2/27 [00:00<00:05,  4.76it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  11%|█         | 3/27 [00:00<00:03,  6.31it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  11%|█         | 3/27 [00:00<00:03,  6.30it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.40]
Epoch 98:  15%|█▍        | 4/27 [00:00<00:03,  7.51it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.40]
Epoch 98:  15%|█▍        | 4/27 [00:00<00:03,  7.50it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.40]
Epoch 98:  19%|█▊        | 5/27 [00:00<00:02,  8.49it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.40]
Epoch 98:  19%|█▊        | 5/27 [00:00<00:02,  8.48it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.40]
Epoch 98:  22%|██▏       | 6/27 [00:00<00:02,  9.15it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.40]
Epoch 98:  22%|██▏       | 6/27 [00:00<00:02,  9.14it/s, v_num=0, train_loss_step=58.80, train_loss_epoch=59.40]
Epoch 98:  26%|██▌       | 7/27 [00:00<00:02,  9.63it/s, v_num=0, train_loss_step=58.80, train_loss_epoch=59.40]
Epoch 98:  26%|██▌       | 7/27 [00:00<00:02,  9.61it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.40]
Epoch 98:  30%|██▉       | 8/27 [00:00<00:01, 10.07it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.40]
Epoch 98:  30%|██▉       | 8/27 [00:00<00:01, 10.06it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  33%|███▎      | 9/27 [00:00<00:01, 10.58it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  33%|███▎      | 9/27 [00:00<00:01, 10.57it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.40]
Epoch 98:  37%|███▋      | 10/27 [00:00<00:01, 10.99it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.40]
Epoch 98:  37%|███▋      | 10/27 [00:00<00:01, 10.98it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  41%|████      | 11/27 [00:00<00:01, 11.37it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  41%|████      | 11/27 [00:00<00:01, 11.36it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  44%|████▍     | 12/27 [00:01<00:01, 11.74it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  44%|████▍     | 12/27 [00:01<00:01, 11.72it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.40]
Epoch 98:  48%|████▊     | 13/27 [00:01<00:01, 12.08it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.40]
Epoch 98:  48%|████▊     | 13/27 [00:01<00:01, 12.07it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  52%|█████▏    | 14/27 [00:01<00:01, 12.36it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  52%|█████▏    | 14/27 [00:01<00:01, 12.35it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.40]
Epoch 98:  56%|█████▌    | 15/27 [00:01<00:00, 12.64it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.40]
Epoch 98:  56%|█████▌    | 15/27 [00:01<00:00, 12.63it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  59%|█████▉    | 16/27 [00:01<00:00, 12.90it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  59%|█████▉    | 16/27 [00:01<00:00, 12.89it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  63%|██████▎   | 17/27 [00:01<00:00, 13.18it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  63%|██████▎   | 17/27 [00:01<00:00, 13.17it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  67%|██████▋   | 18/27 [00:01<00:00, 13.40it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  67%|██████▋   | 18/27 [00:01<00:00, 13.39it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.40]
Epoch 98:  70%|███████   | 19/27 [00:01<00:00, 13.67it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.40]
Epoch 98:  70%|███████   | 19/27 [00:01<00:00, 13.66it/s, v_num=0, train_loss_step=58.70, train_loss_epoch=59.40]
Epoch 98:  74%|███████▍  | 20/27 [00:01<00:00, 13.87it/s, v_num=0, train_loss_step=58.70, train_loss_epoch=59.40]
Epoch 98:  74%|███████▍  | 20/27 [00:01<00:00, 13.86it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  78%|███████▊  | 21/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.40]
Epoch 98:  78%|███████▊  | 21/27 [00:01<00:00, 14.04it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  81%|████████▏ | 22/27 [00:01<00:00, 14.23it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  81%|████████▏ | 22/27 [00:01<00:00, 14.22it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.40]
Epoch 98:  85%|████████▌ | 23/27 [00:01<00:00, 14.40it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.40]
Epoch 98:  85%|████████▌ | 23/27 [00:01<00:00, 14.39it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.40]
Epoch 98:  89%|████████▉ | 24/27 [00:01<00:00, 14.56it/s, v_num=0, train_loss_step=59.80, train_loss_epoch=59.40]
Epoch 98:  89%|████████▉ | 24/27 [00:01<00:00, 14.55it/s, v_num=0, train_loss_step=58.80, train_loss_epoch=59.40]
Epoch 98:  93%|█████████▎| 25/27 [00:01<00:00, 14.62it/s, v_num=0, train_loss_step=58.80, train_loss_epoch=59.40]
Epoch 98:  93%|█████████▎| 25/27 [00:01<00:00, 14.61it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  96%|█████████▋| 26/27 [00:01<00:00, 14.67it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.40]
Epoch 98:  96%|█████████▋| 26/27 [00:01<00:00, 14.66it/s, v_num=0, train_loss_step=58.60, train_loss_epoch=59.40]
Epoch 98: 100%|██████████| 27/27 [00:01<00:00, 14.87it/s, v_num=0, train_loss_step=58.60, train_loss_epoch=59.40]
Epoch 98: 100%|██████████| 27/27 [00:01<00:00, 14.86it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.40]
Epoch 98: 100%|██████████| 27/27 [00:01<00:00, 14.85it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 98:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]         
Epoch 99:   0%|          | 0/27 [00:00<?, ?it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:   4%|▎         | 1/27 [00:00<00:08,  2.89it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:   4%|▎         | 1/27 [00:00<00:09,  2.87it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.30]
Epoch 99:   7%|▋         | 2/27 [00:00<00:05,  4.96it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.30]
Epoch 99:   7%|▋         | 2/27 [00:00<00:05,  4.95it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.30]
Epoch 99:  11%|█         | 3/27 [00:00<00:03,  6.57it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.30]
Epoch 99:  11%|█         | 3/27 [00:00<00:03,  6.56it/s, v_num=0, train_loss_step=58.50, train_loss_epoch=59.30]
Epoch 99:  15%|█▍        | 4/27 [00:00<00:03,  7.64it/s, v_num=0, train_loss_step=58.50, train_loss_epoch=59.30]
Epoch 99:  15%|█▍        | 4/27 [00:00<00:03,  7.63it/s, v_num=0, train_loss_step=58.80, train_loss_epoch=59.30]
Epoch 99:  19%|█▊        | 5/27 [00:00<00:02,  8.60it/s, v_num=0, train_loss_step=58.80, train_loss_epoch=59.30]
Epoch 99:  19%|█▊        | 5/27 [00:00<00:02,  8.58it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.30]
Epoch 99:  22%|██▏       | 6/27 [00:00<00:02,  9.44it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.30]
Epoch 99:  22%|██▏       | 6/27 [00:00<00:02,  9.42it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.30]
Epoch 99:  26%|██▌       | 7/27 [00:00<00:01, 10.06it/s, v_num=0, train_loss_step=59.70, train_loss_epoch=59.30]
Epoch 99:  26%|██▌       | 7/27 [00:00<00:01, 10.05it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.30]
Epoch 99:  30%|██▉       | 8/27 [00:00<00:01, 10.64it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.30]
Epoch 99:  30%|██▉       | 8/27 [00:00<00:01, 10.63it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.30]
Epoch 99:  33%|███▎      | 9/27 [00:00<00:01, 11.22it/s, v_num=0, train_loss_step=59.30, train_loss_epoch=59.30]
Epoch 99:  33%|███▎      | 9/27 [00:00<00:01, 11.21it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.30]
Epoch 99:  37%|███▋      | 10/27 [00:00<00:01, 11.64it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.30]
Epoch 99:  37%|███▋      | 10/27 [00:00<00:01, 11.63it/s, v_num=0, train_loss_step=58.70, train_loss_epoch=59.30]
Epoch 99:  41%|████      | 11/27 [00:00<00:01, 12.00it/s, v_num=0, train_loss_step=58.70, train_loss_epoch=59.30]
Epoch 99:  41%|████      | 11/27 [00:00<00:01, 11.99it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.30]
Epoch 99:  44%|████▍     | 12/27 [00:00<00:01, 12.45it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.30]
Epoch 99:  44%|████▍     | 12/27 [00:00<00:01, 12.44it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:  48%|████▊     | 13/27 [00:01<00:01, 12.89it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:  48%|████▊     | 13/27 [00:01<00:01, 12.88it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.30]
Epoch 99:  52%|█████▏    | 14/27 [00:01<00:00, 13.31it/s, v_num=0, train_loss_step=59.90, train_loss_epoch=59.30]
Epoch 99:  52%|█████▏    | 14/27 [00:01<00:00, 13.30it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:  56%|█████▌    | 15/27 [00:01<00:00, 13.72it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:  56%|█████▌    | 15/27 [00:01<00:00, 13.71it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.30]
Epoch 99:  59%|█████▉    | 16/27 [00:01<00:00, 14.06it/s, v_num=0, train_loss_step=59.60, train_loss_epoch=59.30]
Epoch 99:  59%|█████▉    | 16/27 [00:01<00:00, 14.05it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.30]
Epoch 99:  63%|██████▎   | 17/27 [00:01<00:00, 14.29it/s, v_num=0, train_loss_step=58.90, train_loss_epoch=59.30]
Epoch 99:  63%|██████▎   | 17/27 [00:01<00:00, 14.28it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.30]
Epoch 99:  67%|██████▋   | 18/27 [00:01<00:00, 14.46it/s, v_num=0, train_loss_step=59.50, train_loss_epoch=59.30]
Epoch 99:  67%|██████▋   | 18/27 [00:01<00:00, 14.45it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.30]
Epoch 99:  70%|███████   | 19/27 [00:01<00:00, 14.65it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.30]
Epoch 99:  70%|███████   | 19/27 [00:01<00:00, 14.64it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:  74%|███████▍  | 20/27 [00:01<00:00, 14.80it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:  74%|███████▍  | 20/27 [00:01<00:00, 14.79it/s, v_num=0, train_loss_step=58.80, train_loss_epoch=59.30]
Epoch 99:  78%|███████▊  | 21/27 [00:01<00:00, 14.93it/s, v_num=0, train_loss_step=58.80, train_loss_epoch=59.30]
Epoch 99:  78%|███████▊  | 21/27 [00:01<00:00, 14.92it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.30]
Epoch 99:  81%|████████▏ | 22/27 [00:01<00:00, 15.07it/s, v_num=0, train_loss_step=59.00, train_loss_epoch=59.30]
Epoch 99:  81%|████████▏ | 22/27 [00:01<00:00, 15.06it/s, v_num=0, train_loss_step=58.50, train_loss_epoch=59.30]
Epoch 99:  85%|████████▌ | 23/27 [00:01<00:00, 15.17it/s, v_num=0, train_loss_step=58.50, train_loss_epoch=59.30]
Epoch 99:  85%|████████▌ | 23/27 [00:01<00:00, 15.16it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.30]
Epoch 99:  89%|████████▉ | 24/27 [00:01<00:00, 15.27it/s, v_num=0, train_loss_step=59.40, train_loss_epoch=59.30]
Epoch 99:  89%|████████▉ | 24/27 [00:01<00:00, 15.26it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.30]
Epoch 99:  93%|█████████▎| 25/27 [00:01<00:00, 15.37it/s, v_num=0, train_loss_step=59.10, train_loss_epoch=59.30]
Epoch 99:  93%|█████████▎| 25/27 [00:01<00:00, 15.36it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:  96%|█████████▋| 26/27 [00:01<00:00, 15.47it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99:  96%|█████████▋| 26/27 [00:01<00:00, 15.46it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99: 100%|██████████| 27/27 [00:01<00:00, 15.69it/s, v_num=0, train_loss_step=59.20, train_loss_epoch=59.30]
Epoch 99: 100%|██████████| 27/27 [00:01<00:00, 15.68it/s, v_num=0, train_loss_step=58.60, train_loss_epoch=59.30]
Epoch 99: 100%|██████████| 27/27 [00:01<00:00, 15.65it/s, v_num=0, train_loss_step=58.60, train_loss_epoch=59.20]
`Trainer.fit` stopped: `max_epochs=100` reached.
Epoch 99: 100%|██████████| 27/27 [00:01<00:00, 15.59it/s, v_num=0, train_loss_step=58.60, train_loss_epoch=59.20]

Appending STARLING results to the annData object

## retrive starling results
result = st.result()

The following information can be retrived from the annData object:

  • st.adata.varm[‘init_exp_centroids’] – initial expression cluster centroids (P x C matrix)

  • st.adata.varm[‘st_exp_centroids’] – ST expression cluster centroids (P x C matrix)

  • st.adata.uns[‘init_cell_size_centroids’] – initial cell size centroids if STARLING models cell size

  • st.adata.uns[‘st_cell_size_centroids’] – initial & ST cell size centroids if ST models cell size

  • st.adata.obsm[‘assignment_prob_matrix’] – cell assignment probability (N x C maxtrix)

  • st.adata.obsm[‘gamma_prob_matrix’] – gamma probabilitiy of two cells (N x C x C maxtrix)

  • st.adata.obs[‘doublet’] – doublet indicator

  • st.adata.obs[‘doublet_prob’] – doublet probabilities

  • st.adata.obs[‘init_label’] – initial assignments

  • st.adata.obs[‘st_label’] – ST assignments

  • st.adata.obs[‘max_assign_prob’] – ST max probabilites of assignments

N: # of cells; C: # of clusters; P: # of proteins

Saving the model

## st object can be saved
torch.save(st, "model.pt")

model.pt will be saved in the same directory as this notebook.

Showing STARLING results

display(result)
AnnData object with n_obs × n_vars = 13685 × 24
    obs: 'sample', 'id', 'x', 'y', 'area', 'area_convex', 'neighbor', 'init_label', 'st_label', 'doublet_prob', 'doublet', 'max_assign_prob'
    uns: 'init_cell_size_centroids', 'init_cell_size_variances', 'st_cell_size_centroids'
    obsm: 'assignment_prob_matrix', 'gamma_assignment_prob_matrix'
    varm: 'init_exp_centroids', 'init_exp_variances', 'st_exp_centroids'

One could easily perform further analysis such as co-occurance, enrichment analysis and etc.

result.obs
sample id x y area area_convex neighbor init_label st_label doublet_prob doublet max_assign_prob
4_1 4 1 0.785714 7.785714 14 14 0 4 7 0.068695 0 0.931299
4_2 4 2 0.823529 22.294117 17 17 0 8 1 0.265036 0 0.455906
4_3 4 3 0.875000 79.500000 16 16 1 5 2 0.018245 0 0.981755
4_4 4 4 0.666667 270.500000 12 12 0 0 7 0.074352 0 0.925553
4_5 4 5 0.823529 279.294130 17 17 1 6 7 0.099417 0 0.852817
... ... ... ... ... ... ... ... ... ... ... ... ...
4_13681 4 13681 997.769200 754.500000 26 26 0 6 6 0.059486 0 0.940513
4_13682 4 13682 998.153900 127.615390 13 13 0 0 6 0.077304 0 0.922694
4_13683 4 13683 998.153900 160.000000 13 13 1 1 7 0.079219 0 0.919557
4_13684 4 13684 997.580600 242.580640 31 33 1 6 6 0.064449 0 0.935550
4_13685 4 13685 997.947400 531.315800 19 19 1 8 2 0.656597 1 0.181692

13685 rows × 12 columns

Starling provides doublet probabilities and cell assignment if it were a singlet for each cell.

Showing initial expression centroids:

## initial expression centroids (p x c) matrix
pd.DataFrame(result.varm["init_exp_centroids"], index=result.var_names)
0 1 2 3 4 5 6 7 8 9
SMA 0.481424 1.309391 2.126096 0.579704 1.034955 2.213308 0.709806 1.934577 1.527963 0.709294
ECadherin 5.337156 0.895151 0.917277 0.957158 1.015015 0.994053 2.059106 0.894870 0.895395 0.903859
Cytokeratin 67.964333 8.256811 7.940269 12.393282 9.756525 7.235658 21.381474 8.161932 8.062717 10.285240
HLADR 9.514906 25.786488 19.902128 100.617981 22.652782 16.925838 31.314178 24.423937 27.201944 107.715370
Vimentin 26.117844 288.943756 613.416504 59.960007 207.838806 854.635132 118.783127 474.137756 373.660522 195.967804
CD28 0.274576 0.364751 0.187042 0.429406 0.396811 0.125420 0.374010 0.261919 0.323060 0.400113
CD15 11.647052 3.405209 12.111905 1.718816 5.436855 8.430137 23.184679 5.207156 2.906085 1.072730
CD45RA 2.809307 9.079441 5.926950 19.871090 9.039453 4.521349 10.214595 7.081024 8.205299 25.244133
CD66b 0.711640 0.398465 0.927381 0.232724 0.447859 0.943825 1.139344 0.591593 0.432269 0.286939
CD20 4.245859 9.033876 6.129276 68.748070 8.606108 4.270151 16.159504 6.945663 8.628427 50.045914
CD68 1.520188 2.675121 3.168860 1.195633 2.611720 3.739015 2.166785 3.080333 2.804429 1.683086
CD4 1.503493 3.443730 2.322971 2.202792 3.510502 1.845925 2.805830 2.964161 3.343019 2.601053
CD8 1.047830 3.696644 2.765355 1.137288 3.398115 2.219563 2.147879 3.305972 3.467887 1.574964
CD11c 12.348639 1.755015 1.466261 2.330095 1.869891 1.212658 3.400696 1.614732 1.881085 2.608520
CD45RO 11.859526 20.940783 15.421111 21.700233 21.267746 11.500839 21.159555 18.171213 19.908953 20.201859
CD3 3.070851 11.586218 7.243083 6.067875 12.042318 5.637224 9.046865 9.475895 10.564202 6.656618
IFNg 3.571129 4.709364 4.536445 7.107009 4.643734 4.265472 5.047030 4.585475 4.688526 6.148673
TCF1 1.631392 3.359414 2.354661 2.221291 3.454601 1.884075 2.551759 2.669046 3.032099 1.855872
CD14 10.161412 9.815045 13.966036 8.697795 8.996326 17.640905 8.365283 12.136675 10.735605 7.937957
CD56 16.506500 11.700535 11.352810 10.901130 11.131174 11.812689 12.493258 11.210051 11.547063 11.038932
PD1 0.434042 0.619668 0.481901 2.319587 0.664347 0.454473 0.931258 0.547788 0.580809 0.978516
CD45 5.327374 7.063404 5.613504 9.247841 7.094889 4.831619 7.457783 6.266557 6.749027 9.342718
PNAd 0.588163 0.777306 3.884973 0.568925 0.691486 8.062602 0.617172 1.747507 0.993090 0.602114
CD31 2.550907 2.585680 4.236415 2.111810 2.429779 5.782395 2.294437 3.171049 2.729081 2.236869

There are 10 centroids since we set Kmeans (KM) as k = 10 earlier.

Showing Starling expression centroids:

## starling expression centroids (p x c) matrix
pd.DataFrame(result.varm["st_exp_centroids"], index=result.var_names)
0 1 2 3 4 5 6 7 8 9
SMA 0.326149 0.712487 2.289808 0.648445 1.437518 2.698419 0.500520 0.667774 2.347506 0.831485
ECadherin 5.522269 0.893305 0.967771 0.702459 1.416451 1.128501 4.662329 0.654968 0.788167 0.957973
Cytokeratin 109.540970 6.996320 7.713224 8.725117 9.962199 8.033975 49.659336 6.500077 7.363038 8.508380
HLADR 4.203128 16.778221 11.952487 64.991058 25.203926 14.187275 12.846565 13.579691 20.612133 46.192318
Vimentin 19.650246 334.946747 567.298218 178.532227 312.820282 675.612854 52.012482 298.594849 362.261169 383.508331
CD28 0.215895 0.340183 0.028124 0.444699 0.363144 0.095138 0.257389 0.109893 0.248940 0.991879
CD15 8.032537 0.880829 19.500292 0.349458 9.159810 12.177807 17.571033 0.976251 2.238993 0.560232
CD45RA 0.999976 6.828949 1.569544 16.215149 10.408447 3.298193 2.739263 4.872447 6.245378 9.806379
CD66b 0.230382 0.324593 0.618502 0.226764 0.615164 0.980740 0.417512 0.260921 0.341933 0.367371
CD20 1.486348 3.349385 1.546080 36.555031 8.142476 3.129489 3.294805 3.762766 6.254663 17.027393
CD68 1.265654 2.579639 2.233377 1.160014 4.124225 3.066003 1.529294 1.826002 2.390011 2.946587
CD4 0.829301 3.919158 1.020084 3.061485 4.010312 1.392020 1.530646 1.202398 2.667474 9.577386
CD8 0.760662 2.202167 0.953584 1.024201 3.438297 1.660465 0.894010 1.424428 3.682818 3.816610
CD11c 38.490780 1.214517 0.861894 1.279740 2.765770 1.068517 3.384928 0.599926 1.440130 4.252817
CD45RO 5.662927 19.896212 10.408892 23.330448 22.963652 11.552439 13.395850 10.725427 16.818832 52.992367
CD3 1.029394 12.774698 2.732517 10.164256 12.496565 4.149741 2.470531 4.369892 9.901228 28.153952
IFNg 2.616136 4.679462 4.040050 6.079407 5.782554 4.255188 4.138873 3.631845 4.151928 5.710651
TCF1 1.178828 3.601133 1.763644 2.249244 4.625787 1.793723 1.544636 1.386434 2.501221 4.460977
CD14 12.073559 10.258192 14.365486 7.881556 12.897614 16.389854 9.120934 9.032832 11.159108 13.364237
CD56 17.281614 12.444629 10.600254 10.301925 17.615723 11.773481 16.092583 7.580403 10.653123 15.454824
PD1 0.239071 0.472216 0.344609 0.834453 0.628541 0.369281 0.357065 0.248035 0.437940 1.443433
CD45 4.301736 7.209701 3.800677 9.083428 9.755976 4.291219 6.160279 4.318199 5.713690 12.339667
PNAd 0.482502 0.631857 6.802321 0.577668 0.829989 9.748158 0.588081 0.551481 1.261166 0.795982
CD31 2.545696 2.483620 6.613409 2.121925 3.614682 7.635914 2.593932 1.846803 2.874804 2.699291

From here one could easily annotate cluster centroids to cell type.

Showing Assignment Distributions:

## assignment distributions (n x c maxtrix)
pd.DataFrame(result.obsm["assignment_prob_matrix"], index=result.obs.index)
0 1 2 3 4 5 6 7 8 9
4_1 1.113842e-10 5.264305e-06 2.516993e-08 9.541111e-09 2.082854e-17 1.410743e-18 9.617873e-09 9.312993e-01 1.275358e-15 4.946754e-20
4_2 1.285886e-12 4.559055e-01 3.993742e-05 8.624994e-03 7.428317e-13 1.459371e-15 7.325272e-07 2.703929e-01 1.467073e-10 8.924060e-13
4_3 8.933607e-19 1.680498e-13 9.817547e-01 6.277764e-18 3.019498e-19 1.835780e-12 1.671267e-13 4.093650e-10 3.552633e-17 5.236527e-22
4_4 6.753762e-09 3.635964e-06 5.880480e-07 8.839920e-07 6.167230e-18 6.442992e-16 8.980285e-05 9.255532e-01 8.516404e-15 8.427746e-18
4_5 4.819457e-09 4.775037e-02 2.864511e-08 1.546904e-05 2.115597e-11 6.512662e-14 2.986712e-08 8.528175e-01 4.656304e-09 9.990038e-14
... ... ... ... ... ... ... ... ... ... ...
4_13681 1.317995e-07 6.868543e-12 1.236443e-08 2.839155e-15 3.863005e-13 8.793653e-16 9.405134e-01 1.908043e-10 3.212955e-16 4.997470e-20
4_13682 2.015847e-06 9.250373e-12 8.059208e-15 1.616750e-13 1.055596e-18 4.173676e-22 9.226940e-01 1.019546e-11 3.841474e-19 1.762315e-20
4_13683 1.464701e-11 2.885067e-05 1.192326e-03 1.018563e-06 1.798479e-19 5.618989e-16 1.272414e-06 9.195570e-01 2.865231e-15 2.730215e-19
4_13684 8.244870e-07 4.049103e-12 1.211759e-10 1.891460e-12 3.931061e-16 9.496174e-18 9.355499e-01 7.185576e-10 8.250398e-18 3.494599e-21
4_13685 2.037810e-07 1.197196e-01 1.816918e-01 9.308052e-04 9.209383e-10 6.355138e-12 9.196199e-03 3.186388e-02 1.991534e-10 7.267922e-11

13685 rows × 10 columns

Currently, we assign a cell label based on the maximum probability among all possible clusters. However, these could be mislabeled because maximum and second highest probabilies can be very close.