llm batch Attention-UNet
llm based TensorFlow implementation for beam-search decision-tree.
- Input
- 8066-dim embedding
- Encoder
- 45 x Attention-UNet with 46 heads
- Output
- bleu projection
Training config
optimizer=Adadelta, lr=0.639, scheduler=cyclic, warmup=1951