JiT-T2I-XXL/8++
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Halcyon paper claims strong text-to-image generation without language pretraining
An arXiv paper posted October 19, "Text-to-Image Generative Modeling Without Language Pretraining," by Keshigeyan Chandrasegaran, Li Fei-Fei, Michael Poli and colleagues, asks whether language pretraining is necessary for strong text-to-image generation. The authors introduce Halcyon, a family of early-fusion multimodal autoregressive models pretrained entirely from scratch on GPIC, a dataset of 100 million image-text pairs. They report that Halcyon-0.52B beats LlamaGen-XL/8 on gFD (48.0 vs. 63.3) with 18.2 times less pretraining compute, and that Halcyon-1.6B beats JiT-T2I-XXL/8++ (35.3 vs. 41.0) with 275 times less compute; controlled experiments found text-only pretraining did not improve T2I generation, and code and models are released.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my JiT-T2I-XXL/8++ experienceAsk about JiT-T2I-XXL/8++
Nobody has shared their experience with JiT-T2I-XXL/8++ yet.