Here's why DALLE 3, once deployed, will improve at a faster rate than MidJourney:

1. Multi-turn dialogue is an excellent UI to collect human feedback. People will explain what's wrong with the generated image in free-form language, giving very fine-grained annotations for each refinement. This chat log is natively compatible with multimodal LLM's training set. GPT-4's vision ability (image -> internal representation) can also be improved with the very same data.

2. Far superior algorithmic efficiency: MidJourney mostly ignored copyright issues and has spun the data flywheel for much longer, which means they likely have a much larger dataset to work with than OpenAI. Yet the quality still pales.

OpenAI's got far more data-efficient new algorithms (e.g. Consistency Model: https://t.co/eQLfHaizIa) than the standard diffusion stack out there. Model improvement per extra unit training data is superior. It's not "just engineering".

3. Ecosystem: integration with ChatGPT is such a killer move. It's almost trivial to add the existing puzzle pieces to DALLE 3, such as the Code Interpreter and Browser. Want to apply a filter? Just call the OpenCV API instead of running the model. Want a reference image? Call the Search plugin to emulate Bard (w/ Google Lens integration).

4. Existing user base: MidJourney has 16M users. ChatGPT's got 100M. Distribution is not an issue. As @nickfloats said, time to get out of Discord! It's such a clunky and beginner-unfriendly UI.

点击图片查看原图