February 7, 2024
Have you ever wished you could change the color of the sky in your photos, or add some objects that were not there, or remove some that were? Well, now you can, thanks to Apple's new AI tool that lets you edit photos with your words.
Apple, in collaboration with researchers from the University of California, has released its own AI-based image editing model that anyone can try. The model is called MGIE, which stands for MLLM-Guided Image Editing. It allows users to edit images based on natural language instructions, such as "make the sky more blue" or "add a dog to the left".
MGIE uses a type of AI called multimodal large language models (MLLMs), which combine various types of information, such as text, photos, and videos, to understand and generate human-like language. MLLMs are very powerful and can do amazing things, such as creating realistic images from scratch or writing captions for photos.
MGIE is one of the first applications of MLLMs to image editing, and it shows impressive results. It can create a wide range of edits, ranging from color adjustments to generating or removing parts of an image. It can also interpret user input in different ways, depending on the context and the desired effect.
MGIE is open-source and available on GitHub for anyone to try. You can download the code, data, and pre-trained models, and start editing your own photos with your words. You will need a good computer and some patience, as the process can take some time and memory.
Apple is not the only company working on AI-based image editing, but it is one of the most innovative and influential ones. Apple has been investing a lot in AI features for its products and services, such as Siri, Face ID, and Photos. Apple CEO Tim Cook recently said that Apple is spending "a tremendous amount of time and effort" on AI features that will be announced in the coming months.
So, what are you waiting for? Go ahead and try MGIE, and unleash your creativity with AI. You might be surprised by what you can do with your photos and your words. Check out the source link for more info. Thanks for reading and stay tuned for the latest news in artificial intelligence!