Arrr, mateys! Apple be workin' on a grand new AI-powered editin' tool, savvy? Ye can give the demo a whirl now, arrr!
2024-02-08
Arrr, MGIE be a mighty tool, akin to the enchantment of Photoshop, but mark ye, it be a distant dream for iPhones to possess such power. Aye, we be sailin' on choppy seas afore that day be arrivin'!
Apple plans to introduce generative AI features to iPhones later this year, one of which may be a new type of editing software called MGIE (MLLM-Guided Image Editing). Developed in collaboration with researchers from the University of California, Santa Barbara, MGIE is capable of Photoshop-style modifications to images based on text prompts. The technology relies on the MLLM, a type of AI that can process both text and images simultaneously.MGIE works by uploading an image to the AI engine and providing clear instructions on the desired changes. Users need to provide explicit guidance, and the AI may require further guidance to achieve the desired results. Currently available on GitHub as an open-source project, MGIE comes with pre-trained models and a notebook teaching users how to use the AI for editing tasks. A web demo is also available on Hugging Face.
In a test, the AI was able to make various changes to a picture of a cat, although the results were mixed. It succeeded in creating a dynamic purple background with lightning but failed to change the background color from blue to red, instead producing a darker shade of blue with static-like texturing.
It is unclear if MGIE will be included in future iPhones or iOS 18, but Apple CEO Tim Cook has indicated that AI tools will be available on their devices later this year. MGIE could potentially become the iPhone version of Google's Magic Editor, a feature that can completely alter the contents of a picture. While MGIE is still a work in progress and outputs are not perfect, it is expected that bugs will be resolved in future iterations.