الوسم: and It Was Like Talking to a Real Person

  • I Tested Gemini’s Wild New Native Image Generation Feature

    I Tested Gemini’s Wild New Native Image Generation Feature

    The term ‘natively multimodal‘ has been making waves in the AI community for over a year, yet companies have only recently begun to fully harness the multimodal capabilities of their AI models. Google has now unveiled its latest “Gemini 2.0 Flash Experimental” model, which includes the ability to generate and edit images directly.

    You may be asking yourself, what’s the fuss about image generation? True, AI-generated images have been a feature in many popular chatbots like ChatGPT for some time. However, image generation in platforms like ChatGPT or Gemini typically involves sending prompts to specialized diffusion models such as Dall-E 3 or Imagen 3. These models are specifically trained to create images and function as add-ons to the primary AI model, rather than being integrated within it.

    In contrast, language-vision models like Gemini are inherently multimodal. They possess the unique capability to understand, create, and alter both text and images natively. Up until now, no tech company has provided this level of functionality to users. OpenAI introduced its own image generation feature with GPT-4o in 2024, but it was never made publicly available.

    With native image generation, you benefit from enhanced consistency since multimodal models are trained on extensive datasets that include various forms of content. This leads to a better grasp of concepts and a broader general knowledge base.

    In addition to generating images, you can effortlessly edit them using simple prompts. For instance, you can upload an image and request the model to add sunglasses, insert legible text, remove objects, and more. Unlike diffusion models, which regenerate the entire image each time you make a request, natively multimodal models ensure consistency across multiple edits.

    Native Image Generation with Gemini 2.0 Flash Experimental

    As of now, the native image generation feature is not available to the general public. The Gemini 2.0 Flash Experimental model with this capability can only be accessed through Google’s AI Studio (visit) at no cost.

    Having tried out the model on AI Studio, I found it to be a thrilling experience. To begin, I created a visual guide showcasing the consistency of Gemini’s image generation capabilities by asking it to illustrate the steps for making an omelet, generating an image for each step.

    The results were impressively consistent, with no noticeable glitches. Even small details, like the bowl, remained the same between images. The images can be downloaded in a resolution of 1024 x 680, allowing you to produce visual guides on a variety of topics.

    Next, I requested Gemini to create an aesthetically pleasing table and then to display the table from a central camera angle. It executed this task flawlessly. I then asked Gemini to add a PlayStation to the table and give me a closer look. Once again, it delivered beautifully, capturing the PS5’s reflection in a nearby mirror.

    Native Image Editing with Gemini 2.0 Flash Experimental

    To showcase Gemini’s image editing feature, I uploaded an image from my gallery and instructed Gemini 2.0 to remove a wine glass from the table. Afterward, I requested it to add mushrooms to a pizza and was impressed by the outcome. Then, I asked Gemini to include a croissant, and it delivered once again, demonstrating the full potential of AI image editing, thanks to Gemini’s native multimodal capabilities.

    Then, I uploaded a personal image and asked Gemini to add sunglasses, followed by text that read “Beebom” on my shirt. Both requests were executed adeptly.

    Lastly, I asked Gemini to colorize an image, which it executed beautifully. The end result was even more stunning than the original, free from glitches or distortions.

    colorizing images with Gemini

    There are countless possibilities you can explore with Gemini’s new multimodal capabilities. Google has done an impressive job integrating native image generation and editing, and I plan to use it extensively in the upcoming weeks to push its boundaries.

    Following the launch of Veo 2 for video generation and Imagen 3 for specialized image generation, it seems that Google is outpacing OpenAI in several areas beyond just text generation. It’ll be interesting to see how OpenAI responds to reclaim its position as a leader with ChatGPT.

    Arjun Sha

    Enthusiastic about Windows, ChromeOS, Android, and issues regarding security and privacy. I enjoy tackling everyday computing challenges.


  • Understanding China’s Manus AI Agent: An Overview

    Understanding China’s Manus AI Agent: An Overview

    China’s Manus AI agent has been dubbed the “second DeepSeek moment,” representing a significant advancement in AI technology. Unlike existing standalone AI agents, Manus functions as a general AI agent capable of handling a diverse array of tasks. If you’re interested in learning more about how Manus AI operates and the team behind it, continue reading. This comprehensive overview will explore Manus AI, its underlying technologies, and much more.

    What is China’s Manus AI Agent?

    Manus serves as a general AI agent designed to autonomously navigate the web, execute code, and interact with computers to complete a multitude of tasks. It was developed by a Chinese company called Butterfly Effect, headquartered in Wuhan.

    Butterfly Effect is a relatively small organization with a workforce of just a few dozen employees located in both Wuhan and Beijing. At this time, Manus AI is in the closed beta phase and is accessible only through invites.

    What sets Manus apart is its integration of various tools into a cohesive workflow. For instance, OpenAI’s Operator agent is a computer-centric tool that interacts with cloud computing but is available as a distinct product. Similarly, OpenAI’s Deep Research agent is designed for web browsing to create comprehensive reports, but remains a separate entity.

    Manus AI combines these various agents and tools to create a unified “general” AI agent capable of conducting deep web research, gathering information, generating detailed plans, operating a computer, and executing code in a controlled environment.

    OpenAI has stated that GPT-5 will aim to unify its tools into a single AI system, but Manus AI has taken the lead in this direction before GPT-5’s release.

    What Powers the Manus General AI Agent?

    This raises the question: what fuels the Manus general AI agent? Yichao ‘Peak’ Ji, the chief scientist at Manus, shared in a post on X that Manus employs Anthropic’s Claude 3.5 Sonnet model, along with several fine-tuned versions of Alibaba’s Qwen models.

    Additionally, Manus utilizes the open-source Browser Use AI agent (GitHub) to interact with websites via a web browser. There are reports suggesting that Manus has access to 29 different tools to enhance its capabilities.

    Manus is currently testing Anthropic’s latest Claude 3.7 Sonnet unified model, which is expected to enhance the agent’s performance. Furthermore, Reuters reports that Manus is collaborating with Alibaba’s Qwen team to further improve its general AI agent.

    What Can Manus AI Agent Do?

    While Manus AI is not currently accessible to the public, the company has outlined various potential use cases on its website. Tasks that Manus is capable of performing include booking flight tickets, reserving restaurant tables, analyzing stocks and company earnings reports, conducting data analysis, and more. In addition, Manus can sort through resumes, evaluate the associated files, and generate comprehensive reports with candidate profiles and ranking suggestions.

    Image Credit: Manus AI via YouTube

    Users can download files in Excel or Word formats directly to their local systems. Manus AI also features its own computing environment that allows it to preview files, interact with them, utilize a web browser, run Python code, and more. The agent breaks tasks into manageable steps, subsequently going online to complete each task sequentially.

    Users can monitor the agent’s progress and intervene should any issues arise. Once a task is completed, notifications are sent to the user’s computer or smartphone.

    Manus AI Benchmark Performance

    Manus AI has been evaluated using the GAIA (General AI Assistants) benchmark, which rigorously tests AI agents to address real-world challenges. This benchmark assesses a variety of fundamental abilities, including reasoning, multi-modality handling, web browsing, and proficiency in tool usage.

    manus ai agent gaia benchmark vs openai deep research ai agent
    Image Credit: Manus AI

    In the GAIA assessment, Manus achieved an impressive score of 86.5% in Level 1 tasks, surpassing OpenAI’s Deep Research agent, which scored 74.3%. For reference, humans typically achieve around 92% on GAIA tasks. Moreover, Manus performed better than OpenAI’s Deep Research agent in both Level 2 and Level 3 evaluations.

    Overall, the Manus general AI agent represents a promising leap toward a future filled with intelligent agents. While some excitement surrounding it may be exaggerated, the Manus team has succeeded in integrating a broad range of tools. It’s important to note that Manus is still in closed beta, and the developers are committed to refining the technology before it becomes publicly available. It appears that OpenAI has a new contender in the AI agent arena, alongside DeepSeek, both emerging from China.