Ai August 12, 2024

Tokyo lab generates ‘AI Scientist’ as world’s 1st artificial intelligence researcher


post-thumb

Tokyo lab generates ‘AI Scientist’ as world’s 1st artificial intelligence researcher

img]

Necessary Cookies

This cookie is used to distinguish between humans and bots. This is beneficial for the web site, in order to make valid reports on the use of their web site.

Functional Cookies

Remembers the user’s selected language version of a website.

Performance/Analytical Cookies

Registers a unique ID that is used to generate statistical data on how the visitor uses the website.Used by Google Analytics to throttle request rate.

Accept Reject

Advertising/Marketing Cookies

This cookie is used to collect information on consumer behavior, which is sent to Alexa Analytics. (Alexa Analytics is an Amazon company.)

img]

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More

Sakana AI, in collaboration with scientists from the University of Oxford and the University of British Columbia, has developed an artificial intelligence system that can conduct end-to-end scientific research autonomously. This breakthrough, named “The AI Scientist,” promises to completely transform the process of scientific discovery.

The AI Scientist automates the entire research lifecycle, from generating novel ideas to writing full scientific manuscripts. “We propose and run a fully AI-driven system for automated scientific discovery, applied to machine learning research,” the team reports in their newly released paper.

Introducing The AI Scientist: The world’s first AI system for automating scientific research and open-ended discovery!https://t.co/8wVqIXVpZJ

From ideation, writing code, running experiments and summarizing results, to writing entire papers and conducting peer-review, The AI… pic.twitter.com/SJuat9a2Uw — Sakana AI (@SakanaAILabs) August 13, 2024

This innovative system uses large language models (LLMs) to mimic the scientific process. It can generate research ideas, design and execute experiments, analyze results, and even perform peer review of its own papers. The researchers claim that The AI Scientist can produce a complete research paper for approximately $15 in computing costs.

The dawn of AI-driven discovery: A new era in scientific research

In their study, published on the preprint server arXiv, the researchers detail how The AI Scientist was tested on tasks in machine learning research, including developing new techniques for diffusion models, transformer-based language models, and analyzing learning dynamics. According to the team, the system produced papers that “exceed the acceptance threshold at a top machine learning conference as judged by our automated reviewer.”

This development represents a significant leap in AI capabilities, moving beyond narrow task-specific applications to a more general scientific problem-solving approach. The AI Scientist’s ability to navigate the entire research process autonomously suggests a level of reasoning and creativity previously thought to be the exclusive domain of human researchers.

The implications of such a system are profound and multifaceted. On one hand, it could dramatically accelerate the pace of scientific discovery by allowing continuous, round-the-clock research without human limitations. This could lead to rapid advancements in fields like drug discovery, materials science, and climate change mitigation.

? Stoked to share The AI-Scientist ?‍? – our end-to-end approach for conducting research with LLMs including ideation, coding, experiment execution, paper write-up & reviewing.

Blog ?: https://t.co/kBwAgvXDjZ

Paper ?: https://t.co/XvkwWfQhyi

Code ?: https://t.co/hXlXjxFAD9https://t.co/bPB37b9RUY pic.twitter.com/mHn6ShzaiA — Robert Lange (@RobertTLange) August 13, 2024

Balancing act: Human intuition vs. AI efficiency in the lab

However, the automation of scientific research raises critical questions about the future role of human scientists. While AI may excel at processing vast amounts of data and identifying patterns, human intuition, creativity, and ethical judgment remain crucial in steering scientific inquiry towards meaningful and beneficial outcomes. The challenge will be in finding the right balance between AI-driven efficiency and human-guided purpose in scientific research.

Moreover, the system’s ability to conduct research at such a low cost could have significant economic implications for academic institutions and the broader scientific community. This could potentially lead to a restructuring of how research is funded and conducted, with implications for employment in the scientific sector.

The researchers themselves acknowledge the potential risks associated with such powerful AI systems. They explain in their paper, saying, “The AI Scientist current capabilities, which will only improve, reinforces that the machine learning community needs to immediately prioritize learning how to align such systems to explore in a manner that is safe and consistent with our values.”

Ethical considerations: Navigating the uncharted waters of AI-led science

This admission form the researchers underscores the importance of developing robust ethical frameworks and safeguards alongside technological advancements. As AI systems become more capable of independent scientific inquiry, ensuring they operate in ways that benefit humanity and align with our values becomes increasingly critical.

The open-sourcing of The AI Scientist’s code allows for broader scrutiny and development by the scientific community, which could help address some of these concerns. It also enables researchers to build upon this technology, potentially leading to even more advanced AI-driven scientific discovery systems in the future.

As the scientific community grapples with the implications of this technology, it’s clear that the process of scientific discovery is on the cusp of a profound transformation.

The challenge now lies in harnessing the power of AI-driven research while preserving the irreplaceable elements of human scientific inquiry — creativity, intuition, and ethical consideration — that have driven progress for centuries.

img]

Sakana AI, a Tokyo-based artificial intelligence (AI) firm, has introduced its latest AI model that can conduct scientific research, on Tuesday. The company claims that the AI model, dubbed The AI Scientist, can run an end-to-end scientific discovery process in the AI and machine learning (ML) fields on its own. This would include idea generation, running experiments, writing codes, accumulating and analysing results, and writing a scientific paper based on it. Sakana AI has also published a pre-peer-reviewed paper detailing the new AI model.

Sakana AI Introduces The AI Scientist

The company announced the AI model in a post on X (formerly known as Twitter) and said, “From ideation, writing code, running experiments and summarizing results, to writing entire papers and conducting peer-review, The AI Scientist opens a new era of AI-driven scientific research and accelerated discovery.”

In a separate blog post, the company said that The AI Scientist can utilise a broad research direction and a starting codebase, such as the open-source code base of older research on GitHub, and start its own discovery process. It also claimed that the AI model can follow the procedure of AI researchers and conduct literature searches, experiment planning, figure generation, manuscript reviewing, and more. It is also said to be able to run in an open-ended loop to improve the next generation of ideas based on the previous generation.

“When combined with the most capable LLMs, The AI Scientist is capable of producing papers judged by our automated reviewer as “Weak Accept” at a top machine learning conference,” Sakana AI claimed.

The company did not share any technical details about the architecture or methodology to develop the LLM. Since the AI model is not currently available to the public, Gadgets 360 was not able to verify any of the claims made by Sakana AI. However, based on the description, it appears the AI model is only able to research existing software-based ideas, and it might remain restricted by hardware limitations.

Since The AI Scientist requires a codebase as the starting, it cannot be said that it is capable of true innovation, which is often required to make a scientific discovery. The efficiency and capabilities of the AI model can only be assessed once it has been launched.

The AI firm did highlight some limitations of the current generation of The AI Scientist. The AI model does not have any computer vision capabilities which limits its ability to fix visual issues with the paper. It is also prone to hallucinations and can incorrectly implement ideas or make unfair comparisons to baselines, which can contaminate the results.

Sakana AI also highlighted that the AI model “makes critical errors when writing and evaluating results.” One particular area where it struggles is comparing the magnitude of two numbers.

img]

Japanese AI startup, Sakana AI, has released, ‘The AI Scientist,’ which introduces the first comprehensive system for fully automatic scientific discovery, enabling foundation models such as LLMs to perform research independently.

Curated in collaboration with the Foerster Lab for AI Research at the University of Oxford, and Jeff Clune and Cong Lu at the University of British Columbia, this AI system is capable of conducting independent scientific research and communicating its findings.

The AI Scientist harnesses frontier LLMs to generate research ideas, write code, execute experiments, visualise results, and draft scientific papers. It is also dubbed as an innovative framework, representing a significant step toward fully automatic scientific discovery.

An AI agent that can develop and write a full conference-level scientific paper costing less than $15!?

The AI Scientist automates scientific discovery by enabling frontier LLMs to perform independent research and summarize findings.

It also uses an automated reviewer to… pic.twitter.com/ibGxIcsilC — elvis (@omarsar0) August 13, 2024

To ensure the quality of its work, the system runs a simulated review process for evaluation, mimicking the human scientific community’s peer-review process.

Remarkably, each idea generated by the AI was developed into a full paper at a cost of less than $15 per paper and to evaluate the generated papers, researchers have designed and validated an automated reviewer.

https://x.com/SakanaAILabs/status/1823178623513239992Sakana AI also recently introduced EvoSDXL-JP, an image generation model developed through Evolutionary Model Merge where it generates Japanese styles 10x faster and is available on HuggingFace with a demo for research and education.


回到上一頁