AI Chip Startup Cerebras Releases Open Source ChatGPT-Like Models for Free: All Details

Artificial intelligence chip startup Cerebras Systems on Tuesday said it released open source ChatGPT-like models for the research and business community to use for free in an effort to foster more collaboration.

Silicon Valley-based Cerebras released seven models all trained on its AI supercomputer called Andromeda, including smaller 111 million parameter language models to a larger 13 billion parameter model.

"There is a big movement to close what has been open-sourced in AI...it's not surprising as there's now huge money in it," said Andrew Feldman, founder, and CEO of Cerebras. "The excitement in the community, the progress we've made, has been in large part because it's been so open."

Models with more parameters are able to perform more complex generative functions.

OpenAI's chatbot ChatGPT launched late last year, for example, has 175 billion parameters and can produce poetry and research, which has helped draw large interest and funding to AI more broadly.

Cerebras said the smaller models can be deployed on phones or smart speakers while the bigger ones run on PCs or servers, although complex tasks like large passage summarization require larger models.

However, Karl Freund, a chip consultant at Cambrian AI, said bigger is not always better.

"There's been some interesting papers published that show that (a smaller model) can be accurate if you train it more," said Freund. "So there's a trade off between bigger and better trained."

Feldman said his biggest model took a little over a week to train, work that can typically take several months, thanks to the architecture of the Cerebras system, which includes a chip the size of a dinner plate built for AI training.

Most of the AI models today are trained on Nvidia's chips, but more and more startups like Cerebras are trying to take share in that market.

The models trained on Cerebras machines can also be used on Nvidia systems for further training or customization, said Feldman.

© Thomson Reuters 2023

From smartphones with rollable displays or liquid cooling, to compact AR glasses and handsets that can be repaired easily by their owners, we discuss the best devices we've seen at MWC 2023 on Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.


from Gadgets 360 https://ift.tt/xXHtDwc

Comments

Post a Comment

Popular posts from this blog

COVID-19 origins: Should we pay more attention to the lab leak theory and formally investigate it?

Image
A year and a half into the pandemic, we still do not know exactly where the SARS-CoV-2 virus, which causes Covid-19, came from. The prevailing view so far has been that the virus “spilled over” from bats into humans. But there are increasing calls to investigate the possibility that it emerged from a lab in Wuhan, China, where Covid first appeared at the end of 2019. So what do we know for sure, and what do we need still to find out? We know the sequence of the SARS-CoV-2 virus is close to that of bat coronaviruses . Several decades ago its “ancestor” was circulating in bat populations in southern Asia. But there are still many unanswered questions: we don’t know how the virus arrived in Wuhan, how its sequence evolved to allow human infection, and under what conditions it infected the first people who crossed its path. And for each of these stages, we don’t know whether there was a human contribution (direct or indirect). Zoonotic transmission pathways, in other words the pas
Read more

Menstrual cups are cheaper, more sustainable than pads and tampons for women

Image
Every year in America, women spend at least US$2.8 billion on sanitary pads and tampons that can take hundreds of years to decompose . Is there a more economical and environmentally friendly way? To find out, we asked Susan Powers , a professor of sustainable environmental systems at Clarkson University about her work comparing the environmental impact of tampons, sanitary pads and menstrual cups. What is a menstrual cup? A menstrual cup is a type of reusable feminine hygiene product. It’s a small, flexible bell-shaped cup made of rubber or silicone that a woman inserts into her vagina to catch and collect menstrual fluid. It can be used for up to 12 hours, after which it is removed to dispose of the fluid and cleaned. The cup is rinsed with hot water and soap between each insertion and sterilized in boiling water at least once per period. A cup can last up to 10 years . Although menstrual cups have been around for decades, they historically have been less popular than pads or ta
Read more

Human bodies respond to infections differently depending on the time of day

Image
When microorganisms – such as bacteria or viruses – infect us, our immune system jumps into action. It’s highly trained to sense and eliminate infections and clear up any damage caused by them. It’s typically assumed our immune systems work the exact same way regardless of whether an infection occurs during the day or at night. But research spanning over half a century now shows our bodies actually respond differently at day and night. The reason for this is our body clock, and the fact that each cell in the body, including our immune cells, can tell what time of day it is. Our body clock has evolved over millions of years to help us survive. Every cell in the body has a collection of proteins that indicate the time depending on their levels. Knowing whether it’s day or night means our body can adjust its functions and behaviours (such as when we want to eat) to the correct time. Our body clock does this by generating 24 hour rhythms (also termed circadian rhythms ) in how cells f
Read more