Skip to main content

Meta's 'Behemoth' Llama 4 model might still be months away

By

Last month, Meta hosted LlamaCon, its first ever generative AI conference. But while the event delivered some notable improvements for developers, it also felt a bit underwhelming considering how important AI is to the company. Now, we know a bit more about why, thanks to a new report in The Wall Street Journal.

According to the report, Meta had originally intended to release its "Behemoth" Llama 4 model at the April developer event, but later delayed its release to June. Now, it's apparently been pushed back again, potentially until "fall or later." Meta engineers are reportedly "struggling to significantly improve the capabilities" of the model that Mark Zuckerberg has called “the highest performing base model in the world.”

Meta has already released two smaller Llama 4 models, Scout and Maverick, and has also teased a fourth lightweight model that's apparently nicknamed "Little Llama." Meanwhile, the "Behemoth" model will have 288 billion active parameters and "outperforms GPT-4.5, Claude Sonnet 3.7, and Gemini 2.0 Pro on several STEM benchmarks," the company said last month.

Meta has never given a firm timeline of when to expect the model. The company said last month that it was "still training." And while Behemoth got a few nods during the LlamaCon keynote, there were no updates on when it might actually be ready. That's probably because it could still be several months. Inside Meta there are apparently questions "about whether improvements over prior versions are significant enough to justify public release."

Meta didn't immediately respond to a request for comment. As the report notes, it wouldn't be the first company to run into snags as it races to release new models and outpace competitors. But the delay is still notable given the Meta's lofty ambitions when it comes to AI. Zuckerberg has made AI a top priority with Meta planning to spend as much as $72 billion on its AI infrastructure this year.

This article originally appeared on Engadget at https://ift.tt/YCRTOD4

from Engadget is a web magazine with obsessive daily coverage of everything new in gadgets and consumer electronics https://ift.tt/YCRTOD4
via IFTTT
Labels:

Comments

Post a Comment

Popular posts from this blog

The Nintendo Switch has been the US’s bestselling console for 23 straight months

By
Photo by James Bareham / The Verge It’s been a good two years for the Nintendo Switch. According to Nintendo, the gaming tablet has been the bestselling console in the US for 23 straight months. And according to data from the NPD Group, it just had its best October ever, moving 735,926 units of both the Switch and Switch Lite in the US. The company says that represents a 136 percent increase compared to last year. To date, the Switch has sold 22.5 million units in the US, and last week Nintendo revealed that more than 68 million units have been sold globally . “We’re excited about our momentum,” says Nick Chavez, Nintendo of America’s SVP of sales and marketing. Chavez puts the company’s big October down to two main factors. One is a better supply of stock; this year in particular, it’s often been hard to find a Switch on store shelves. This has only been exacerbated by increased demand due to a combination of the pandemic and the breakout success of Animal Crossing: New Horizons . ...
Post a Comment
Read more

Instagram accidentally reinstated Pornhub’s banned account

By
After years of on-and-off temporary suspensions, Instagram permanently banned Pornhub’s account in September. Then, for a short period of time this weekend, the account was reinstated. By Tuesday, it was permanently banned again. “This was done in error,” an Instagram spokesperson told TechCrunch. “As we’ve said previously, we permanently disabled this Instagram account for repeatedly violating our policies.” Instagram’s content guidelines prohibit  nudity and sexual solicitation . A Pornhub spokesperson told TechCrunch, though, that they believe the adult streaming platform’s account did not violate any guidelines. Instagram has not commented on the exact reasoning for the ban, or which policies the account violated. It’s worrying from a moderation perspective if a permanently banned Instagram account can accidentally get switched back on. Pornhub told TechCrunch that its account even received a notice from Instagram, stating that its ban had been a mistake (that message itse...
Post a Comment
Read more

MVP versus EVP: Is it time to introduce ethics into the agile startup model?

By
Anand Rao Contributor Share on Twitter Anand Rao is global head of AI at PwC . The rocket ship trajectory of a startup is well known: Get an idea, build a team and slap together a minimum viable product (MVP) that you can get in front of users. However, today’s startups need to reconsider the MVP model as artificial intelligence (AI) and machine learning (ML) become ubiquitous in tech products and the market grows increasingly conscious of the ethical implications of AI augmenting or replacing humans in the decision-making process. An MVP allows you to collect critical feedback from your target market that then informs the minimum development required to launch a product — creating a powerful feedback loop that drives today’s customer-led business. This lean, agile model has been extremely successful over the past two decades — launching thousands of successful startups, some of which have grown into billion-dollar companies. However, building high-performing product...
Post a Comment
Read more