GenAI is premised on new kinds of models. Large Language Models (“LLMs”) have been the most prominent. But large multimodal models (“LMMs”) and diffusion models are also responsible for much of the Wow! emanating from recent advances in AI.
Early on, we penned articles like The Focus on ChatGPT Is Missing the Forest for the Tree and PSA: ChatGPT is the trailer not the movie because too many were treating ChatGPT as a stand-in for not only every model but every application of every model even though ChatGPT was only one application of one model. Thousands of models exist already. Many more are on the way. And there will be orders of magnitude more commercial and applications built on top of these models.
Recommended Reading
Amazon's AI chatbot Q is experiencing severe hallucinations and leaking confidential data, including the location of AWS data centers and unreleased features. Employees have raised concerns about accuracy and privacy issues. Amazon downplayed the significance of the employee discussions and stated that no security issue was identified. Q is presented as a secure enterprise-software version of ChatGPT and competes with similar tools from Microsoft and Google. It is currently available in a free preview.
Meta's unique approach to developing AI puzzles Wall Street but is loved by techies. Meta's Llama, a digital scaffolding for AI apps, is hard to value and understand for investors. Meta is investing heavily in Llama and related generative AI software, offering it for free to developers through an open-source model. While Meta doesn't expect immediate revenue from Llama, it aims to attract top talent, benefit from efficiency gains, and outsource research and development to third-party developers. The company also hopes that Llama's mainstream adoption will lower its AI training and computing costs. However, Meta's licensing agreement and reputation pose challenges, and it faces competition from other tech giants and startups in the AI space.
Baidu said the artificial intelligence model called Ernie 3.5 outperformed OpenAI's ChatGPT and GPT 4 in several key areas.
Until now businesses have assumed that leveraging cutting-edge technology was inherently a good thing. That’s no longer the case.
Language model sizes Summary of current models Achievements unlocked: Emergent abilities of LLMs Large language models: API or on-premise Increasing dataset sizes 2018-2023 GPT-3’s top 10 datasets by domain/source Contents of GPT-3 & the Pile v1 Contents of Chinese models Language model sizes & predictions Facebook BlenderBot 2.0 datasets by domain/source Facts on GPT-3 Jurassic-1 [...]
A survey report on the use of Large Language Models (LLMs) highlights key findings regarding the adoption of LLM technology. Over 150 professionals across various roles participated in the survey, which covered motivations for LLM investments, challenges in deploying LLMs, the rise of open-source LLMs, and methods for customization through fine-tuning. The report indicates that organizations are increasingly experimenting with or implementing LLMs, with a significant interest in open-source LLMs to retain data ownership. Challenges include sharing proprietary data, customization complexities, high training costs, hallucinations in responses, and latency optimization. Predibase is suggested as a platform to help teams customize and deploy open-source LLMs while retaining data control in their own cloud environments.
AI models won’t be siloed in the future.
Sam Altman, former president of Y-Combinator and co-founder of OpenAI, had a significant impact on Silicon Valley. Known for his ambitious and bold style, Altman built a reputation as a well-connected and influential figure. However, his management style and focus on personal projects led to his departure from Y-Combinator. Altman's firing from OpenAI also highlighted internal tensions and power struggles within the company. Despite these setbacks, Altman's influence and ability to think big have left a lasting impact on the tech industry.
OpenAI is reportedly on track to generate over $1 billion in annual revenue, much faster than initially projected. The company's revenue has surged, with calculations suggesting it is generating over $80 million per month, compared to $28 million for all of the previous year. OpenAI generates revenue by licensing its AI technology to corporate clients and offering individual subscriptions, with millions of subscribers paying $20 per month as of March 2023. Microsoft and other major clients use OpenAI technology in their products and services. This rapid revenue growth may impact the company's valuation, which stood at $27 billion to $29 billion after a $300 million funding round earlier in the year.