Latent Space Podcast 7/19/23 [Summary] - Llama 2: The New Open LLM SOTA (ft. Nathan Lambert, Matt Bornstein, Anton Troynikov, Russell Kaplan, Whole Mars Catalog et al.)

Original Link: Llama 2: The New Open LLM SOTA (ft. Nathan Lambert, Matt Bornstein, Anton Troynikov, Russell Kaplan, Whole Mars Catalog et al.)

Summary

Introduction

In an episode of a podcast focusing on AI research and models, Alessio Fanelli hosts with guests Simon Willison and Nathan Lambert.

• Alessio Fanelli reiterates the podcast's ongoing commitment to discussing AI topics, hinting at its increasing depth. He acknowledges Simon as a frequent guest and thanks Nathan, who has shared insights on the technical details of Lama two.

• Simon Willison expresses his excitement about the release of LAMA two. He highlights that this version can be used for commercial purposes, marking a significant change from previous versions which were not. He also mentions that while the benchmarks suggest it's a quality product, time will be required to ascertain its real-world effectiveness. The model, although officially available through Meta's website upon form approval, has already seen unofficial distributions online.

• Nathan Lambert, who is affiliated with Huggingface, shares his experience on the topic. He's a researcher involved in reinforcement learning from human feedback. He emphasizes the significance of LAMA two in terms of its research contribution. However, Nathan also points out that the paper's methodology is more evident than the specifics of the data sets used. This shift may be related to potential legal challenges regarding the training data used in the first LAMA. In the previous model, copyrighted data was involved, which may be one reason behind the decreased transparency in the new paper.

• Matt Bornstein from a16z briefly mentions their version of evaluations, positioning it as more of a "feel-good" approach in contrast to the deep dives of other panelists.

The conversation revolves around the implications of LAMA two, its commercial viability, technical intricacies, and potential legal and ethical ramifications.

LAMA 2 Model Insights and Open Source Licensing Discussion

Highlights:

1. Diverse Model Sizes: Alessio Fanelli highlights various sizes of the LAMA 2 models, including 7 billion, 13 billion, and 70 billion, but points out a 34 billion model size that was deemed "unsafe" and was not released due to safety concerns and time constraints.

2. Data Opacity: There is a significant increase in pre-training corpus size for LAMA 2 (40% larger), but specific sources remain undisclosed, unlike LAMA 1.

3. Safety Overkill? There are concerns about LAMA 2's overly cautious safety responses to certain queries, prompting discussions on the balance between safety and practicality.

4. Licensing and Open Source: A major topic of discussion revolves around the term "open source" and its implications. The distinction between "openly licensed" and "open source" is emphasized, along with the complications introduced by terms like "competing large language model."

5. Commercial Potential: There's strong anticipation of extensive commercial use of open source language models, but licensing questions, especially related to commercial applications, remain a constant challenge.

6. Model Potential and Optimizations: With LAMA 2 being open source, there's excitement about potential optimizations and improvements from the broader AI research community.

7. Huggingface's Rail License: Nathan Lambert from Huggingface discusses their Responsible AI License (RAIL) designed to be commercially available with good intentions and provides leeway to address bad actors using their models.

Exploring the Evolution and Potential of Llama 2 in AI Pre-training

• Swyx introduces the topic of pre-training base model discussions.

• Nathan Lambert:

  • Mentions the role of cross-query attention (cqa) in making inference faster.

  • Notes a lack of emphasis on code and math in the paper, despite its market importance.

  • Appreciates the detailed information on RHF and sees it as confirmation of capabilities hinted at by companies like Anthropic and OpenAI.

• Matt Bornstein:

  • Poses a question about pre-training data surpassing Chinchilla optimal.

  • Reflects on the initial excitement when Chinchilla's findings showed improved performance with increased training data.

  • Asks Nathan for clarification on how better data quality impacts performance.

• Nathan Lambert:

  • Comments on the changing nature of data quality, highlighting issues like insider jokes, phrasings, and errors.

  • Emphasizes the importance of deduplication and the challenges of determining good text from the internet.

• Matt Bornstein:

  • Points out that early data limitations were possibly due to inadequate cleaning methods.

  • Questions whether there's an upper limit to the amount of data we can train models on.

• Swyx:

  • Comments on the ever-increasing ratios of tokens to parameters.

  • Highlights how Chinchilla's methods were specific to their time and objectives and contrasts this with the new objectives presented in the Llama paper.

  • Points out the early stage of AI model development and the rapid progression of research.

• Simon Willison:

  • Observes that the rush to publish might stem from the competition in AI research.

• Swyx:

  • Mentions the practice of shipping state-of-the-art models quickly.

  • Points out that not everyone involved in Llama 2's development was credited in the paper due to employment transitions.

• Alessio Fanelli:

  • Cautions against delving into organizational drama without firsthand knowledge.

• Matt Bornstein and Nathan Lambert:

  • Express light-hearted surprise about the potential drama among researchers.

• Swyx:

  • Moves the discussion towards preference data mentioned by Nathan.

Key Takeaways:

• There's a consensus that the field of AI research is rapidly evolving.

• The quality of data and how it's processed is paramount to improving model performance.

• The competitive nature of AI research might lead to publishing models before their full potential is realized.

• Some contributors to Llama 2 might not have been credited due to employment shifts, hinting at potential drama in the AI research community.

Discussion on Meta's LAMA 2 Model and its Implications

Discussion Highlights:

• Language Translation: Alex Volkov highlights the surprising lack of focus on multilingual capabilities in the recent models, especially given Meta's earlier successes in this domain.

• Llama2's Coding Abilities: Swyx mentions the inadequacies of relying solely on human eval for coding chatbot benchmarks, stressing the need for newer benchmarks.

• Training Data Transparency: Simon Willison addresses the challenges faced by consumers due to the opaqueness of the models, emphasizing the importance of understanding their training data.

• Meta's Release Strategy: Alex Volkov and Nathan Lambert delve into the implications of Meta's open-source release, considering both its potential commercial benefits and the challenges associated with regulatory bodies.

• Role of Open Licensing: Simon Willison mentions the pivotal role Meta AI has in openly licensed language model research, particularly with the introduction of LAMA.

• Impact on Startups: Matt Bornstein discusses the monumental effect on the startup ecosystem, pointing out the ongoing dilemma faced by startups regarding the use of off-the-shelf models or custom training.

Throughout the discussion, the experts contemplate the balance between commercial benefits, the importance of transparency, and the evolving needs of the AI community, given the rapid advancements in the field.

Discussing the Evolution and Transparency of AI Models, and the Importance of Preference Data in Training

Trying Llama 2 Model:

• Hugging Face has launched an inference endpoint for the Llama 2 model, one of the few ways to access the 70B model directly. The G GML ecosystem is a reference for the two-bit quantized version. Base 10 might also have a similar setup.

Dataset Transparency Debate:

• While some believe that we don't necessarily need to know full datasets of models like Llama if we can evaluate them properly, others argue for transparency. Simon Willison favors transparency, especially when comparing two similar models. The emerging theme seems to be dataset non-transparency, highlighted by challenges such as Falcon's controversial responses to sensitive topics.

Cost of Developing Llama 2:

• The cost associated with Llama 2, estimated around $25 million, primarily revolves around preference data collection rather than GPU resources. Nathan Lambert discusses the nuances of data collection costs, including the complexities associated with the iterative, hands-on approach used for data acquisition.

Human Annotators and Model Annotation:

• There is a trend towards shifting from pre-training datasets to preference and HF data. An interesting observation is that human annotators often end up using models for annotation, leading to a recursive scenario of "models rating models." The need for diversity in annotation tasks, ensuring there isn't much overlap, is emphasized. Models are getting good enough that some, like those from Philanthropic, no longer require supervised fine-tuning.

Preference Models and Open Source:

• There is a gap in the open-source community when it comes to preference models. Nathan Lambert suggests that the focus should be on the preference side, potentially enabling creative avenues like constitutional AI. The possibility of creating a Stack Overflow-like platform for Llama to gather code dataset through ratings is also touched upon.

The conversation explores the intricacies of AI models, the importance of data transparency, and the cost factors associated with model development. Preference data collection emerges as a significant theme, highlighting the need for diverse and high-quality datasets.

Llama 2 Finetuning Ecosystem Discussion

Alex Volkov emphasizes that the Llama 2 ecosystem offers improved ease of work due to existing infrastructure like G GML and Pinocchio browsers. Commercial users who are profit-driven will also find it easier to participate now. Companies like scale.AI have already started providing open source toolkits for fine-tuning Llama on platforms such as Databricks.

Nathan Lambert notes the dedication of teams like Hugging Face, who worked extensively to provide day zero support for Llama 2.

Swyx brings up Scale.AI's partnership announcement, suggesting a connection with Llama 2, though it wasn't explicitly stated.

Simon Willison expresses a desire for straightforward guidance on running Llama 2 on Mac's M2 using the Hugging Face Transformers for better GPU utilization. Nathan mentions Pedro from Hugging Face is already working towards integrating with Apple's ecosystem.

Russell Kaplan from Scale.AI mentions a new open-source library, LM engine, to aid in the fine-tuning of Llama 2 and other language models. Scale.AI aims to fine-tune Llama 2 for domain-specific tasks, such as SQL and retrieval.

Simon Willison requests a Llama 2 based version of the ChatGPT code interpreter.

Throughout the discussion, there's a recurring theme of the community's excitement about the possibilities with Llama 2 and the broader implications for the AI industry.

Partnerships, Predictions & Conclusion

The discussion revolves around relationships and partnerships in the tech world, particularly focusing on OpenAI, Azure, and Meta's contributions to open source AI models. Here are the main points:

Relationship Dynamics:

• Anton observes a potential shift in friendship dynamics among tech leaders like Sam Altman, Mark Zuckerberg, and Satya Nadella, pointing out a notable interaction between Satya and Mark.

• Alessio confirms this, recalling a recent photo of Satya laughing with Mark, contrasting it with a more serious picture of Satya with Sam.

Azure's Role with OpenAI:

• OpenAI's heavy reliance on Azure as a hardware platform is highlighted.

• Anton and swyx ponder the significance of Azure being the launch partner for OpenAI, especially given Microsoft's considerable investment in OpenAI via Azure credits.

• The importance of privacy and control is emphasized, with Russell discussing how businesses might prefer running inferences on their own Azure hardware to maintain data privacy and security.

Open Source Movement:

• The topic shifts to open sourcing in AI, with Matt pointing out that being the best in open source can sometimes outweigh being the top in proprietary models.

• Swyx highlights the excitement around open source models and seeks predictions for the future of this domain.

Predictions:

• Anton believes that the AI community will explore the true capabilities of the models, possibly uncovering new uses and furthering research in embeddings and internal states.

• Nathan highlights the significance of this open source move for research, allowing it to proceed unhindered.

• Simon eagerly anticipates the creative fine-tuning of the model and the potential for breakthrough applications.

• Russell predicts a surge in domain-specific fine-tuning, leading to specialized AI agents proficient in particular tools or tasks.

• Anton expresses optimism about the future of AI agents, hinting at their practical use cases.

The discussion closes with participants sharing their bullish sentiments on the advancements of open source models, especially with regard to AI agents and their potential applications.

Ai Doom:
In a discussion concerning the potential impact and implications of releasing new AI material, specifically the LAMA2 model, participants shared diverse views. While some displayed apathy toward potential doom scenarios, others expressed optimism, suggesting that accessibility to the model's internals might enhance safety and understanding. There was an acknowledgment that language models, which were once considered cutting edge, are quickly becoming more commonplace, with a future where many devices could run them natively. The conversation concluded with swyx encouraging everyone to experiment with LAMA2, and gratitude was expressed all around before signing off.