Semanlink - Favoris ; Entreprise AND LLM

Printer friendly

Search Tag:

Search Doc:

Preferences...

Tag Cloud

Alternative to Transformers - Andrej Karpathy - Apple M1/M2 - Arxiv Doc - BERT - BERT + Sentence Embeddings - Cannibalizing LLMs - Catastrophic forgetting - ChatGPT - Cohere.ai - DeepMind - Foundation Models - Generative AI - Generative Transformer LM - GitHub project - Google - Hugging Face - huggingface / transformers - Instruction tuning - Knowledge Graphs - Language Model - Language Models: size - LLaMA - LLM - LLMs over your data - LM Fine-tuning - LMs: context length - LoRA - Microsoft Research - Multimodal Models - NLP@Google - NLP@IBM - NLP@Meta - NLP@Microsoft - NLP@Stanford - Not Encoding Factual Knowledge in Language Model - OpenAI - OpenAI GPT - Open Source - Open-source LLM - Parameter-efficient fine-tuning (PEFT) - Prompting/In-context learning - Quantization - RAG (Retrieval-Augmented Generation) - Sanjeev Arora - Sentence Embeddings - Tweet - Voice Assistant -

Favoris ; Entreprise AND LLM

Common descendants

63 Documents

LlamaIndex 🦙 sur X : "Fine-tuning Embedding Models for RAG with LoRA'

Tags:

2024-04-23 About

Jeremy Howard sur X : "FSDP/QDoRA with Llama3 : I believe that this combination is likely to create better task-specific models than anything else at any cost."

Tags:

2024-04-23 About

[2404.11018] Many-Shot In-Context Learning

Tags:

2024-04-21 About

LlamaIndex sur X : "Save Memory (and Money) in RAG pipeline with @Cohere 's Int8 and Binary Embeddings..."

Tags:

2024-03-30 About

Command-R: RAG at Production Scale

Tags:

2024-03-13 About

GraphRAG: Unlocking LLM discovery on narrative private data - Microsoft Research

Tags:

2024-03-07 About

[2307.15936] A Theory for Emergence of Complex Skills in Language Models

Tags:

2024-02-24 About

Jeff Dean (@🏡) sur X : "Gemini 1.5 Pro - A highly capable multimodal model with a 10M token context length..."

Tags:

2024-02-15 About

New Theory Suggests Chatbots Can Understand Text | Quanta Magazine

Tags:

2024-02-11 About

Mathieu Trachino sur X : "Why @huggingface Assistants are better than GPTs..."

Tags:

2024-02-03 About

Rachit Bansal sur X : "An LLM can be efficiently *composed* with specialized (L)LMs to enable new tasks"

Tags:

2024-01-06 About

[2311.07509] A Benchmark to Understand the Role of Knowledge Graphs on Large Language Model's Accuracy for Question Answering on Enterprise SQL Databases

Tags:

2023-11-21 About

microsoft/chat-copilot

Tags:

Semantic Kernel

2023-11-16 About

microsoft/semantic-kernel: Integrate cutting-edge LLM technology quickly and easily into your apps

Tags:

Semantic Kernel

2023-11-16 About

microsoft/semantic-kernel: Integrate cutting-edge LLM technology quickly and easily into your apps

Tags:

2023-10-19 About

LLM prompting guide

Tags:

2023-10-13 About

Yam Peleg sur X : "Qwen-14B (Alibaba) The most powerful open-source model for it's size. And the longest trained: 3T tokens..."

Tags:

2023-09-28 About

[2309.12307] LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models

Tags:

2023-09-26 About

[2306.04640] ModuleFormer: Modularity Emerges from Mixture-of-Experts

Tags:

2023-09-16 About

Sebastien Bubeck sur X : "How far does one billion parameters take you? ... Releasing phi-1.5, a 1.3B parameter LLM exhibiting emergent behaviors surprisingly close to much larger LLMs"

Tags:

2023-09-12 About

Simon Willison sur Twitter : "Run Llama 2 on your own Mac using LLM and Homebrew..."

Tags:

2023-08-02 About

[2307.08621] Retentive Network: A Successor to Transformer for Large Language Models

Tags:

2023-07-20 About

Llama 2 is here - get it on Hugging Face

Tags:

2023-07-19 About

clem 🤗 sur Twitter : "Llama 2 by @Meta is already integrated with @huggingface transformers, TGI, inference endpoints, PEFT and much more..."

Tags:

2023-07-19 About

[2305.14128] Dr.ICL: Demonstration-Retrieved In-context Learning

Tags:

2023-07-14 About

Introducing Azure OpenAI Service On Your Data in Public Preview - Microsoft Community Hub

Tags:

2023-06-21 About

The Falcon has landed in the Hugging Face ecosystem

Tags:

2023-06-05 About

ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++

Tags:

2023-06-04 About

How to use Alpaca-LoRA to fine-tune a model like ChatGPT

Tags:

2023-05-26 About

State of GPT (Andrej Karpathy at Microsoft Build)

Tags:

2023-05-24 About

Bringing the power of AI to Windows 11

Tags:

Windows Copilot

2023-05-24 About

Google teases Project Tailwind — a prototype AI notebook that learns from your documents - The Verge

Tags:

2023-05-14 About

DataChazGPT sur Twitter : "The new 𝚝𝚛𝚊𝚗𝚜𝚏𝚘𝚛𝚖𝚎𝚛𝚜.𝚝𝚘𝚘𝚕𝚜 library from @huggingface is insane! E.g. you can summarize and chat with a PDF in just 6 lines of code..."

Tags:

2023-05-14 About

skeskinen/bert.cpp: ggml implementation of BERT

Tags:

2023-05-09 About

Google "We Have No Moat, And Neither Does OpenAI"

Tags:

> low-cost public involvement was enabled
by a vastly cheaper mechanism for fine tuning called low
rank adaptation ()[LoRA](tag:lora)

> **Part of what makes LoRA so effective is that ... it’s stackable.**
>
> By contrast, training giant models from scratch not only
throws away the pretraining, but also any iterative
improvements that have been made on top.

> LoRA updates are very cheap to produce (~$100) for the
most popular model sizes.

> Many of these projects are saving time by training on
small, highly curated datasets...
> These
datasets are built using synthetic methods (e.g. filtering
the best responses from an existing model) and
scavenging from other projects

> Directly Competing With Open Source
Is a Losing Proposition

> Paradoxically, the one clear winner in all of this is Meta.
Because the leaked model was theirs ([LLaMA](tag:llama)), they have
effectively garnered an entire planet's worth of free labor.
Since most open source innovation is happening on top of
their architecture, there is nothing stopping them from
directly incorporating it into their products.

2023-05-04 About

ArxivGPT - Chrome Web Store

Tags:

2023-04-27 About

Azure-Samples/azure-search-openai-demo: A sample app for the Retrieval-Augmented Generation pattern running in Azure

Tags:

2023-04-14 About

Diffusion language models – Sander Dieleman

Tags:

2023-04-06 About

Daniel Vila Suero sur Twitter : "Data quality is key for LLMs, but we're building Open Source LLMs with data of "unknown" quality... Introducing Alpaca GarbageCollector..."

Tags:

2023-04-05 About

Jim Fan sur Twitter : "...NVIDIA AI Foundations "

Tags:

2023-03-24 About

John H. Meyer 🚀 sur Twitter : "@emerywells That's actually what I built it for👀 Context: I unfortunately lost my dad unexpectedly at the young age of 50, back in 2017. There was a lot left un-said, and a lot I wish I could've spoken to him about in my adult life.…"

Tags:

2023-03-21 About

Maria Khalusova @maria@recsys.social sur Twitter : "Did you know that you can tweak the text output generated by a LLM without changing any of the trainable parameters?..."

Tags:

2023-02-23 About

Guiding Frozen Language Models with Learned Soft Prompts – Google AI Blog

Tags:

2023-02-14 About

[2203.14465] STaR: Bootstrapping Reasoning With Reasoning

Tags:

2023-02-07 About

Google announces ChatGPT rival Bard, with wider availability in ‘coming weeks’ - The Verge

Tags:

2023-02-07 About

Microsoft launches Teams Premium with features powered by OpenAI - The Verge

Tags:

2023-02-07 About

Generative AI with Cohere: Part 1 - Model Prompting

Tags:

2023-02-04 About

Ramsri Goutham Golla sur Twitter : "The most practical open-source competitor to @OpenAI 's GPT-3 is Google's Flan-T5 Here are 5 Flan-T5 resources to try out easily, deploy, or fine-tune it! 🧵" / Twitter

Tags:

2023-02-04 About

BioGPT

Tags:

2023-02-02 About

The Flan Collection: Advancing open source methods for instruction tuning – Google AI Blog

Tags:

2023-02-02 About

Shayne Longpre sur Twitter : "What’s the best completely public competitor to #ChatGPT? Flan-T5 beats all public models we tested..."

Tags:

2023-02-01 About

An empirical analysis of compute-optimal large language model training

Tags:

2023-01-26 About

Characterizing Emergent Phenomena in Large Language Models – Google AI Blog

Tags:

2023-01-26 About

Mate Marschalko sur Twitter : "ChatGPT in an iOS Shortcut — I built the World's Smartest HomeKit Voice Assistant #siri #homeautomation #openai #homekit #chatgpt"

Tags:

2023-01-23 About

Andrej Karpathy sur Twitter : "Great post (5mo ago) "chinchilla's wild implications" giving context to LLM goldrush shifting from model size to dataset size..."

Tags:

2023-01-05 About

[2201.04337] PromptBERT: Improving BERT Sentence Embeddings with Prompts

Tags:

2022-09-16 About

Prompt Tuning BERT🎯:CommonLit Readability | Kaggle

Tags:

2022-09-16 About

[2203.08913] Memorizing Transformers

Tags:

2022-05-07 About

[2108.13934] Robust Retrieval Augmented Generation for Zero-shot Slot Filling

Tags:

2022-01-19 About

Omer Levy sur Twitter : "What if I told you that fine-tuning T5-Large (0.8B params) on a couple hundred examples could outperform GPT-3 (175B params) on a bunch of tasks?"

Tags:

2021-10-13 About

How many data points is a prompt worth?

Tags:

2021-04-08 About

Hugging Face sur Twitter : "Transformers release of the Retrieval-Augmented Generation model in collaboration with @facebookai!"

Tags:

2021-02-23 About

Retrieval Augmented Generation with Huggingface Transformers and Ray | Distributed Computing with Ray

Tags:

2021-02-11 About