posted 29th March, 2023 - 11:50, GPT4ALL launched 1 hr ago
What if we use AI generated prompt and response to train another AI
- Exactly the idea behind GPT4ALL, they generated 1 million prompt-response pairs using the GPT-3.5-Turbo OpenAI
API between March 20, 2023 and March 26th,
2023, and used this to train a large language model.
Work on prompt response model -
2. randomly selecting stackoverflow questions for coding knowledge
3. using dataset bigscience 's bloomz p3 from transformers (huggingface) - https://huggingface.co/bigscience/bloomz-p3
bells and some drumrolls
1. Amazing response with accuracy since the trained data is very fine tuned, i.e. running LLaMa on a 8GB RAM laptop possible.
Github repo - https://github.com/nomic-ai/gpt4all