h2oGPT - The world's best open source GPT

h2oGPT is an open-source repository that provides code, data, and models for large language models or GPT. It includes code for preparing instruction datasets for fine-tuning of large language models, fine-tuning of large language models on commodity hardware and enterprise GPU servers, running a chatbot on a GPU server with a shareable endpoint with Python client API, and evaluating and comparing the performance of fine-tuned LLMs. The repository aims to make the world's best open-source GPT and provides open-source datasets and models on H2O.ai's Hugging Face page with a very simple demo app hosted on H2O.ai Hugging Face Spaces. The roadmap items include integrating code and resulting LLMs with downstream applications and low/no-code platforms, complement h2oGPT chatbot with search and other APIs, providing high-performance distributed training of larger models on trillion tokens, improving code completion, reasoning, mathematics, factual correctness, hallucinations, and avoid repetitions, and providing the ability to chat with h2oGPT.