Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

CrowdGPT proposes a collaboratively trained 1B-parameter LLM

AI summary

Developer Vxtzq1 introduced CrowdGPT, a project intended to train a 1-billion-parameter LLM collaboratively on participants’ personal computers rather than in datacenters. The developer says the open-source project will publish training data and model weights, accept clean data submissions, and let participants help shape its direction; the data-submission pipeline is reportedly ready. The current model is described as a proof of concept, and these project details and capabilities have not been independently verified.

In-depth insight

CrowdGPT offers a decentralized, community-oriented alternative to conventional LLM training, but its technical viability and open-data claims remain unverified.

Hello, I'm developing CrowdGPT, a project aiming to create an LLM without datacenters and without the usual millions of dollars spent by AI companies. The project aims to train a 1 billion parameter model collaboratively and openly, with a protocol where everyone gets a say in the direction the project takes. Anyone can use their PC to train the AI independently, then add their contributions to the global model. Unlike most American and Chinese AI companies, the project is not only open-source, but also makes 100% of its training data public (along with the weights). Anyone can submit their own clean data to train the model, and even help steer the project in new directions. This creates the paradigm of an AI we all have a stake in. The project is open to as many people as possible, which is why I'd like to ask: what's stopping you from contributing to the project? I want to hear your answers so I can improve it. Are people simply willing to dedicate some of their GPU time to training a cool new open-source model? Or do they want something in return (like free inference credits on the crowdgpt model for example)? Although the current model is somewhat small (1 billion parameters), I plan to make it bigger / better in the future, and its current size is only meant as a proof of concept. Any advice / feedback on the project is welcome. Here's the project website: https://www.crowdgpt.net/ Or the GitHub if anyone wants to check out the code 😂 https://github.com/Vxtzq/CrowdGPT Thanks in advance. PS: I hope this post follows the subreddit's rules! My main goal is to gather criticism and understand how to make the project more accessible, not to advertise it 😅 EDIT: The data submission pipeline for the project (i'm mentioning in some replies) is ready!! Come check it at https://www.crowdgpt.net/#submit submitted by /u/Vxtzq1 [link] [comments]

#CrowdGPT

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.