noneabove1182@sh.itjust.worksM to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

HUGE dataset released for open source use

0

0

HUGE dataset released for open source use

noneabove1182@sh.itjust.worksM to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

0

RedPajama-Data-v2: An open dataset with 30 trillion tokens for training large language models

30T tokens, 20.5T in English, allegedly high quality, can’t wait to see people start putting it to use!

Related github: https://github.com/togethercomputer/RedPajama-Data

You must log in or register to comment.

Chat

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

5 users / day
5 users / week
5 users / month
31 users / 6 months
11 local subscribers
2.2K subscribers
74 Posts
54 Comments
Modlog