互联网每个阶段周期差不多10年左右时间,每次都是“霸主更迭,资源洗牌分配,王朝更迭末期”的好时机。看谁能优先找到“新船票”上车…
2000-2010年PC互联网时代
2010-2020年移动互联网时代
第三代LLM/AGI辉煌时代
能够在第二代尾声活下来的人深度参与,不做旁观者,这样才能后面有机会挤进“豪门盛宴”牌桌。
对个人来说不管是爱好还是生存,起点差不多就是拼不断学习能力
1.基础入门
https://huggingface.co/docs/transformers/index
https://huggingface.co/docs/peft/index
https://huggingface.co/docs/accelerate/index
https://www.gradio.app/docs/
2.模型界github
https://huggingface.co/
https://www.modelscope.cn/models
3.分布式训练框架
https://pytorch.org/docs/stable/index.html
https://github.com/microsoft/DeepSpeed
https://docs.ray.io/en/latest/
4.RLHF
https://github.com/tatsu-lab/alpaca_farm
https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat
5.应用开发框架
https://python.langchain.com/docs/get_started/introduction.html
https://integrations.langchain.com/
https://github.com/hwchase17/langchain
https://github.com/jerryjliu/llama_index
6.训练Embedding模型
https://github.com/shibing624/text2vec
https://github.com/dbiir/UER-py
7.向量数据库
github.com/qdrant/qdrant
https://github.com/milvus-io/milvus/
github.com/semi-technologies/weaviate
8.开源项目
https://github.com/LianjiaTech/BELLE
https://github.com/tatsu-lab/stanford_alpaca
https://github.com/togethercomputer/OpenChatKit
https://github.com/mosaicml/llm-foundry
https://github.com/microsoft/JARVIS
https://github.com/microsoft/TaskMatrix
https://github.com/Significant-Gravitas/Auto-GPT
https://github.com/openai/chatgpt-retrieval-plugin
不断汇总中…
评论留言