基础模型研究中心-智源“悟道”人工智能大模型-智源研究院官网

EN

新闻

科研: 科研项目


研究中心
基础模型研究中心生命模拟研究中心自主医学检查系统研究中心健康计算研究中心千方智慧医疗研究中心

智源学者
人工智能的数理基础机器学习智能信息检索与挖掘智能体系架构与芯片自然语言处理人工智能的认知神经基础自由探索

产业

生态

关于我们

加入智源

最新动态

悟道·天鹰 AquilaCode升级多语言代码生成，多项指标领先，开源可商用

2023年08月18日

智源「悟道3.0」Emu模型开源，「多模态-to-多模态」全能高手

2023年08月18日

「悟道·视界」视觉大模型系列，6项领先成果技术详解

2023年08月18日

FlagEval 天秤大模型评测体系及开放平台，打造更全面的引领性评测基准

2023年06月21日

悟道·天鹰 Aquila + 天秤 FlagEval，打造大模型能力与评测标准双标杆

2023年06月21日

开源 AltDiffusion-m18 ，18 种语言文图生成 all in one

2023年06月02日

10亿参数、多项SOTA，智源开源视觉基础模型EVA

2023年06月02日

智源研究院开源阿拉伯语通用大模型ALM，发布最大阿拉伯语数据集ArabicText

2023年06月02日

2021智源大会发布｜“悟道2.0”重磅发布

2022年08月08日

2021中关村论坛｜世界顶级专家共商大模型时代多学科发展

2022年08月08日

全网首个OpenPrompt尝鲜报告：Prompt研究者必备实验利器

2022年08月08日

2021智源三周年｜悟道大模型团队讲述项目背后的酸甜苦辣与未来计划

2022年08月08日

2021悟道科研基金（第一批）准支持名单公示

2022年08月08日

悟道之巅竞赛公开课（第4期）：悟道开发案例：悟空策论——议论文写作平台

2022年08月08日

悟道之巅竞赛公开课（第5期）：悟道API的应用部署及应用思路分享

2022年08月08日

学术进展

Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models

Wen Wang, Kangyang Xie, Zide Liu, Hao Chen, Yue Cao, Xinlong Wang, Chunhua Shen
2023

Images Speak in Images: A Generalist Painter for In-Context Visual Learning

Xinlong Wang, Wen Wang, Yue Cao, Chunhua Shen, Tiejun Huang
2023

SegGPT: Segmenting Everything In Context

Xinlong Wang, Xiaosong Zhang, Yue Cao, Wen Wang, Chunhua Shen, Tiejun Huang
2023

EVA-CLIP: Improved Training Techniques for CLIP at Scale

Quan Sun, Yuxin Fang, Ledell Wu, Xinlong Wang, Yue Cao
2023

Generative Pretraining in Multimodality

Quan Sun, Qiying Yu, Yufeng Cui, Fan Zhang, Xiaosong Zhang, Yueze Wang, Hongcheng Gao, Jingjing Liu, Tiejun Huang, Xinlong Wang
2023

AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities

Zhongzhi Chen, Guang Liu, Bo-Wen Zhang, Fulong Ye, Qinghong Yang, Ledell Wu
2023

Plan4MC: Skill Reinforcement Learning and Planning for Open-World Minecraft Tasks

Haoqi Yuan, Chi Zhang, Hongcheng Wang, Feiyang Xie, Penglin Cai, Hao Dong, Zongqing Lu
2023

Parameter-efficient Fine-tuning of Large-scale Pre-trained Language Models

Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li & Maosong Sun
2023

EVA: Exploring the Limits of Masked Visual Representation Learning at Scale

Yuxin Fang, Wen Wang, Binhui Xie, Quan Sun, Ledell Wu, Xinggang Wang, Tiejun Huang, Xinlong Wang, Yue Cao
2022

MAVEN: A Massive General Domain Event Detection Dataset

Xiaozhi Wang, Ziqi Wang, Xu Han, Wangyi Jiang, Rong Han, Zhiyuan Liu, Juanzi Li, Peng Li, Yankai Lin, Jie Zhou
2020

ExpanRL: Hierarchical Reinforcement Learning for Course Concept Expansion in MOOCs

Jifan Yu, Chenyu Wang, Gan Luo, Lei Hou, Juanzi Li, Jie Tang, Minlie Huang, Zhiyuan Liu
2020

MOOCCube: A Large-scale Data Repository for NLP Applications in MOOCs

Jifan Yu, Gan Luo, Tong Xiao, Qingyang Zhong, Yuquan Wang, Wenzheng Feng, Junyi Luo, Chenyu Wang, Lei Hou, Juanzi Li, Zhiyuan Liu, Jie Tang
2020

CogLTX: Applying BERT to Long Texts

Ming Ding, Chang Zhou, Hongxia Yang, Jie Tang
2020

OpenPrompt: An Open-source Framework for Prompt-learning

Ning Ding, Shengding Hu, Weilin Zhao, Yulin Chen, Zhiyuan Liu, Hai-Tao Zheng, Maosong Sun
2021

Better Robustness by More Coverage: Adversarial and Mixup Data Augmentation for Robust Finetuning

Chenglei Si, Zhengyan Zhang, Fanchao Qi , Zhiyuan Liu , Yasheng Wang, Qun Liu , Maosong Sun
2021

PPT: Pre-trained Prompt Tuning for Few-shot Learning

Yuxian Gu, Xu Han, Zhiyuan Liu, Minlie Huang
2021

Pre-Trained Models: Past, Present and Future

Xu Han, Zhengyan Zhang, Ning Ding, Yuxian Gu, Xiao Liu, Yuqi Huo, Jiezhong Qiu, Liang Zhang，Wentao Han, Minlie Huang, Qin Jin, Yanyan Lan, Yang Liu, Zhiyuan Liu, Zhiwu Lu, Xipeng Qiu, Ruihua Song, Jie Tang, Jirong Wen, Jinhui Yuan, Wayne Xin Zhao, Jun Zhu
2021

Prompt-Learning for Fine-Grained Entity Typing

Ning Ding, Yulin Chen, Xu Han, Guangwei Xu, Pengjun Xie, Haitao Zheng, Zhiyuan Liu, Juanzi Li, Hong-Gee Kim
2021

Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification

Shengding Hu, Ning Ding, Huadong Wang, Zhiyuan Liu, Juanzi Li, Maosong Sun
2021

CPM-2: Large-scale Cost-effective Pre-trained Language Models

Zhengyan Zhang, Yuxian Gu, Xu Han, Shengqi Chen, Chaojun Xiao, Zhenbo Sun, Yuan Yao, Fanchao Qi, Jian Guan, Pei Ke, Yanzheng Cai, Guoyang Zeng, Zhixing Tan, Zhiyuan Liu, Minlie Huang, Wentao Han, Yang Liu, Xiaoyan Zhu, Maosong Sun
2021

SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining

Chenglei Si, Zhengyan Zhang, Yingfa Chen, Fanchao Qi, Xiaozhi Wang, Zhiyuan Liu, Maosong Sun
2021

Cokebert: Contextual knowledge selection and embedding towards enhanced pre-trained language models

Yusheng Su, Xu Han, Zhengyan Zhang, Yankai Lin, Peng Li, Zhiyuan Liu, Jie Zhou, Maosong Sun
2021

CPM: A large-scale generative Chinese pre-trained language model

Zhengyan Zhang, Xu Han, Hao Zhou, Pei Ke, Yuxian Gu, Deming Ye, Yujia Qin, Yusheng Su, Haozhe Ji, Jian Guan, Fanchao Qi, Xiaozhi Wang, Yanan Zheng, Guoyang Zeng, Huanqi Cao, Shengqi Chen, Daixuan Li, Zhenbo Sun, Zhiyuan Liu, Minlie Huang, Wentao Han, Jie Tang, Juanzi Li, Xiaoyan Zhu, Maosong Sun
2021

Knowledge Inheritance for Pre-trained Language Models

Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
2021

PTR: Prompt Tuning with Rules for Text Classification

Xu Han, Weilin Zhao, Ning Ding, Zhiyuan Liu, Maosong Sun
2021

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models

Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun
2021

Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks

Zhengyan Zhang, Guangxuan Xiao, Yongwei Li, Tian Lv, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Xin Jiang, Maosong Sun
2021

EVA: An Open-Domain Chinese Dialogue System with Large-Scale Generative Pre-Training

Hao Zhou, Pei Ke, Zheng Zhang, Yuxian Gu, Yinhe Zheng, Chujie Zheng, Yida Wang, Chen Henry Wu, Hao Sun, Xiaocong Yang, Bosi Wen, Xiaoyan Zhu, Minlie Huang, Jie Tang
2021

KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation

Xiaozhi Wang, Tianyu Gao, Zhaocheng Zhu, Zhengyan Zhang, Zhiyuan Liu, Juanzi Li, Jian Tang
2021

MOOCCubeX: A Large Knowledge-centered Repository for Adaptive Learning in MOOCs

Jifan Yu, Yuquan Wang, Qingyang Zhong, Gan Luo, Yiming Mao, Kai Sun, Wenzheng Feng, Wei Xu, Shulin Cao, Kaisheng Zeng, Zijun Yao, Lei Hou,Yankai Lin, Peng Li, Jie Zhou,Bin Xu,Juanzi Li, Jie Tang,Maosong Sun
2021

Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability

Xin Lv, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Yichi Zhang, Zelin Dai
2021

TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graph

Jiaxin Shi, Shulin Cao, Lei Hou, Juanzi Li, Hanwang Zhang
2021

A Comprehensive Survey of Entity Alignment for Knowledge Graphs

Kaisheng Zeng, Chengjiang Li, Lei Hou, Juanzi Li, Ling Feng
2021

CogKR: Cognitive Graph for Multi-hop Knowledge Reasoning

Zhengxiao Du, Chang Zhou, Jiangchao Yao, Teng Tu, Letian Cheng, Hongxia Yang, Jingren Zhou, Jie Tang
2021

Self-supervised Learning: Generative or Contrastive

Xiao Liu, Fanjin Zhang, Zhenyu Hou, Li Mian, Zhaoyu Wang, Jing Zhang, Jie Tang
2021

Controllable Generation from Pre-trained Language Models via Inverse Prompting

Xu Zou, Da Yin, Qingyang Zhong, Ming Ding, Hongxia Yang, Zhilin Yang, Jie Tang
2021

GPT Understands, Too

Xiao Liu, Yanan Zheng, Zhengxiao Du, Ming Ding, Yujie Qian, Zhilin Yang, Jie Tang
2021

All NLP Tasks Are Generation Tasks: A General Pretraining Framework

Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, Jie Tang
2021

FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding

Yanan Zheng, Jing Zhou, Yujie Qian, Ming Ding, Jian Li, Ruslan Salakhutdinov, Jie Tang, Sebastian Ruder, Zhilin Yang
2021

CogView: Mastering Text-to-Image Generation via Transformers

Ming Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng, Chang Zhou, Da Yin, Junyang Lin, Xu Zou, Zhou Shao, Hongxia Yang, Jie Tang
2021

L2M-GAN: Learning To Manipulate Latent Space Semantics for Facial Attribute Editing

Yang Guoxing, Nanyi Fei, Mingyu Ding, Guangzhen Liu, Zhiwu Lu, and Tao Xiang
2021

IEPT: Instance-level and episode-level pretext tasks for few-shot learning

Zhang Manli, Jianhong Zhang, Zhiwu Lu, Tao Xiang, Mingyu Ding, and Songfang Huang
2021

WenLan: Bridging vision and language by large-scale multi-modal pre-training

Huo Yuqi, Manli Zhang, Guangzhen Liu, Haoyu Lu, Yizhao Gao, Guoxing Yang, Jingyuan Wen et al
2021

Modeling Protein Using Large-scale Pretrain Language Model

Yijia Xiao, Jiezhong Qiu, Ziang Li, Chang-Yu Hsieh, Jie Tang
2021

Self-Supervised Video Representation Learning with Constrained Spatiotemporal Jigsaw

Huo Yuqi, Mingyu Ding, Haoyu Lu, Zhiwu Lu, Tao Xiang, Ji-Rong Wen, Ziyuan Huang et al
2021

Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning

Yujia Qin, Xiaozhi Wang, Yusheng Su, Yankai Lin, Ning Ding, Zhiyuan Liu, Juanzi Li, Lei Hou, Peng Li, Maosong Sun, Jie Zhou
2021

MoEfication: Conditional Computation of Transformer Models for Efficient Inference

Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
2021

CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models

Yuan Yao, Ao Zhang, Zhengyan Zhang, Zhiyuan Liu, Tat-Seng Chua，Maosong Sun
2021

科研项目

vid2vid-zero：简单prompt（提示）即可视频编辑的零样本视频编辑方法

Painter通用视觉模型：首创「上下文视觉学习」技术路径

「视界」通用分割模型：一通百通，分割一切

EVA-CLIP：性能最强开源CLIP模型

「悟道3.0」Emu模型开源，「多模态-to-多模态」全能高手

开源 AltDiffusion-m18 ，18 种语言文图生成 all in one

用ChatGPT和强化学习玩转《我的世界》，Plan4MC攻克24个复杂任务

面向大规模预训练语言模型的参数高效微调

基于动态梯度调节的平衡化多模态学习

基于transformer的端到端的视频关系检测模型

多模态情感理解

基于文澜的海报设计：文本检索图像并自动设计海报

大模型轻量化微调

布灵剪辑工作室

面向知识的可解释复杂问题推理

大规模预训练模型的参数高效微调框架与工具

分布式大模型训练系统

面向动态视音场景的问答学习机制

EVA：大规模中文预训练对话模型

CPM: 以中文为核心的大规模预训练语言模型

XLORE 3.0: 大规模中英文跨语言知识图谱