File size: 351 Bytes
fe39385
5b96da5
 
 
 
 
 
fe39385
5b96da5
 
fe39385
5b96da5
 
 
 
 
528cb3d
5b96da5
 
 
4ef2d01
5b96da5
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
---
language:
- en
tags:
- spiking neural netwroks
- text-generation
- rwkv
license: bsd-2-clause
datasets:
- bookcorpus
---
---


---

# SpikeGPT-BookCorpus

## Model Description

SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See https://github.com/ridgerchu/SpikeGPT for details.

ctx_len = 1024
n_layer = 18
n_embd = 768