Also:
> These models were evaluated at full precision (float32)
For 4B effective parameters that's 16 GB ram.
Also:
> These models were evaluated at full precision (float32)
For 4B effective parameters that's 16 GB ram.