Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
|
1aurent29's comments
login
1aurent29
5 months ago
|
parent
|
context
[–]
| on:
Which table format do LLMs understand best?
Common enough words like `function` and `class` are generally encoded as a single token by the tokenizer and may provide a slightly better context to the LLM. For openai you can test this stuff at
https://platform.openai.com/tokenizer
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: