
Philosophy of language studies language's nature and its relationship with users and the world
Philosophy of language studies language's nature and its relationship with users and the world
Philosophy of language explores the intricate connections between language, its users, and the surrounding world. This field delves into various aspects such as meaning, indexicality, intentionality, reference, sentence constitution, concepts, learning, and thought. Understanding these connections is crucial for comprehending how language functions in different contexts and its impact on communication and cognition.
Example
In a conversation, the speaker's intention, the context, and the listener's background knowledge all play roles in interpreting the meaning of the words used.
Recognizing the importance of context and background knowledge helps improve effective communication and understanding in diverse situations.
Retrieval-augmented generation
RAG enables LLMs to access new information without retraining
Her Alibi
Bruce Beresford directed Her Alibi
paged attention (vLLM) improves serving throughput
Paged attention (vLLM) improves serving throughput by reducing latency through non-contiguous KV-cache pages, enabling faster data retrieval
the vocabulary size matters: larger vocab = shorter sequences but more parameters
Larger vocab reduces sequence length, increasing model complexity and parameters
Prompt engineering
The GenAI model learns tasks from examples in the prompt
the tokenizer's special tokens do: [CLS], [SEP], [PAD], [MASK] have specific roles
[CLS] marks the start of input, [SEP] denotes separation, [PAD] fills space, [MASK] hides words for prediction
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews