What is an AI Token? Day 3 of 100 Days of AI #Shorts

Name: What is an AI Token? Day 3 of 100 Days of AI #Shorts
Duration: 1 min

Transcript 117 words · about 1 min to read

Auto-generated captions from YouTube, not hand-corrected, so names and technical terms may be imperfect. The video is authoritative.

all right tokens per minute tokens per second we've seen this stat in AI what does that actually mean first off what is a token a token is a mathematical representation of some type of data object let's take text for an example in a typical model a token can represent 34 of a word so if something says it does 33 tokens per second with Gemini that means that it can ingest 33 tokens or process 334 of a word per minute which is faster than what a human

can read uh higher end gpus might have 500 tokens per second so tokens is the conversion of text to math so that AI can be done

4:41 Your GPUs Aren't Slow. Your Data Path Is

4:23 Where HPE Adds Value to NVIDIA CPUs

4:03 Not All NVIDIA AI Factories Are the Same

10:28 Borrow the Vendor's Plumbing, Not Its Judgment | RAG on AWS + NVIDIA DGX Spark

What is an AI Token? Day 3 of 100 Days of AI #Shorts

More CTO Dose